Login Page - Create Account

Support Board


Date/Time: Thu, 09 May 2024 02:16:47 +0000



Post From: Spreadsheet number precision

[2013-07-31 02:47:22]
joshtrader - Posts: 440
Unfortunately this does not address the issue. All references to this value will reference the same inaccurate number, and I will have to manually truncate the number. Every single number referenced, BEFORE it is used in a calculation, must be truncated. This means that instead of:

=E3-E5

I have:

=TRUNC(E3,2)-TRUNC(E5,2)

Plus, this will necessarily yield incorrect value when using formulas such as MAX() which takes a range, and every number in the range needs to be truncated but can't be.

I just don't understand how SC can be introducing data that is not there--where does this come from? How does 454.02 become 454.0214 ? I can understand losing precision in some cases, but the spreadsheet study is adding precision, and I have no idea where that incorrect data is coming from.

I know you are working on a new spreadsheet system--will this be addressed in the new code?
Date Time Of Last Edit: 2013-07-31 02:52:06