Login Page - Create Account

Support Board


Date/Time: Wed, 08 May 2024 07:43:14 +0000



Post From: Spreadsheet number precision

[2019-03-03 10:01:27]
ARDAN - Posts: 66
I use a study which is filling AA column of a spreadsheet study.
I use =1/ROUND(1/J21,0) formula to Round the tick size to remove floating point errors in H21 cell as suggested in the documentation.
Then I use =MROUND(AA3, $H$21) in the cell AA3, =MROUND(AA4, $H$21) in the cell AA4 and so on.

The value in the cell H21 is always 0.1
But some rows in column AA is not rounded and I still see some of them have values such as -7.6000000000000005. I would expect it to be -7.6. How I can overcome this?
Thanks.