Login Page - Create Account

Support Board


Date/Time: Sat, 27 Apr 2024 03:54:47 +0000



Spreadsheet number precision

View Count: 1977

[2013-07-30 18:25:06]
joshtrader - Posts: 439
I am getting quotes on my spreadsheet with a precision of .0001 when I have the spreadsheet set to 0.01 ... I am not sure why this happens, as AAPL should not be quoting to that precision.

http://screencast.com/t/r5RilD8H
[2013-07-30 18:42:59]
Sierra Chart Engineering - Posts: 104368
Make sure you select all of the cells and set the number format to .01.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2013-07-31 02:47:22]
joshtrader - Posts: 439
Unfortunately this does not address the issue. All references to this value will reference the same inaccurate number, and I will have to manually truncate the number. Every single number referenced, BEFORE it is used in a calculation, must be truncated. This means that instead of:

=E3-E5

I have:

=TRUNC(E3,2)-TRUNC(E5,2)

Plus, this will necessarily yield incorrect value when using formulas such as MAX() which takes a range, and every number in the range needs to be truncated but can't be.

I just don't understand how SC can be introducing data that is not there--where does this come from? How does 454.02 become 454.0214 ? I can understand losing precision in some cases, but the spreadsheet study is adding precision, and I have no idea where that incorrect data is coming from.

I know you are working on a new spreadsheet system--will this be addressed in the new code?
Date Time Of Last Edit: 2013-07-31 02:52:06
[2013-07-31 03:12:26]
joshtrader - Posts: 439
Actually, I just realized that the problem is worse than I thought. I can not use TRUNC() but must use ROUND() instead. All I can hope is that rounding will yield the actual values. I.E., I have to hope that 454.86 is given in the spreadsheet as greater than or equal to 454.855 and less than 454.865
[2013-07-31 03:47:35]
Sawtooth - Posts: 3976
Here is what I do to round the OHLC to the tick size:

1) Round the tick size to remove floating point errors. Put this in H21:
=1/ROUND(1/J21,0)

2) Round the Last price to the tick size multiple:
=MROUND(E3,$H$21)
Date Time Of Last Edit: 2013-07-31 03:49:02
[2013-07-31 05:33:13]
Sierra Chart Engineering - Posts: 104368
This data comes from the data feed. So you need to ask the data service you are using about the additional digits.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-03-03 10:01:27]
ARDAN - Posts: 66
I use a study which is filling AA column of a spreadsheet study.
I use =1/ROUND(1/J21,0) formula to Round the tick size to remove floating point errors in H21 cell as suggested in the documentation.
Then I use =MROUND(AA3, $H$21) in the cell AA3, =MROUND(AA4, $H$21) in the cell AA4 and so on.

The value in the cell H21 is always 0.1
But some rows in column AA is not rounded and I still see some of them have values such as -7.6000000000000005. I would expect it to be -7.6. How I can overcome this?
Thanks.
[2019-03-04 07:33:50]
ARDAN - Posts: 66
I've made another test.
my data in AQ@3 is 0.9934338927268982. in AR@3 I typed: =MROUND(AQ3,0.01) and I see 0.9900000000000002 as value. How can I overcome this?
Thanks.
[2019-03-04 12:13:49]
Sierra Chart Engineering - Posts: 104368
You have to change the Value Format for those cells. Refer to:
Working with Spreadsheets: Cell Formatting
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-04-09 03:28:25]
whats1thingnow - Posts: 407
when i click

Spreadsheet >> Number Format
or
Spreadsheet >> Cell Properties

i do not see a popup/window...

i have to hit 'esc' until i can interact with the spreadsheet again

i tried:
Window >> Reset Windows to reset it back to its default position


but still i cannot see it :(

please and thank you for the help!
[2019-04-09 04:37:03]
Sierra Chart Engineering - Posts: 104368
Refer to:
High CPU Usage | Inactive User Interface | Poor Performance | Long Time to Load Chart Data | Charts Reloading Often: 30.40 - Dialog Windows Do Not Display (Dialog Windows Do Not Display)
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-04-09 04:37:21

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account