Support Board
Date/Time: Fri, 09 May 2025 12:13:40 +0000
Historical Data problems
View Count: 881
| [2025-01-02 23:15:48] |
| User8135477 - Posts: 133 |
|
1. Historical Data (daily candle) is not updating for COMEX, NYMEX, and non-index CME charts. 2. Last month, I reached my max limit for December. Today is only the 2nd day of January, and already shows a number of 367. How could this be? Ie. How is this number calculated? I run no more than 20 symbols at a time and cannot have requested 367 in such a short amount of time. Moreover, the charts have been active throughout the sessions and already download the majority of the data on a real time basis. I am wondering how the number is arrived, and whether it is possible for there to have been an error for January's count. |
| [2025-01-03 15:20:41] |
| John - SC Support - Posts: 39675 |
|
1. There is no reason for there to be an issue with this. What is one symbol for which you are having an issue? Please get us an image of that chart by following these instructions: Support Board Posting Information: Attaching or Posting a Screenshot/Image (Optional) For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2025-01-03 16:54:02] |
| User8135477 - Posts: 133 |
|
1. I'm not able to get the image anymore, since the correct historical data has now downloaded itself. This has happened intermittently throughout the past and is not the first time. 2. Please respond regarding this issue. I am noticing - everytime I boot up the computer from either sleep mode, or restarting the platform, I do see that historical data is being requested, even if it is literally within seconds after the program was shut down. Does this mean that for example, if I restart my computer twice within one hour, multiplied by 20 symbols -> I will have been recorded to have requested for the historical data 20x 2 = 40 times within the hour? |
| [2025-01-03 18:33:36] |
| Sierra_Chart Engineering - Posts: 19527 |
|
Every time Sierra Chart is restarted, it will download Historical Daily data for charts that are open. The computer coming out of sleep mode, will not cause historical daily data requests unless it has been 24 hours since the last download for the symbol. Yes: Does this mean that for example, if I restart my computer twice within one hour, multiplied by 20 symbols -> I will have been recorded to have requested for the historical data 20x 2 = 40 times within the hour?
This only applies to historical daily data for futures. And some cash indices. And also some intraday data like for ICE.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2025-01-03 18:34:18
|
| [2025-01-08 00:11:57] |
| User8135477 - Posts: 133 |
|
This only applies to historical daily data for futures.
If I change the chart setting to "Intraday Chart Only", will the requests still get counted for certain time frames? |
| [2025-01-08 00:24:53] |
| Sierra_Chart Engineering - Posts: 19527 |
|
No but let us know the symbol. Because it still will in the case of ICE.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2025-01-08 00:28:57] |
| User8135477 - Posts: 133 |
|
I just kept track, and it got counted again. I had one chartbook with the 4 CME indices. MES/M2K/MYM/MNQ. I set the chart to "Intraday Chart Only", and had the time period set @ 1-0-0 (1 Day). I reopened the chart and confirmed that the "Historical Data Downloading" message popped up again. I refreshed my counter under my account, and saw that the counter went up again, thus confirming that I am being counted for non-Historical data requests as well? |
| [2025-01-08 15:56:01] |
| User8135477 - Posts: 133 |
|
I'd like to follow up on this thread? I have approx 22 historical charts, but I am being counted for more than double the amount. This only makes sense if any of the following is actually happening: 1. Every time I start from sleep. 2. Non-historical charts. |
| [2025-01-09 21:52:19] |
| Sierra_Chart Engineering - Posts: 19527 |
|
This is 100% completely impossible: thus confirming that I am being counted for non-Historical data requests as well?
It simply does not happen, unless the symbols are for ICE, which they are not, or their is some symbol settings misconfiguration on your side. Understand that that counter you are looking at, updates on a delay. About 5 to 10 minutes. So you cannot refresh it immediately and look for a change. Try disabling custom Symbol Settings: Global Symbol Settings: Disabling Custom Symbol Settings Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2025-01-09 23:33:41] |
| User8135477 - Posts: 133 |
|
I have a total of less than 30 Historical Charts Running at a time. No ICE symbols. It's not making sense why I am being counted for so many requests. Some additional info that may help troubleshoot: 1. Upon reconnection/wake from sleep, the Historical Daily Data charts do not display anything, but the intraday charts have the alerts pop up in the following order: Waiting to Download Historical Data -> Downloading Historical Data -> Historical Data Complete. 2. I am connected to IBKR. Please advise what else I can try aside from disabling custom symbol settings. |
| [2025-01-16 15:08:49] |
| Sierra_Chart Engineering - Posts: 19527 |
|
Update to the latest version of Sierra Chart. Instructions: Software Download: Fast Update You need to search the Message Log for this text: SC External HD service This indicates historical data downloads that are being counted. Only these ones. No other ones are counted. This makes no sense. Why would this be the case: the Historical Daily Data charts do not display anything,
Something is wrong with your system if this is happening. Stop using sleep. This is definitively not a Sierra Chart problem at all. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2025-01-16 15:10:48
|
| [2025-01-19 07:22:47] |
| User8135477 - Posts: 133 |
|
You need to search the Message Log for this text: SC External HD service
This indicates historical data downloads that are being counted. Only these ones. No other ones are counted. I ran the search. I see that I am being counted multiple times for the same ticker (once for each contract month/year, but within the same symbol). However, as mentioned in the description under the Daily Data Download Limit: Sierra Chart Historical Data Service For Continuous Futures Contract charts, there are multiple data requests made when the initial data is downloaded.
It does not seem right that I am being counted for previous contract months upon every start up, even after the initial data had already been downloaded previously. |
| [2025-01-19 20:53:59] |
| Sierra_Chart Engineering - Posts: 19527 |
|
It does not seem right that I am being counted for previous contract months upon every start up, even after the initial data had already been downloaded previously. What symbol does this occur with, and how many days of data are you loading in the chart?We have to do a test and see what the problem is. Maybe you are loading more data than is available. For example, you could be trying to load 10 years of MES data, yet that contract does not exist 10 years ago. Or you could have incorrect Rollover settings for a symbol causing downloads to keep reoccurring. Those should be left at the default. Refer to: Continuous Futures Contract Charts: Preventing Error Messages by Reducing Days to Load in Chart Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2025-01-19 23:05:58] |
| User8135477 - Posts: 133 |
|
It occurs with the 4 CME micro-indices. There may be more in my 2nd instance, but I have not checked that yet (which would require another Fast Update, and my reasons for avoiding that are made clear later below). Or you could have incorrect Rollover settings for a symbol causing downloads to keep reoccurring. Those should be left at the default.
As per your recommendation from a while ago (+1 year?) the Rollover setting was changed to Volume Based rollover, (back adjusted).Maybe you are loading more data than is available. For example, you could be trying to load 10 years of MES data, yet that contract does not exist 10 years ago.
Rather than Days to Load, I have had it set to Use Date Range. The Start Date goes back to only 2023. But for some reason, I do see chart data dating back to 2022. That is still well after the inception of MES data.Refer to:Continuous Futures Contract Charts: Preventing Error Messages by Reducing Days to Load in Chart
All being said, I do see that the Error Messages as referred to in your link still show up, dating back to 1970's. This seems to be an error on the program's part - Why would this error message even apply if I have only set it to go back to 2023, with the "Use Date Range" method?For now, I will change it to Use Number of Days to Load. Please keep me posted on your findings. --------------------------------------- As a side note, after doing the Fast Update, I had to go back to my previous version because your latest update for the Price Expansion tool (which I rely on heavily and make frequent adjustments) is very inefficient. It changed what was already simple & intuitive to use into something that requires additional clicks and is also visually more difficult to navigate. Specifically, the updated version now requires for me to click twice to toggle on/off a level (once to highlight the field, once to toggle). Previously, it was a simple checkbox for each level. Furthermore, the updated level after changing the numerical input does not show instantaneously on the chart. It now requires that I either click "Apply", or hit "Enter", and in the latter case, the cursor disappears from the screen and does not reappear unless I move the mouse around everywhere - after which I have to search for the cursor which subsequently ends up on a different part of the screen. This is for every single level that I choose to update. And in case you were considering suggesting that I save multiple different levels under different settings, that is not a good option because there are an infinite combination of levels, and I cannot simply have them all preset. On another note, doing the "Install Previous Version" method left me with a glitchy interface, where no menu would show after trying to right click on any chart drawings. I had to do a hard wipe and reinstall from a prior backup. The Price Expansion tool was working perfectly with the previous version - I respectfully request that you consider allowing for the previous functions for future updates. Date Time Of Last Edit: 2025-01-19 23:07:30
|
| [2025-01-20 22:58:45] |
| Sierra_Chart Engineering - Posts: 19527 |
|
As a side note, after doing the Fast Update, I had to go back to my previous version because your latest update for the Price Expansion tool (which I rely on heavily and make frequent adjustments) is very inefficient. It changed what was already simple & intuitive to use into something that requires additional clicks and is also visually more difficult to navigate. Specifically, the updated version now requires for me to click twice to toggle on/off a level (once to highlight the field, once to toggle). Previously, it was a simple checkbox for each level. Furthermore, the updated level after changing the numerical input does not show instantaneously on the chart. It now requires that I either click "Apply", or hit "Enter", and in the latter case, the cursor disappears from the screen and does not reappear unless I move the mouse around everywhere - after which I have to search for the cursor which subsequently ends up on a different part of the screen. This is for every single level that I choose to update. On another note, doing the "Install Previous Version" method left me with a glitchy interface, where no menu would show after trying to right click on any chart drawings. I had to do a hard wipe and reinstall from a prior backup. This is easily resolved by configuring the menus through Global Settings >> Customize * Menu.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2025-01-21 05:30:43
|
| [2025-01-21 05:31:05] |
| Sierra_Chart Engineering - Posts: 19527 |
|
All being said, I do see that the Error Messages as referred to in your link still show up, dating back to 1970's. This seems to be an error on the program's part - Why would this error message even apply if I have only set it to go back to 2023, with the "Use Date Range" method? This could not be an error in Sierra Chart. There must be one chart loading data back to the 1970s. Although the starting date for a symbol which is not receiving any historical daily data, will be back to the 1970s but that is not an unusual. Although there is not going to be a request for a specific contract year back then. Unless a chart is requesting it.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2025-01-21 05:32:06
|
| [2025-01-21 06:16:56] |
| User8135477 - Posts: 133 |
|
This could not be an error in Sierra Chart. There must be one chart loading data back to the 1970s. Although the starting date for a symbol which is not receiving any historical daily data, will be back to the 1970s but that is not an unusual. Although there is not going to be a request for a specific contract year back then. Unless a chart is requesting it.
None of my charts go back that far. However, as mentioned, when I leave the setting to "Use Date Range", the actual historical data displayed does not follow the specification, and they display more than specified. This is typically no further than 2022. This is partly what I was referring to when I mentioned that it seems to be an error on the program's part. Only one of the charts go back to 2019 (MES) - This one may be trying date back to the 1970's, but that doesn't account for the other symbols. Regardless, as mentioned, I have changed them to "Use Number of Days to Load" for now. |
| [2025-01-21 07:10:00] |
| Sierra_Chart Engineering - Posts: 19527 |
|
Check this setting: Data/Trade Service Settings: Maximum Historical Days to Download for Daily Data (Global Settings >> Data/Trade Service Settings >> Common Settings >> Historical Daily Data) Make sure it is set to 20000 to ensure enough historical daily data gets downloaded. When you see a date of 1970 show us the message, so we can understand it. We are sure this is normal and is just the starting download date, whether the data is available back then or not, for a symbol. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2025-01-21 07:36:09] |
| User8135477 - Posts: 133 |
|
The setting was at 18250 as per the default mode. Do you still recommend for me to increase to 20000? On another note, doing the "Install Previous Version" method left me with a glitchy interface, where no menu would show after trying to right click on any chart drawings. I had to do a hard wipe and reinstall from a prior backup.
This is easily resolved by configuring the menus through Global Settings >> Customize * Menu. None of my keyboard shortcuts were working either after doing the Previous Version Install. When you see a date of 1970 show us the message, so we can understand it. We are sure this is normal and is just the starting download date, whether the data is available back then or not, for a symbol.
I've uploaded a copy of the log from a few days ago, when I had run the Fast Update. |
Private File Attachment Deleted. |
| [2025-01-21 08:28:33] |
| Sierra_Chart Engineering - Posts: 19527 |
|
No this is not necessary: . Do you still recommend for me to increase to 20000?
There are differences with the internal values used for keyboard shortcuts between the more recent versions and older versions. This is the reason for the problem and they have to be reconfigured if going back to an older version. This is definitely the problem: Line 63: 2025-01-18 21:32:24.491 | MES-202503-CME-USD [CBV] Daily #3 | Error while getting daily settlement price with date 1970-09-18 from file. C:\SierraChart\Data\MES-197009-CME-USD.dly. Error: No Data for read. End of file. Line 64: 2025-01-18 21:32:24.491 | MES-202503-CME-USD [CBV] Daily #3 | Error while getting daily settlement price with date 0 from file. C:\SierraChart\Data\MES-197012-CME-USD.dly. Error: No Data for read. End of file. It is chart #3, that is loading data back to 1970. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing |
| [2025-01-21 18:43:32] |
| User8135477 - Posts: 133 |
|
This is definitely the problem:
Line 63: 2025-01-18 21:32:24.491 | MES-202503-CME-USD [CBV] Daily #3 | Error while getting daily settlement price with date 1970-09-18 from file. C:\SierraChart\Data\MES-197009-CME-USD.dly. Error: No Data for read. End of file. Line 64: 2025-01-18 21:32:24.491 | MES-202503-CME-USD [CBV] Daily #3 | Error while getting daily settlement price with date 0 from file. C:\SierraChart\Data\MES-197012-CME-USD.dly. Error: No Data for read. End of file. What about the other charts? If you scroll down further there is also this: | MNQ-202503-CME-USD [CBV] Monthly #1 | Error while getting daily settlement price with date 1970-06-19 And how do you suggest I go about fixing the problem? As mentioned, the Use Date Range was only set for starting in 2023. For now, I have changed it to Use Number of Days to Load. |
| [2025-01-24 20:59:27] |
| Sierra_Chart Engineering - Posts: 19527 |
|
We cannot reproduce any problem like this, but this chart has been loading data, back to at least 1965 from the log: | MNQ-202503-CME-USD [CBV] Monthly #1
If this is still happening and only if this is still happening provide that chart by following these instructions:Support Board Posting Information: Providing Chartbook with Only a Single Chart 2025-01-18 21:32:25.836 | MES-202503-CME-USD [CBV] Weekly #2 | Error while getting daily settlement price with date 1965-12-17 from file. C:\SierraChart\Data\MES-196512-CME-USD.dly. Error: No Data for read. End of file.
Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2025-01-24 21:00:42
|
| [2025-02-05 03:33:38] |
| User8135477 - Posts: 133 |
|
Historical data is not updating properly again today, as mentioned in the 1st & 2nd posts of this thread: 1. Historical Data (daily candle) is not updating for COMEX, NYMEX, and non-index CME charts.
John's reply: 1. There is no reason for there to be an issue with this. What is one symbol for which you are having an issue? Please get us an image of that chart by following these instructions: Support Board Posting Information: Attaching or Posting a Screenshot/Image (Optional)
For today, this has happened to some of my NYMEX symbols. I've attached a copy of the MCL (both daily historical & intraday data are problematic). FYI, the problem is also present for PL (Daily historical is fine, but intraday data are problematic). Date Time Of Last Edit: 2025-02-05 03:43:07
|
Private File |
| [2025-02-05 07:09:59] |
| Sierra_Chart Engineering - Posts: 19527 |
|
What issue do you have with intraday data? We do not know. The daily data looks fine for MCL: https://www.sierrachart.com/image.php?Image=1738734431315.png Re-download the data: Edit Menu: Edit >> Download Data from End of Chart Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, use the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2025-02-05 07:10:17
|
| [2025-02-05 08:40:18] |
| User8135477 - Posts: 133 |
|
The daily data looks fine for MCL:
https://www.sierrachart.com/image.php?Image=1738734431315.png Did you compare your image to what I uploaded? It did NOT look fine at the time. And yes, I re-downloaded the data prior to uploading the image. As of this point, the data has now corrected itself. This has happened so many times over the past year that I've lost count. Ie. There is an issue with the missing data -> does not correct itself even after re-downloading the data -> then, after about 12-24 hours of the problem persisting, it gets resolved by itself. What issue do you have with intraday data? We do not know.
The problem is the same as what I described for the historical data. The difference is that it just occurs on the intraday charts. Date Time Of Last Edit: 2025-02-05 17:27:24
|
To post a message in this thread, you need to log in with your Sierra Chart account: