Login Page - Create Account

Support Board


Date/Time: Fri, 26 Apr 2024 01:09:03 +0000



Does symbol limit has an impact on batch downloading historical daily data?

View Count: 746

[2019-02-05 00:31:07]
Andy Sureway - Posts: 93
Hello SC team,

I have a subscription with 20 symbol limit. And I am doing a batch downloading via "Download daily data associated with watch list symbols". I observed that only a fraction of the symbol list got downloaded. Is that due to my symbol limit of 20?

Another observation, after the batch download, the memory usage of Windows became very high. Closing SC does not even help.

Thanks!
[2019-02-05 09:31:29]
Sierra Chart Engineering - Posts: 104368
No most likely it is due to other limits imposed by Barchart and we are working to resolve that.


Another observation, after the batch download, the memory usage of Windows became very high. Closing SC does not even help.
That is an issue on your side. Not at all with Sierra Chart.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-02-05 09:32:10
[2019-02-05 12:21:30]
Andy Sureway - Posts: 93
No most likely it is due to other limits imposed by Barchart and we are working to resolve that.

I further noticed that during the US night time, the downloading success rate is much much higher than that during US day time.
[2019-02-05 21:22:07]
Sierra Chart Engineering - Posts: 104368
This does not make any sense to us. We have never noticed a difference with this at any time of day.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-02-06 11:04:19]
Andy Sureway - Posts: 93
Well here are my observations: during the US day time, on average 4 symbols per minute are downloaded, while during the US night time, on average 21 symbols per minute are downloaded.

Nevertheless, the most important topic of this thread is, how to do batch downloading reliably? Because many of the valid requests got rejected, leading to a high failure rate.

Thanks!
[2019-02-06 19:56:39]
Sierra Chart Engineering - Posts: 104368
This is very poor performance to just have 4 symbols a minute. When you notice a problem where some symbols are failing, provide the Message Log. Instructions:
https://www.sierrachart.com/index.php?page=PostingInformation.php#MessageLog

First clear the Message Log before starting historical data download for the symbols.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-02-07 01:17:43]
Andy Sureway - Posts: 93
Thanks for your reply! I just sent a Message Log via "Send For Analysis" Option.

There are a few factors I want to mention:

1. I am downloading a large number of daily data, at least to my viewpoint.
2. Because of lacking of a better way to get all the valid contract names, I combine all 12 monthly contract names to every single underlying symbols. Thus half of the contracts names are not valid.
3. I did see a lot of error messages "daily quota exceeded".

Meanwhile, I came across a post and a SC documentation on this topic. I will take a good look of them.

Error: hourly quota exceeded during historical daily data download

Study/Chart Alerts And Scanning: Scanning Large Number of Historical (Daily) Charts

Thanks!
[2019-02-07 16:14:59]
Sierra Chart Engineering - Posts: 104368
Okay, your log is huge, and is beyond anything we are willing to go through. And based upon what you said above by getting the daily quota errors, obviously that is the problem. And that error is from Barchart, we do not control that.

We are planning to add a new service to allow any number of historical data downloads across any time, but this is going to be an additional cost.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-02-07 16:15:23
[2019-02-07 16:21:21]
Andy Sureway - Posts: 93
Thanks for your reply. Looking forward to that new features.
[2019-02-07 17:13:36]
Andy Sureway - Posts: 93
Also I read a thread on downloading daily data from ACSIL.
Feature Request: Download Historical Daily Data from ACSIL

Where can I find more documentation on this functionality? Thanks!
[2019-02-08 20:51:01]
Sierra Chart Engineering - Posts: 104368
This is documented here:
sc.StartDownloadHistoricalData()
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account