Login Page - Create Account

Support Board


Date/Time: Tue, 07 May 2024 20:33:31 +0000



Large data file (SCID) size

View Count: 1941

[2016-03-11 15:16:05]
nth - Posts: 46
I am aware of the "Large Data File Setting" that automatically moves out data from a large intraday data file based on MB.

Is it possible to utilize this feature based on the date or time? e.g., I'd like to have data available for the past five or six quarters or 15 to 18 months.

Best,
nth
[2016-03-11 17:47:05]
Sierra Chart Engineering - Posts: 104368
For a long time now this has been replaced with this new feature:
https://www.sierrachart.com/index.php?page=doc/doc_DataSourceSettings.php#DataFileManagement

Have a look at this new feature and it should effectively do what you want.

Really you are running an unsupported version at this time. We know you have a specific reason to do so, but you really should update. Your version of Sierra Chart is very out of date.

We also no longer recommend anyone to use the Barchart Data Service directly and use this service:
Sierra Chart Exchange Data Feed
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2016-03-11 23:39:36]
nth - Posts: 46
Is it possible to restrict this "large data file" compression process to one specific scid file or will it do all scid files in "Data" folder?

I upgraded to current SC version without incident. Will check out SC data feed service v BarChart.
[2016-03-12 00:13:10]
nth - Posts: 46
I see now my question has been answered by the instructions that ALL SCID files are compressed. Sorry.

It appears to do calendar days correct?

I set 550 days which I assumed would "remove" any data older than Sep 2014 but I still find data back to July 2013 which includes then the data that has been "compressed"?

Hmmmm... I was hoping unneeded data would be "archived" as before. My current setup searches the entire SCID data file by default (no date limit setting available) and thus the search is taking longer as the SCID data file is much larger than necessary.

In other ideas?

Best,
nth
[2016-03-12 00:30:41]
Sierra Chart Engineering - Posts: 104368
The data is not removed, it is only compressed.

The setting does consider calendar days.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2016-07-06 18:53:42]
nth - Posts: 46
RE: prior questions on this thread and your replies, my scid continues to grow with every rollover "join file" I perform. Using my 3rd party sftwr, it reads every record in the scid file (right now about 3 years worth of records or about 9,270,000 "bars") even if my import requests only one day's worth or a years worth of date.

The compression feature doesn't seem to change the amount of time importing scid data significantly.

I know this is a unique situation and I am not expecting you all to jump through hoops to accommodate my need. However, before I spend a small fortune to have a programmer solve my problem, I must ask if an outdated version of Sierra Chart (SC) could accomplish reducing the number of data records from current scid file, using the "Large Data File Setting" feature? And would the outdated SC version still be available for download? And once done, could I then use this new smaller scid file in my current SC version 1307?

Of course, if you have a better idea, I am open to any suggestions.

Hopes this makes sense.

Best,
nth
[2016-07-06 19:10:22]
Sierra Chart Engineering - Posts: 104368
Yes an earlier version can help by using the Large Data File Setting but we do not know what version that is in.

Probably a version from more than two years ago will work. You can find older versions here:
https://www.sierrachart.com/index.php?page=doc/SCInstallerList.php

And once done, could I then use this new smaller scid file in my current SC version 1307?
Yes.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2016-07-07 17:06:25
[2016-07-07 16:10:06]
nth - Posts: 46
Thx very much. Not quite sure how I pulled it off but I have the result I wanted!! Best, nth

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account