Login Page - Create Account

Support Board


Date/Time: Tue, 07 May 2024 13:52:10 +0000



Compress a specific symbol's data file, not all of them

View Count: 169

[2024-03-29 02:40:56]
joshtrader - Posts: 439
From the documentation, it seems that compression of data files can only be performed on all symbols, or none of them. Is this accurate?

For some data files I have no need for tick data (TICK-NYSE, for example). For others, I do. Further, these non-contract symbols like TICK-NYSE or stocks like AAPL grow forever, so, I'd be happy to compress them every so often. Futures contracts, however, I never want to compress, especially given that the contract expires and the file size is ultimately capped.

Is there a way to compress only specific symbol data files?
[2024-03-29 13:37:32]
John - SC Support - Posts: 31419
There is only the option to "compress" all the files, there is not an option to only compress some or one.
For the most reliable, advanced, and zero cost futures order routing, use the Teton service:
Sierra Chart Teton Futures Order Routing
[2024-03-30 15:15:00]
User823591 - Posts: 21
joshtrader,

There is a way to accomplish what you're trying to do .... it will require you to install a separate instance of Sierra Chart.

Name this separate instance whatever you want .... for example - SierraChart2 (I will use this example throughout my explanation)

Now go into your main SierraChart installation to the Data folder & copy all the .scid files that you want to compress.

Paste those .scid files into the Data folder of the new instance .... SierraChart2 in my example.
Launch the separate instance of (SierraChart2) and then compress the files, when done you can close this instance.

Now go into the Data folder of SierraChart2 & copy all the .scid files you just compressed .... (all the steps are just reversed)
So you will then paste those copied files back into the Data folder of your main SierraChart instance .... (all steps are now complete)

Once you confirm everything is working as intended, you can delete the SierraChart2 file folder (if you wish to do so).
[2024-03-30 15:33:39]
joshtrader - Posts: 439
Thank you User823591. I wasn't sure whether this might cause issues with future appending of data. I guess after manually compressing the files, SC will continue to append data at the granularity specified in the data settings. For example, if I use tick data and compress to 1 minute data, then future appending on those specific files will still be tick data. And, if I compress the data again in the future, all of the data will be 1 minute, and the process repeats. Is this the way it works?
[2024-03-30 15:57:30]
User823591 - Posts: 21
joshtrader,

That is exactly correct in regards to future appending data & if you was to re-compress a .scid file again .... you clearly understand how it works.
[2024-03-30 18:29:42]
Sierra_Chart Engineering - Posts: 14255
You can compress a specific file, by installing a separate installation of Sierra Chart. And copying that file to the Data Files Folder of that installation.

The best most efficient operating model, is to put all of the data files, you want to be compressing currently and in the future, in that installation of Sierra Chart and just have charts for them there. So you can have a separate installation, for stocks and market statistics.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, use the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2024-03-30 18:33:10
[2024-03-30 19:45:30]
User823591 - Posts: 21
Sierra_Chart Engineering .... In regards to your response in Post #6

It may not be the ideal solution for for certain Chartbooks created.

For example, I have a Chartbook that has the following symbols:
E-mini S&P 500 (ES)
E-mini Nasdaq 100 (NQ)
DOW JONES 30 INDUSTRIALS (NYSE)
NYSE-TICK (Market Statistics)

As you can see in my above Chartbook where there is various exchanges being displayed .... having a separate instance is not ideal.

Not sure how (joshtrader) has his Chartbooks setup .... but it may be a similar situation.

Also with the CME connection restrictions in mind, you may not want to waste that separate instance.
[2024-03-30 22:23:41]
Sierra_Chart Engineering - Posts: 14255
If you want to do different data management with a different category of symbols like stocks, it is logical to keep them in a separate installation. That is a different exchange.

And also regarding connection limits, those limits are controlled independently for different exchanges or exchange groups.

You could have 3 CME Group connections on the same computer and 3 real-time US equities data connections on the same computer. So you can have a total of 6 instances.

And also you can use sub instances and accomplish the same thing as well and use a single connection to the server.

With sub instances you can have an unlimited number of them.

Intraday Data File Management: Compressing Specific Intraday Files and Not All | Using Different Compression Time Units for Specific Symbols
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, use the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2024-03-30 22:23:52

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account