Login Page - Create Account

Support Board


Date/Time: Sat, 20 Apr 2024 03:07:10 +0000



Problems facing due to size on disk which is 63 GB

View Count: 733

[2020-03-26 17:12:35]
User857142 - Posts: 82
HI

I am facing problems due to size on disk which is 63 GB. SC doesnt work in few mins when the disk is full.
I have attached the screenshots for the same.

Please solve it asap.

Thanks
imagesize on disk.png / V - Attached On 2020-03-26 17:10:11 UTC - Size: 16.59 KB - 233 views
imagescid.png / V - Attached On 2020-03-26 17:10:18 UTC - Size: 22.92 KB - 246 views
[2020-03-26 18:27:36]
Sierra Chart Engineering - Posts: 104368
Yes this is going to be a problem. Although the data files are compressed.

However, you can do further compression:
https://www.sierrachart.com/index.php?page=doc/DataSourceSettings.php#IntradayDataFileManagement

But the fastest solution is going to be to re-download the data with a higher storage unit:
Data/Trade Service Settings: Intraday Data Storage Time Unit (Global Settings >> Data/Trade Service Settings >> Common Settings >> Common Settings)

For example, you could use 10 seconds.

Additionally you should get a larger storage drive.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-03-26 18:27:49
[2020-04-03 11:57:13]
User857142 - Posts: 82
I was not expecting this answer. Anyways I have to deal with it!
Something which is a known problem to your team, should have been solved till now!
[2020-04-03 12:25:05]
Sierra Chart Engineering - Posts: 104368
Solve what? What known problem? This is not making any sense to us. If your system is low on storage space, any program is going to have a problem including the operating system.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-04-03 12:25:11
[2020-04-10 21:41:51]
User857142 - Posts: 82
you mean to say your .SCID extension files with 80GBs each storage on disk is ok?
looks like you have jumped here without seeing the screenshot of the initial post!
[2020-04-12 01:38:28]
Sierra Chart Engineering - Posts: 104368
Those files are compressed. And why do you make reference to "your SCID extension files"?

That is market data from providers, which is the result of trading activity going on in the world. If you want tick by tick data, those files will be large. Years of that data will consume significant space but it is compressed. Refer to:
https://www.sierrachart.com/index.php?page=doc/DataSourceSettings.php#IntradayDataFileManagement

So yes it is ok. This is the reality. This is what users want.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-04-12 01:38:59
[2020-04-13 11:07:16]
bradh - Posts: 853
That is market data from providers, which is the result of trading activity going on in the world.

The size is determined by not only the number of days your chart is requesting, but the oldest date recorded in the file, and the intraday data storage time unit. The latter is going to make the biggest files if you set it to "1 Tick", as it represents market data on a trade by trade basis.

The first thing I would do is delete all the SCID files and then reload your charts. Only the dates needed by the chart will be downloaded and therefore changed. If you have have been trading Forex for a while your files will keep growing. With futures data, a new SCID file gets created when the contract rolls over, so you can delete the older (e.g. > 1 year) SCID files and free up space that way too. The fresh download could take a while and the files will not be compressed at first, so you will see higher than normal disk and CPU activity until they are compressed.

Also, your Size on Disk is only 22 GB, the 63GB would be the uncompressed size. So if you don't have room for 22 GB on your drive, consider removing other data and/or programs to free up space, and of course, upgrading your storage.
[2020-04-13 17:40:26]
Sierra Chart Engineering - Posts: 104368
Only the dates needed by the chart will be downloaded and therefore changed
This is not correct. The amount of data download depends upon this setting:
https://www.sierrachart.com/index.php?page=doc/DataSourceSettings.php#MaxHistoricalIntradayDaysToDownload

The fresh download could take a while and the files will not be compressed at first, so you will see higher than normal disk and CPU activity until they are compressed.
This does not make sense. The operating system performs compression on-the-fly and the space used will be based upon NTFS compression. We have never known any different behavior. It really makes no sense the files would not be compressed. They must be compressed.

We did verify that compression is set on the file, when the file is opened for data downloading.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-04-13 17:43:11

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account