Support Board
Support Board
Search Board
Control Panel
View My Posts / Threads
Direct MessagesDate/Time: Fri, 26 Apr 2024 11:15:49 +0000
[Programming Help] - Data Integrity control
View Count: 731
| [2018-06-18 07:30:44] |
| User393279 - Posts: 1 |
|
Good day, I belong to the community of traders who are using swing system to trade stocks from s&p500. We are using your services SC Data – All Services [data] to get EOD historical data. We have Service Package 5. Our WatchList has more than 500 tickers, and we download data for each ticker through SierraChart->Edit->Download Daily Data for Associated Watch List Symbol. Each ticker has always a history of couple thousand days. I found out that SierraChart does not control data integrity, at all. Meaning, it does not check if data from previous download are same as newest data on your server. If I download any ticker it will save as, for example ZTS.dly. Problem is that sometimes data are not downloaded properly. For example, there could be couple of years of data missing. I would expect that with every new download Sierra would compare data on my PC with data on your server and in case of and dissimilarity it would ask me to overwrite my previous data. Unfortunately, it is not happening. Most probably, SierraChart just check the latest date in .dly file and add data up to current date. This is useless. I intentionally manually deleted part of data (I removed data from approximately 2006 until 2013) from already existing ZTS.dly file and Sierra did not care at all. It was not corrected with next download. I had to delete .dly file from my HDD and after that with next download Sierra created a new and correct file. Same thing is happening when there is a Split in stock. (Division of the nominal value of the share into more shares with smaller value, where sum of shares with smaller nominal value is equal to nominal value of original share). In this case historical recalculation of price values is happening. Unfortunately, SierraChart does not care that on my HDD I have original data which does not fit with newly recalculated data on your server anymore. So, in this case, to get newest recalculated data I do not have any other choice only to manually delete original .dly file from my HDD and after that let SierraChart to download most recent recalculated data. It would be great if SierraChart would implement some kind of control and comparison between already existing data on my HDD with newest data from your server. After the control, SierraChart would notify user and possibly ask for permission to overwrite original data. You cannot expect that your clients will be manually checking hundreds of tickers to find out if they have correctly downloaded data and if they match newest historical recalculation after spilt of the ticker. We also cannot delete old .dly files every day and let SierraChart download new updated .dly files. Anyway this does not rule out the possibility of mistakes while downloading data from your server. This problem is significantly affecting our trading system. Therefore, it would be great if you can look into this problem and help us find a solution. I look forward to your reply. |
| [2018-06-19 00:18:13] |
| |
|
We understand what you are saying but the problem simply is that there is no way Sierra Chart can know whether data is missing because it is just not available or whether it is missing due to some other reason. We cannot try to re-download data every time there is missing data, otherwise it creates another new much much worse problem. The historical daily date also comes from a server we do not control and we cannot know what data is available from it or not. Possibly we could add certain types of records indicating there is missing data due to the data not being available and not try to re-download, but that is a significant development task, that we just cannot be involved with at this time. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing |
| [2018-06-19 00:26:04] |
| |
|
This is useless. I intentionally manually deleted part of data (I removed data from approximately 2006 until 2013) from already existing ZTS.dly file and Sierra did not care at all. Of course this is going to be the case. It would be a huge mistake for Sierra Chart to re-download that data. This complicates things, and also in most cases this is not even what the user would want.And you do not have to do any type of file deleting. You just need to use this command: "Edit >> Delete All Data and Download". Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2018-06-19 00:27:06
|
| [2018-06-19 06:02:33] |
| |
|
One thing that we also want to point out is that really this is something that is exceptionaly unlikely: Problem is that sometimes data are not downloaded properly. For example, there could be couple of years of data missing.
Rarely would we hear about a problem like this, if at all. It really makes no sense that among downloaded data, that there would be missing years somewhere other than at the end. It would make more sense that the download would fail due to a communication problem or data restriction, and the most recent data is missing. Therefore, when the download is done again, since the missing data from the end is downloaded including the last two days within the file, it will then be filled in. In regards to automatic adjusting of the historical data with stock splits, that would really only be practical with historical daily data, which you are using but that is not yet something we have had any time to work on. And there are also associated complications with this as well. Sierra Chart Support - Engineering Level Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy: https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service: Sierra Chart Teton Futures Order Routing Date Time Of Last Edit: 2018-06-19 06:59:38
|
To post a message in this thread, you need to log in with your Sierra Chart account: