Login Page - Create Account

Support Board


Date/Time: Sun, 05 May 2024 10:53:46 +0000



Can't display chart of scid files of expired futures offline

View Count: 1490

[2015-02-09 22:15:10]
User24804 - Posts: 19
How do I work with charts based on scid data of expired futures contracts.
SC rev 1224
I have several scid data files preserved for retrospective testing but am unable to do any work on them or even view them.

I'm using IB data normally for real time updating but once IB move on to the next front month my access within sierra of my stored data disappears.

Tried connected and disconnected modes

Am I doing something wrong?
I'd reasonably expect to view data up to the last update or at least be able to edit the data.

If Sierra can't do this
Can you supply a data transfer tool to export scid files to .txt or .csv to work with other charting tools?

Thank you
Martin

[2015-02-09 22:37:11]
Sierra Chart Engineering - Posts: 104368
What you are describing does not make sense and this is something that we have not heard reported before.

You simply open the data file through File >> New/Open Intraday Chart.

Here are the instructions:
https://www.sierrachart.com/index.php?page=doc/doc_GettingStarted.php#AlternateOpeningCharts
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-10 19:12:47]
User24804 - Posts: 19
Hi
I'm sorry you don't understand.

I've attached one of the files in question which is the Ftse100 future contract for September last.

I note that when opening an intraday file, SC automatically changes state from disconnected to connected.

I don't want to download data - there isn't any for an expired contract and IB return a symbol not found msg or similar.

I'm interested in looking at the old data and exporting it.

Hope you can help

Martin
attachmentZ-201409-ICEEU.scid - Attached On 2015-02-10 19:07:31 UTC - Size: 8.18 MB - 423 views
[2015-02-10 20:21:11]
Sierra Chart Engineering - Posts: 104368
This is some of the data that we see when we open the chart data file:
http://www.sierrachart.com/image.php?l=142359960280.png

Do you only see a blank chart when opening that file?

Also, Sierra Chart will not connect to data feed if the data file contains data unless the data is being filtered out by the Session Times.

Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-10 20:31:54]
User24804 - Posts: 19
Yes a blank screen if disconnected and a symbol not found msg from IB if connected

My Pic attached

Thanks for your pic, that's roughly what I would expect to see

BTW
SC ver 1224 on W7 64bit
imageSC2.PNG / V - Attached On 2015-02-10 20:31:23 UTC - Size: 34.19 KB - 375 views
[2015-02-10 20:48:28]
User24804 - Posts: 19
Sorry for that pic, You will note that the file name includes LIFFE instead of ICEEU.
Actually both files are identical except in name.

ICE made a takeover of the LIFFE exchange about then and we had to rename a lot of files. I have the same difficulty with the slightly older LIFFE files which of course are not recognised by IB due to name change.

A new pic attached and a log file of the attempt to open an intraday file.
Note that SC was "Disconnected" when the "open file" command was given
There are a few mins left of todays ICEEU session ending 2100 UTC

Thanks
Martin
imageSC3.PNG / V - Attached On 2015-02-10 20:45:01 UTC - Size: 46.73 KB - 351 views
attachmentSierralog1.txt - Attached On 2015-02-10 20:45:19 UTC - Size: 4.49 KB - 769 views
[2015-02-11 09:00:45]
Sierra Chart Engineering - Posts: 104368
You should see some data for sure. Refer to this documentation here to check the session times:
https://www.sierrachart.com/index.php?page=doc/doc_HistoricalIntradayData.html#h7.3


In regards to the historical data downloading, we need to do an update to symbol settings to minimize that.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-11 09:10:34]
Sierra Chart Engineering - Posts: 104368
Rename the chart data file using this format:
Z-######-ICEEU-GBP-1000

To avoid an excessive amount of historical data downloading.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-12 09:55:37]
User24804 - Posts: 19
There seem to be inconsistencies with this symbol system and behaviour.

I have succeeded in opening the expired scid file Z-291409-ICEEU when re-named Z-201409-ICEEU-GBP-1000.

However when calling for a new chart of the current front month from IB which is Z-201503 by using the full name Z-201503-ICEEU-GBP-1000 we are unsuccessful - see log attached

A subsequent request for Z-201503-ICEEU was accepted but the download is still on-going after circa 30 mins.

I will continue to explore the original query regarding expired contracts offline which is not satisfactorily resolved.

SC won't open OLD saved scid files and immediately makes calls to IB - why can't it read data SC created?

Is there some lack of backward data compatibility in the latest version?

I not in some cases, when a file appears to be opened but not displayed an F5 enquiry for properties shows that the date range of the file is "unknown"
An example is attatched



Private File
attachmentZ-201406-LIFFE.scid - Attached On 2015-02-12 09:55:24 UTC - Size: 7.77 MB - 375 views
[2015-02-12 19:58:35]
Sierra Chart Engineering - Posts: 104368
One of the problems is you need to reduce the Maximum Number of Historical Intraday Days to Download. Refer to this section here:

https://www.sierrachart.com/index.php?page=doc/IB.php#SlowDownloading

When we open your attached file, it displays:
http://www.sierrachart.com/image.php?l=1423771062696.png


The only reason why a file could not be opened and display nothing has to do with the Session Times and we already gave you information about that, or the file could not be read:
Error Messages When Opening Files

Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-16 09:54:41]
User24804 - Posts: 19
Major problems still exist.

Please clarify in order to eliminate issues

#1
Is SC scid data file format identical when created in W7 - 64 bit and W-XP - 32 bit environments?
We run both.

#2
When your help page refers to possible need for SC to be run as Administrator does this imply running with Windows 7's so-called "administrator" privileges (which we are) or is it ESSENTIAL to have genuine Super User creds?

Thus far these two points do not appear to be a problem - just being careful.

Martin



[2015-02-16 10:14:07]
Sierra Chart Engineering - Posts: 104368
1. Yes.

2. Just as a normal Windows administrator.

You should not have any trouble opening a chart data file. A problem like this is almost unheard of. So the chart is blank? Are there any error messages shown in the Sierra Chart Message Log? You are saying that when you go to Chart >> Chart Settings the date range is "Unknown to unknown". This makes no sense.

We opened the file you attached, just fine. The data file must be within the Sierra Chart Data Files Folder. And no other folder.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2015-02-16 10:14:33
[2015-02-16 16:03:12]
User24804 - Posts: 19
>>> The data file must be within the Sierra Chart Data Files Folder. And no other folder. <<<

I think there may be a clue here.
Although I have set a data folder up in general settings correctly, I have also tried setting this to look across a network to a remote folder with some very odd results.

Two consistent features of all attempts are
#1 that when a file has got as far as opening to a blank screen a dialogue starts up across the network even after it has been previously disconnected as though SC is searching for symbol confirmation or some such.

#2 An F5 query always shows date range unknown

I have also tried on a separate system which has been running SC reliably for years.
When opening some older files I got blank screens on occasion but finally a system crash on a hitherto stable system.
Error messsage
"Initialisation error. Error creating the alert manager object.
If you need more help contact SC support"

SC continues to give this msg even after re-starts and re boots.

I am going to re- install that platform XP 32 bit but also are doing a clean drive total re-install of the 64 bit W7

I'll be in touch when this has been done.

Perhaps you could suggest prefered initial general settings for SC and 1st chartbook.

Should I open the first chart as a currently available symbol with 1 or even zero days history and save that format as default so as to encourage SC not to go looking for a data update for old intraday charts which will definitely not be recognised by IB.

I'd simply like to open these old intraday files offline ideaaly.

Martin
[2015-02-16 16:56:29]
Sierra Chart Engineering - Posts: 104368
You are on your own with this:
I have also tried setting this to look across a network to a remote folder with some very odd results.
If you are having problems with this, it is your responsibility to determine why. This is the only reasonable explanation for the problem. There must be some problem with file access.

finally a system crash on a hitherto stable system.
Error messsage
"Initialisation error. Error creating the alert manager object.
If you need more help contact SC support"
In regards to this. We need to get the SCAlerts.JSON file from you. Please provide that to us. Do not delete it. We need to determine why this is happening.

This does not matter:


Should I open the first chart as a currently available symbol with 1 or even zero days history and save that format as default so as to encourage SC not to go looking for a data update for old intraday charts which will definitely not be recognised by IB.

The most important thing to minimize historical data downloading is to use a format which is listed in File >> Find Symbol.

Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-17 11:14:59]
User24804 - Posts: 19
Re - crash
Alerts file attatched
attachmentSCAlerts.json - Attached On 2015-02-17 11:14:04 UTC - Size: 104 B - 330 views
[2015-02-17 18:00:08]
Sierra Chart Engineering - Posts: 104368
Are you still having a problem with starting Sierra Chart?

This file is empty and contains no alerts and is not the cause of the problem.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-17 19:10:35]
User24804 - Posts: 19
Yes, I intend to re-install but didn't overwrite this install pending your input.
Are there any other log files etc that might give you a clue?
[2015-02-18 02:31:07]
Sierra Chart Engineering - Posts: 104368
When Sierra Chart is not running and we assume it is not, delete the SCAlerts.JSON file and see if you get the startup error.

If so, we need to add more logging to isolate the problem.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2015-02-18 12:22:50]
User24804 - Posts: 19
Progress - of a kind
From a fresh boot up and with SC not running
Deleted SCalerts.JSON

Launched IB's desktop TWS to present the login window

Step #1
Launched SC
SC came up with last chartbook appearing correctly but disconnrcted. See log sc180215-1-start.txt
did not connect or find TWS to login

Step #2
Initiated "Connect" via SC Con icon. See log sc180215-2-connect.txt
did not connect or find TWS to login

Step #3
Logged into TWS manually. See log sc180215-3-wkng.txt
Initiated "Connect" via SC Con icon.
Connection sucessful and data backfilled corectly.

Examined Data/Trade Settings panel
Noted that "Connect on Program Startup" was NO LONGER checked (this was previously checked)
Enabled auto "Connect on Program Startup" and saved settings and workbook and exited SC.

Step #4
With TWS login window visible , Re-launched SC. See log sc180215-4-nologin.txt
No auto connection
Initiated "Connect" via SC Con icon. No result
Log forwarded to you as requested

NB this is SC rev 1220 on 32bit XP

Thanks
Martin




Private File
Private File
Private File
Private File
[2015-02-18 19:32:28]
Sierra Chart Engineering - Posts: 104368
Our primary concern is about Sierra Chart starting up with an error in the Alerts Manager. We understand this problem is now solved for you. The underlying problem which we think is causing it, will be fixed in the next release.

As far as a problem logging into the TWS Login window, follow the instructions here for this:
http://www.sierrachart.com/index.php?page=doc/IB.php#AutomaticallyLogin

There is no guarantee that feature will work.

We have also verified from your Message Log that this is a valid Interactive Brokers symbol:
Z-201503-ICEEU-GBP-1000

Slow historical data downloading will be due to downloading too many days of Intraday history.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2015-02-18 20:32:48
[2015-02-25 20:39:18]
User24804 - Posts: 19
OK some feedback - both systems now working, one only after a complete re-install with default folders. I think that is relevant.

The probs with rev1224 seem to relate to how the software finds and updates data.
The initial install was slightly unusual on the D: drive not C:
This was to save disk space on a relatively small but very fast C:

I was also updating across a network to a data archive folder.
All rights and permissions correct and this worked well.

Issues only arose when I tried to open files of old or expired contracts 2014 and earlier.
It didn't seem to matter whether these were pulled across the network or whether they were copied onto the SC Install drive or the C: drive of the same machine. SC got frazzled by this and wouldn't read the files properly.

During the sort out, I resurected a retired PC with rev 897 I think with a default setup. Managed to read the files copied onto its hard drive - Fine.

I give this feedback since I didn't think my methodology was to far out. Perhaps a buglet has been uncovered to do with data paths.

Thanks for your help

Martin




[2015-02-25 21:43:50]
Sierra Chart Engineering - Posts: 104368
We definitely do not think there is a problem within Sierra Chart related to reading Intraday data files. With a large number of users that we have and the extensive use of Sierra Chart especially in server environments with zero problems, there could not be anything wrong.


If you are comparing to version 897, that reads files a little differently than newer versions. Newer versions of Sierra Chart will periodically close the file while reading through large blocks of data.

We see this as a system specific issue.

And as we indicated, if the file name does not follow one of the known symbol formats in Global Settings >> Symbol Settings, then historical data downloading will not stop at the contract expiration date and continue to the present time.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2015-02-25 21:44:28

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account