Login Page - Create Account

Support Board


Date/Time: Thu, 25 Apr 2024 13:29:56 +0000



Post From: Denali Data Feed Compression Available

[2020-09-24 20:24:04]
Sierra Chart Engineering - Posts: 104368
In regards to post #20 let us know if you notice an improvement being on that server.

And make sure you do have compression enabled as we explained further above (Post #6).

Latest compression data:
SC Data - All Services | Heartbeat from server | ServerReceivedClientHeartbeatSecondsAgo=6, NumberOfOutstandingSendBuffers=2, TransmissionDelayInMilliseconds=40, ServerSendBufferSizeInBytes=208, ActualMessageDelay=0.0 seconds, DataCompRatio=2.09, UncompressedBytes=614928397, CompressionTime=2.116531, NumCompressions=173507 | 2020-09-24 16:22:37.679

~615 MB compressed. Total compression time 2.11 seconds. Very impressive.


The way that we handle compression, is as follows:

The individual client connection in our real-time server program fills in a buffer with data to send to the user. That buffer, is then processed on one of multiple threads. Currently we are running 4 threads but this is tunable. We can increase as needed. The data is compressed, and then passed to the operating system to go out to the user. This is an overlapped I/O operation with no intermediate operating system buffer. The buffer goes straight out to the network adapter. Extremely efficient nonblocking process. We can easily scale this up by adding more CPU cores, and more threads.

But with very low compression time, is there is already ample capacity. And even during the busiest of times, there is no latency added which is perceivable. The average compression time is about 12 µs. This is microseconds. A tiny fraction of a millisecond.

Another advantage, as the market becomes busy and there is more data to transmit to the user, the compression ratio increases. It goes up to 3 or 4. Therefore the actual output data, is not much more.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2020-09-24 20:42:48