Login Page - Create Account

Support Board


Date/Time: Mon, 29 Apr 2024 01:14:31 +0000



Notice: Transact Websocket Connectivity Issue

View Count: 7698

[2019-08-29 20:57:33]
Sierra Chart Engineering - Posts: 104368
but I am sure traders community would appreciate the full functionality as well.
This is something that Transact will need to add to their compact JSON encoding.

And also in regards to this, it is something also that Transact will need to resolve if this persists with the compact JSON encoding:
lagging and disconnection

And also if the disconnect issue is resolved when using 1982 and the market is very active, then it quite likely indicates the problem was on the Transact side because the underlying handling of the websocket frames, which relates to the disconnect, is the same whether we are processing the binary price packet or the JSON messages. There is no difference.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-08-29 23:05:49
[2019-08-29 23:05:45]
User90125 - Posts: 715
It is clear, we probably have to bring back the bridge program, but we want to see what the feedback is with version 1982.

Presuming software engineering best practices, you should have the raw code from version 1941 (Build 27570:27571M) still available.

Perhaps a software fork from version 1941 (keeping the legacy TA code intact) adding recent changes and updates might be considered here?
[2019-08-30 18:33:47]
Sierra Chart Engineering - Posts: 104368
We have been told by Transact, that the main websocket production server of theirs does not yet properly support the JSON compact websocket encoding we have been using in 1982. So we switched back to the binary price packet processing in version 1983.

We did not realize this earlier because we were working on a different test server where the JSON compact encoding was working properly and in a certain way.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-08-30 20:39:25
[2019-08-30 20:19:38]
Meklon - Posts: 217
Support do you have any update on when the original Bridge connection with Transact may be coming back? Besides disabled chart trading latest version of Sierra also demonstrates a significant data lag. Real-time market data is delayed substantially, especially during highly active markets. This affects all chart types, from Number Bars and P&F to simple time interval.
Date Time Of Last Edit: 2019-08-30 20:20:24
[2019-08-31 19:13:10]
EdCarp - Posts: 25
This affects all chart types, from Number Bars and P&F to simple time interval.

Of course it does.

Would a rollback to pre-1941 fix all these issues? I'm running 1928 and haven't seen any issues at all. Because of the refusal of TransAct to support more DOM levels and symbols plus this new issue with websockets, I'm seriously considering moving my account to another broker.
Date Time Of Last Edit: 2019-08-31 19:27:04
[2019-08-31 21:48:06]
Meklon - Posts: 217
You are not alone. Many Transact customers feel the same. The worst part of this situation is that Transact completely refusing responsibility for this issue and pointing to Sierra. This is a silent push by Transact to force people switching to their new platform. They going to start losing business and customers in droves pretty soon.
[2019-09-01 03:23:15]
U_winks - Posts: 190
The worst part of this situation is that Transact completely refusing responsibility for this issue and pointing to Sierra. This is a silent push by Transact to force people switching to their new platform.

User 347037, glad that you've realised I wasn't making an assertive statement earlier for nothing.


As a Transact user, I'm also seriously considering changing brokers.. Especially if Transact still has lagging and order routing issues with the latest SC version in September onwards, based on what they have informed SC Support (post #46):


Yes it will be. We expect it will be out this coming month in September.

[2019-09-03 02:59:16]
Sierra Chart Engineering - Posts: 104368
You are not alone. Many Transact customers feel the same. The worst part of this situation is that Transact completely refusing responsibility for this issue and pointing to Sierra. This is a silent push by Transact to force people switching to their new platform. They going to start losing business and customers in droves pretty soon.

There are couple of basic issues here. One issue is lagging data and lagging data is almost always going to be an external cause. Refer to help topic 4:
Prices / Data Falling Behind

This is why we switched to the Transact compact JSON encoding but as of yet, they have not yet released that on their production server. We hope it will be this week.

The other problem is various websocket framing related errors. In the more than seven years or so that we have worked with websocket connections we have never seen any problem like this from a server.

If the issue is on the Sierra Chart side, it would be somewhere within the network I/O, encryption/decryption, Websocket framing layers or components. There is 0% chance it is at the network I/O or encryption/decryption layers. That is used extensively with all services including on our servers and that handles easily hundreds and hundreds of gigabytes a day flawlessly for years without any problem. There just is not a problem on our side there at all.

And with the websocket framing functionality, that is extensively used by CQG with 0% incidents like this ever over a period of at least five years. Although we are not sure we ever got frames larger than 65K from CQG and we do not know if that occurs with Transact either. However, we examined that code quite closely and see no problem. We also did a very thorough manual code review of the websocket functionality in Sierra Chart and see no problem.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-09-03 07:03:15]
EdCarp - Posts: 25
The other problem is various websocket framing related errors. In the more than seven years or so that we have worked with websocket connections we have never seen any problem like this from a server.

It's also quite possible that this is either a firmware issue inside the network card on TransAct's server, or a hardware issue with the network card itself. The only way to be sure, of course, would be to power down the server, remove power from the server for several seconds, then bring the server back up. If the problem persists, it is likely a hardware issue.
[2019-09-03 09:33:47]
Sierra Chart Engineering - Posts: 104368
No it does not make sense it would be at that level. The data would never have made it through due to the TCP protocol. The only other possibility is that websocket extensions are being used unknown to them and we do not know what they are, and that is altering the websocket frames in some way. This is what it appeared initially like but it does not seem as though this is the case based upon further logs we have seen.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-09-04 16:47:07]
Sierra Chart Engineering - Posts: 104368
If you are having problems, with losing the connection Transact and sometimes the reconnection not succeeding and the reconnection keeps getting lost over and over again, then use prerelease version 1985.

This uses the compact JSON format and Transact has released support for this.

Please let us know if this resolves the problem.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-09-05 00:15:33]
Sierra Chart Engineering - Posts: 104368
The answer to the question about bringing back the bridge, is we decided against that again. The reason is in our call today with Transact, they said they are close to having the trading Websocket connection available to be used.

And every time we have started the process of bringing back the bridge interface, it just was not simple there were many detailed changes required to do that and it was quite an involved process to do properly and thoroughly. And the bridge really is a substandard method of connectivity. We are not happy with bringing that back. For example, Transact brought an issue today to us about bridge connectivity. They said they spent an hour on the phone with helping someone with that, and the situation is still unresolved, and we had an experience a few weeks ago with the bridge, where after the connection was lost, the bridge was not able to connect again every time it was started (Or something like that, we forget the exact details). But we have seen this so my times in logs posted here over the years.

Also, as we said before if the prerelease 1985 solves this:
If you are having problems, with losing the connection Transact and sometimes the reconnection not succeeding and the reconnection keeps getting lost over and over again
It would indicate the problem was with Transact. We will provide a technical explanation later. But we need to have feedback in regards to this.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-09-05 00:49:05
[2019-09-05 01:03:52]
Meklon - Posts: 217
Support,

Did Transact confirmed and assured that they in fact committed to resolving this problem with Web Socket, eventually releasing working as well as stable solution?

The reason I am razing this question is because it has been over 3 months and they seem to be no closer to the finish line than they were before. Transact keeps pushing back on facts every time someone inquires on the status of the issue and not even offering an approximate timeline.
[2019-09-05 01:16:12]
Sierra Chart Engineering - Posts: 104368
They did not directly confirm that. But based on their own internal testing, the problem where they kept losing the connection on the websocket which was using the binary price packet is no longer occurring now that we are using the compact JSON encoding.

They do not believe the problem is on their side, but we did tell them today, it is exceptionally unlikely it is on the Sierra Chart side and we just left it at that. We said that we would have to go through a very low level buffer analysis to see what is happening, but if 1985 resolves this, then that will be unnecessary. This is why we want the feedback. We did not observe any problem today ourselves.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-09-05 01:16:48
[2019-09-06 18:58:10]
Sierra Chart Engineering - Posts: 104368
Transact has confirmed this in regards to the compact JSON encoding used by version 1985:

It seems the sierra websocket is holding up. I think its good to release.

And we also told them this in regards to the binary price packet encoding which earlier versions have used:
your timing of the message is interesting. I was just looking into see why it is we were having a problem previously.

I have confirmed, that when using the binary price packets, you are sending out corrupted websocket data at times which is causing the lost connection. I cannot see any other possibility. I have looked at this quite closely. Nothing changes on our side, at the websocket level when you are using the JSON format, the websocket processing remains identical. (Note: and as we said above, there could not possibly be an issue at the network I/O or encryption/decryption level/layer)

The only variance is that there is less data flowing but the only possible reason that could be an issue is that if there is a frame over 65K, there is a different block of code to determine the frame size, but it essentially works identically. But that is not what is happening. There are no frames ever coming in over that size, when we are getting corrupt data.

And with the subsequent processing of the binary price packet, that is a safe read-only processing . So it is not as though there is any potential for data corruption using the binary price packets causing this issue. If there is any potential for data corruption, it would be more likely with JSON but clearly that is not happening because now we are processing enormous amounts more of that using the compact JSON format. (Note: We already knew there is no corruption occurring with the JSON data processing either. This code is reliable and has never been a problem for years with various usage of JSON internally and also with external services)

We will force an update, over the weekend.

Furthermore, the only thing that changes when requesting the binary price packets, or the compact JSON encoding of the market data with the Transact websocket price data connection, is the payload content of the websocket frames. The problem has always been with the header data on those frames causing the lost connections. Changing the payload should never cause any problem with the header processing . It simply could not.

This is further confirmation the problem is with corrupt data from the Transact server. And additionally as we have said above, there have been 0% issues like this, corrupt frame headers, with websocket connections to Bitfinex, BitMex, and with CQG with massive extensive use over a period of at least 6 years.

So if Transact did say the problem was on the Sierra Chart side, this was not correct based on our findings.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-09-07 20:12:01
[2019-09-06 20:50:14]
User90125 - Posts: 715
We will force an update, over the weekend.

Does this finally enable live trading thru the websocket with Transact?
[2019-09-07 02:10:24]
Sierra Chart Engineering - Posts: 104368
No it does not.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
[2019-09-09 03:14:20]
User316362 - Posts: 210
Still can't connect using TransActWS version 1986. Going back to 1941 I guess.
[2019-09-09 04:31:47]
Sierra Chart Engineering - Posts: 104368
If you cannot connect, then just make sure you have set the correct settings as explained here:
https://www.sierrachart.com/index.php?page=doc/TransAct.php#SetupInstructions

And if you still cannot connect, then contact Transact support and they will allow the connection. You need to ask them to allow your Transact account to be able to use the new websocket connection.

If you continue to have problems connecting to Transact using the new websocket connection even after having asked them to allow the connection and there is an account logon error, then ask your broker about this.
Sierra Chart Support - Engineering Level

Your definitive source for support. Other responses are from users. Try to keep your questions brief and to the point. Be aware of support policy:
https://www.sierrachart.com/index.php?l=PostingInformation.php#GeneralInformation

For the most reliable, advanced, and zero cost futures order routing, *change* to the Teton service:
Sierra Chart Teton Futures Order Routing
Date Time Of Last Edit: 2019-09-09 07:02:46
[2019-09-09 05:31:46]
EdCarp - Posts: 25
so they can make a decision to either abandon SC altogether and move to TT, Lynnsoft Investore R/t, Bluewater or other platforms

Apparently the poster is either unaware that Sierra is not tied to TransAct - they can use any broker/data feed - or the poster is a shill for another trading platform.
[2019-09-13 02:29:01]
U_winks - Posts: 190
Don't be tricked by Transact or Infinity Futures into updating to v1986 and above. Their websocket connection is still useless.

User Crtfyd did that and encountered this problem, which SC Support confirmed:

The Transact websocket connection does not provide market depth data. Only the top of book. But you should still see bars based on the top of book. We are looking into this now.

NO BID ASK | Post: 191752

Ok we looked into this, the problem is the new Transact websocket data feed does not even provide best bid and ask size data either.

NO BID ASK | Post: 191759


Stick to v1941 for the time being, as advised by Transact staff themselves:

FYI: Just got off phone with Transact. He had me revert back to version 1941 (last one to work before new socket) and Bid/Ask works fine. He said first time he's heard of it. He said stay on this version until further notice. So you guys can do your stuff wherever the problem may be.

Reference thread: NO BID ASK

To post a message in this thread, you need to log in with your Sierra Chart account:

Login

Login Page - Create Account