Login Page - Create Account

Support Board


Date/Time: Thu, 28 Mar 2024 09:58:52 +0000



Post From: TT order routing

[2019-08-17 15:51:11]
4trading - Posts: 20
Greetings:

I found this post Sat. morning. TT posted an update dated to yesterday (16th) here:
https://www.tradingtechnologies.com/blog/2019/08/16/update-on-the-tt-outage-on-august-13-2019/

Actions to be taken:
Short-term actions

Beginning this weekend and over the next few weeks, Zookeeper services will be moved to separate hosts from UMP.
Beginning this weekend and over the next few weeks, all UMP hosts will be switched to solid state drives. These types of storage devices are far superior to traditional spinning disk drives, which will increase the servers’ disk I/O capacity.
We are actively working internally to reproduce the two Zookeeper-related defects where (a) the Zookeeper leader responsibility was not properly transferred to a follower on a restart and (b) Order Gateways lost connection to the entire Zookeeper cluster when only a single node was restarted.
We will be making a change in Algo servers to better handle real-time changes to the Zookeeper cluster to ensure proper cleanup of synthetic orders when cancelled after a change is made.
We will enhance the size and scope of our scalability test environment and invest the necessary engineering resources to enable automation of a base set of cross-component load tests that run weekly across multiple versions of code.

Medium/long-term actions
We are working on a roadmap to share directly with clients which will highlight the series of changes we will be making to both our scale/load testing procedures as well as any design or architectural changes to address the instability experienced in the last few months.

Date Time Of Last Edit: 2019-08-17 18:40:27