Technology for Tomorrow’s High Performance Exchanges Paul Michaud Global Executive IT Architect for Financial Markets November 2009 © 2009 IBM Corporation.

Slides:



Advertisements
Similar presentations
QA Function for Low Latency Trading Platform
Advertisements

Express5800/ft series servers Product Information Fault-Tolerant General Purpose Servers.
Copyright © 2007, GemStone Systems Inc. All Rights Reserved. Optimize computations with Grid data caching OGF21 Jags Ramnarayan Chief Architect, GemFire.
Message Queues COMP3017 Advanced Databases Dr Nicholas Gibbins –
Master/Slave Architecture Pattern Source: Pattern-Oriented Software Architecture, Vol. 1, Buschmann, et al.
Chapter 7 LAN Operating Systems LAN Software Software Compatibility Network Operating System (NOP) Architecture NOP Functions NOP Trends.
Serverless Network File Systems. Network File Systems Allow sharing among independent file systems in a transparent manner Mounting a remote directory.
High Availability Group 08: Võ Đức Vĩnh Nguyễn Quang Vũ
Oracle Data Guard Ensuring Disaster Recovery for Enterprise Data
NETWORK LOAD BALANCING NLB.  Network Load Balancing (NLB) is a Clustering Technology.  Windows Based. (windows server).  To scale performance, Network.
SANE: A Protection Architecture for Enterprise Networks Offense by: Amit Mondal Bert Gonzalez.
Business Continuity and DR, A Practical Implementation Mich Talebzadeh, Consultant, Deutsche Bank
Chapter 3 : Distributed Data Processing
Advanced Distributed Software Architectures and Technology group ADSaT 1 Scalability & Availability Paul Greenfield CSIRO.
.NET Mobile Application Development Introduction to Mobile and Distributed Applications.
A T AXONOMY AND S URVEY OF C LOUD C OMPUTING S YSTEMS Reporter: Steven Chen Date: 2010/10/27 1.
Module 14: Scalability and High Availability. Overview Key high availability features available in Oracle and SQL Server Key scalability features available.
National Manager Database Services
11 SERVER CLUSTERING Chapter 6. Chapter 6: SERVER CLUSTERING2 OVERVIEW  List the types of server clusters.  Determine which type of cluster to use for.
Real-time Stream Processing Architecture for Comcast IP Video
® IBM Software Group © 2005 IBM Corporation IBM Support for FIA (FIXML) Messaging Enterprise Service Bus View of Standards The Evolution of Messaging for.
Client/Server Architectures
© 2006 IBM Corporation SOA on your terms and our expertise Software Overview IBM WebSphere Message Broker Extender for TIBCO RV.
Computer Measurement Group, India Reliable and Scalable Data Streaming in Multi-Hop Architecture Sudhir Sangra, BMC Software Lalit.
Thriving in a Hybrid World Dean J. Marsh Vice President, Client Success IBM Analytic Solutions.
Word Wide Cache Distributed Caching for the Distributed Enterprise.
Software Engineer, #MongoDBDays.
The New Trading Platform
 Anil Nori Distinguished Engineer Microsoft Corporation.
HBase A column-centered database 1. Overview An Apache project Influenced by Google’s BigTable Built on Hadoop ▫A distributed file system ▫Supports Map-Reduce.
IMDGs An essential part of your architecture. About me
Middleware for FIs Apeego House 4B, Tardeo Rd. Mumbai Tel: Fax:
Multiprossesors Systems.. What are Distributed Databases ? “ A Logically interrelated collection of shared data ( and a description of this data) physically.
Lecture 4: Sun: 23/4/1435 Distributed Operating Systems Lecturer/ Kawther Abas CS- 492 : Distributed system & Parallel Processing.
11 December, th IETF, AAA WG1 AAA Proxies draft-ietf-aaa-proxies-01.txt David Mitton.
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
Components of a Sysplex. A sysplex is not a single product that you install in your data center. Rather, a sysplex is a collection of products, both hardware.
Network security Product Group 2 McAfee Network Security Platform.
Fast Crash Recovery in RAMCloud. Motivation The role of DRAM has been increasing – Facebook used 150TB of DRAM For 200TB of disk storage However, there.
Databases Illuminated
MGA Duplica Replication Tool. 1. High Availability and Avoidance of Data Loss  Replicate to alternate databases 2. Split activities across databases.
The Network Architecture of the Connection Machine CM-5 Charles E. Leiserson et al (Thinking Machines Corporation) Presented by Eric Carty-Fickes 1/28/04.
Ashish Prabhu Douglas Utzig High Availability Systems Group Server Technologies Oracle Corporation.
Copyright © 2006, GemStone Systems Inc. All Rights Reserved. Increasing computation throughput with Grid Data Caching Jags Ramnarayan Chief Architect GemStone.
AMQP, Message Broker Babu Ram Dawadi. overview Why MOM architecture? Messaging broker like RabbitMQ in brief RabbitMQ AMQP – What is it ?
Infrastructure for Data Warehouses. Basics Of Data Access Data Store Machine Memory Buffer Memory Cache Data Store Buffer Bus Structure.
CS 351/ IT 351 Modeling and Simulation Technologies HPC Architectures Dr. Jim Holten.
Warwick Rudd – Henry Rooney – How Available is SQL Server 2016? DAT33 6.
Cluster computing. 1.What is cluster computing? 2.Need of cluster computing. 3.Architecture 4.Applications of cluster computing 5.Advantages of cluster.
Univ. of TehranIntroduction to Computer Network1 An Introduction to Computer Networks University of Tehran Dept. of EE and Computer Engineering By: Dr.
The Google File System Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Presenter: Chao-Han Tsai (Some slides adapted from the Google’s series lectures)
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
Ignite in Sberbank: In-Memory Data Fabric for Financial Services
SysPlex -What’s the problem Problems are growing faster than uni-processor….1980’s Leads to SMP and loosely coupled Even faster than SMP and loosely coupled.
PHD Virtual Technologies “Reader’s Choice” Preferred product.
Cluster-Based Scalable
Ricardo Jimenez-Peris Universidad Politecnica de Madrid
Smart Building Solution
Managing Multi-User Databases
Introduction to Distributed Platforms
High Availability Linux (HA Linux)
Smart Building Solution
Maximum Availability Architecture Enterprise Technology Centre.
Chapter 19: Architecture, Implementation, and Testing
Mapping the Data Warehouse to a Multiprocessor Architecture
The Moscow Exchange CIO Update
Cloud Computing Architecture
Cloud Computing Architecture
Presentation transcript:

Technology for Tomorrow’s High Performance Exchanges Paul Michaud Global Executive IT Architect for Financial Markets November 2009 © 2009 IBM Corporation

Technology for Tomorrow’s High Performance Exchanges Advancements in Technology and Architecture For Exchanges  About 6 years ago IBM initiated a concentrated effort around developing technologies and best practice system design for exchanges under the umbrella of the Securities Exchange Reference Architecture (SXRA) project  Part of this effort involved building an exchange front office test harness, including Order Management Systems (OMS), FIX Gateways, Matching Engines, Transaction Loggers, Load Balancers and Monitoring Systems  IBM uses this test harness to test and refine both our technologies and our design ideas  This Proof of Technology platform has undergone 6 complete iterations and design changes over those years culminating in technologies and design patterns which are now being put into production

© 2009 IBM Corporation Technology for Tomorrow’s High Performance Exchanges SXRA Configuration OMS 1 Gateway 1 Data Logger XIV WMQLLM Message Store OMS2 Gateway 2 OMS 3 Gateway 3 OMS 4 Gateway 4 OMS 5 Gateway 5 OMS 6 Gateway 6 ME3-1 ME3-2 ME4-1 ME4-2 ME5-1 ME5-2 ME2-1 ME2-2 ME1-1 ME1-2 WMQ Low Latency Messaging Load Balancer Monitor

© 2009 IBM Corporation Technology for Tomorrow’s High Performance Exchanges Key Achievements  Demonstrated round trip Gateway to Gateway times as low as 12 usec  Matched over 6 Million orders per second on 5 partitions and demonstrated linear scalability with additional hardware  Unique High Availability (HA) mechanisms for running components in a Hot-Hot configuration  Detection and failover from primary matching engine to secondary in as little a 7 milliseconds  No loss or duplication of orders during failure  Total order of messages is enforced without central message sequencer, resulting in reduced latency and improved scalability  Support for parallel networks and fault tolerance in the event of network failure  Full message persistence at speeds of up to 7Gbps with a single IBM 3650 writing to disk, scalable horizontally with additional hardware  Ability to bring up new cold component (e.g. Matching Engine) and synchronize its state to the current primary on the fly  Ability to dynamically rebalance load across Matching Engines on the fly using theses state synchronization mechanisms  Most of these capabilities have been made available through IBM Websphere MQ Low Latency Messaging (LLM)

© 2009 IBM Corporation Technology for Tomorrow’s High Performance Exchanges Looking Forward  IBM continues to enhance the technology  Recent Additions –Split brain detection and prevention –Shared memory messaging capabilities –Improved manageability and monitoring –High resolution clock synchronization technology –Enhanced messaging modes for improved WAN support for DR  Going Forward –Continued improvements in performance, scalability and reliability –Streamlined API’s –Support for not just N+N but also N+1 reliability modes

© 2009 IBM Corporation Technology for Tomorrow’s High Performance Exchanges Additional Areas of Effort  Work using Infosphere Streams for Surveillance, Risk Management, Large Scale Monitoring and Process Automation  New Chip technologies for high performance message processing, routing, etc  Appliance based FIX engines  High Performance In Memory Databases  New Solid State Disk Technology