Data Services for Service Oriented Architecture in Finance D. Britton Johnston Chief Technology Evangelist.

Slides:



Advertisements
Similar presentations
Enterprise Data Integration For Service Oriented Architectures Enterprise Architect Summit – June, 2004 Christopher Keene – CEO, Persistence Software
Advertisements

October 10-13, 2006 San Diego Convention Center, San Diego California VoIP/SOA Integration Impact on IT Apps, Processes, & Overall Business.
Presentation Title | Date | Page 1 Extracting Value from SOA.
C9: SOA Management with Actional® for Sonic™
Distributed Systems Architectures
© 2007 Open Grid Forum Grids in the IT Data Center OGF 21 - Seattle Nick Werstiuk October 16, 2007.
May 2007 Global Technology & Operations | Network Computing Group | Global Enterprise Access & Desktop Services | Network Services Document Release Level/Version:
18 Copyright © 2005, Oracle. All rights reserved. Distributing Modular Applications: Introduction to Web Services.
0 - 0.
1Copyright © 2013, Oracle and/or its affiliates. All rights reserved.
Govern the Flow of Data: Moving from Chaos to Control
Hello i am so and so, title/role and a little background on myself (i.e. former microsoft employee or anything interesting) set context for what going.
Copyright © 2012 AirWatch, LLC. All rights reserved. Proprietary & Confidential. Mobile Content Strategies and Deployment Best Practices.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 31 Slide 1 Service-centric Software Engineering.
Cloud Computing for Education & Cloud Learning Minjuan Wang to BT Research Center (Abu Dhabi) Educational Technology San Diego State University
ICS 434 Advanced Database Systems
ACT! 3.0 For Notes R5 Turning Contacts Into Relationships and Relationships Into Results Copyright (C) 2002 – GL Computing.
1. 2 Captaris Workflow Microsoft SharePoint User Group 16 May 2006.
Windows Azure and the Hybrid Cloud Arnie Locsin
CA's Management Database (MDB): The EITM Foundation -WO108SN.
1 Chapter 11: Data Centre Administration Objectives Data Centre Structure Data Centre Structure Data Centre Administration Data Centre Administration Data.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 31 Slide 1 Service-centric Software Engineering 1.
Database Architectures and the Web
Cloud Computing: Theirs, Mine and Ours Belinda G. Watkins, VP EIS - Network Computing FedEx Services March 11, 2011.
1 1 Rules and Regulations Business Drivers for SOA-based Agile IT Presented by Adrian Bowles, Ph.D. Program Director, Regulatory Compliance Object Management.
JUNE 2007 page 1 EDS Proprietary Applications Modernization Services Modernizing the Applications Portfolio.
Agile Infrastructure built on OpenStack Building The Next Generation Data Center with OpenStack John Griffith, Senior Software Engineer,
Service Oriented Architecture Terry Woods Session 50.
Building an Operational Enterprise Architecture and Service Oriented Architecture Best Practices Presented by: Ajay Budhraja Copyright 2006 Ajay Budhraja,
® IBM India Research Lab © 2006 IBM Corporation Challenges in Building a Strategic Information Integration Infrastructure Mukesh Mohania IBM India Research.
Oracle Fusion Middleware
Service Oriented Architecture Concepts March 27, 2006 Chris Armstrong
Leveraging Technology to Enhance PeopleSoft Web Services (SOA) System Efficiency Lorne Kaufman, Managing Director.
1 Software architecture adjustments for a changing business.
SOA with Progress Philipp Walther Consultant. © 2007 Progress Software Corporation2 Agenda  SOA  Enterprise Service Bus (ESB)  The Progress SOA Portfolio.
Citrix Partner Update The Citrix Delivery Centre.
Asper School of Business University of Manitoba Systems Analysis & Design Instructor: Bob Travica System architectures Updated: November 2014.
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 17 Client-Server Processing, Parallel Database Processing,
© 2006 IBM Corporation SOA on your terms and our expertise Discovering the Value of SOA SOA In Action SOA & End-2-End Business Driven Development using.
David Besemer, CTO On Demand Data Integration with Data Virtualization.
® IBM Software Group © IBM Corporation IBM Information Server Service Oriented Architecture WebSphere Information Services Director (WISD)
How WebMD Maintains Operational Flexibility with NoSQL Rajeev Borborah, Sr. Director, Engineering Matt Wilson – Director, Production Engineering – Consumer.
Hosted by SAP Future Directions: 2003 and Beyond Joshua Greenbaum, Principal Enterprise Applications Consulting
CHAPTER FIVE Enterprise Architectures. Enterprise Architecture (Introduction) An enterprise-wide plan for managing and implementing corporate data assets.
SANPoint Foundation Suite HA Robert Soderbery Sr. Director, Product Management VERITAS Software Corporation.
Word Wide Cache Distributed Caching for the Distributed Enterprise.
Cloud Computing for the Enterprise November 18th, This work is licensed under a Creative Commons.
SOA based Business Solutions Krishna Prasad Sunil Kumar K.V.
INT-11: It’s Monday Morning, Do You Know Where Your Service Has Been? Service Management with Sonic ™ and Actional Marv Stone Progress Software.
McGraw-Hill/Irwin © The McGraw-Hill Companies, All Rights Reserved BUSINESS PLUG-IN B17 Organizational Architecture Trends.
Progress SOA Reference Model Explained Mike Ormerod Applied Architect 9/8/2008.
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Business Plug-In B17 Organizational Architecture Trends.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Enterprise Architectures.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
SOA-25: Data Distribution Solutions Using DataXtend ® Semantic Integrator for Sonic ™ ESB Users Jim Barton Solution Architect.
SOA-02: Sonic SOA Products Overview Luis Maldonado Technical Product Manager Sonic Software.
INNOV-4: Breaking Down Enterprise Application Data Silos with Data Services Ken Rugg Vice President, Data Services.
SOA-05: Building an Enterprise SOA Using ESB Dave Chappell Vice President & Chief Technology Evangelist, Sonic Software.
Cloud Computing 3. TECHNOLOGY GUIDE 3: Cloud Computing 2 Copyright John Wiley & Sons Canada.
Data Services for Service Oriented Architecture in Finance
EMC: Redefining ERP and ROI with a Virtualized SAP HANA® Deployment
Service-centric Software Engineering
Ebusiness Infrastructure Platform
Architectural Roadmap
XtremeData on the Microsoft Azure Cloud Platform:
SOA-1: Fundamentals of Service-Oriented Architecture
Presented by: Tracey DeLeeuw CEO, Strategist SmartSpeed.ca
SO-Architectural Roadmap
Presentation transcript:

Data Services for Service Oriented Architecture in Finance D. Britton Johnston Chief Technology Evangelist

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 2 Agenda Service Oriented Architecture Ideal for high performance trading systems SOA requires enterprise data architecture Reliable, consistent and timely data Trading system case studies demonstrate benefits of well thought-out and executed data architecture for SOA

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 3 Case Example: Sell-Side BankDBDBDBDBDBDBDBDBDBDB Real-Time Trading Applications ApplicationApplicationApplicationApplicationApplication Enterprise Service Bus 40 global trading applications, $7B trades/day, over 5,000 txns/second Each application re-invents the data access layer: Reduces developer productivity Increases maintenance costs Raises operating risks, system failures, downtime Data Services Integrated Data Access And Caching

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 4 The Optimists View of SOA Messaging Services - SOAP - XML - UDDI/LDAP n Looser coupling of common tasks n Reuse at long last through shared services n Eliminates tyranny of silos n Everything just works SOA

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 5 Distribution Can Cause Bottlenecks Shared Data Apps share data cache, data silos can be out of sync Each app requires separate data, all data must stay in sync Data DB Check_Avail Place_Order Show_Status Check_Avail App Place_OrderShow_Status DB Business drivers: lower cost, higher flexibility Technology enablers: grid computing, web services

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 6 SOA Data Consistency Problem Data DB2 Check_AvailPlace_Order DB1 Item 3 = out of stockItem 3 = in stock Nightly Sync Data silos can cause inconsistent results

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 7 The Pessimist's View of SOA n Looser coupling of commonly performed tasks… –But, tighter consistency for commonly used data n Reuse at long last through shared services… –But, lengthier development time for shared services n Eliminates tyranny of silos… –But, lose application boundaries n Everything just works… –But, Nothing ever works as advertised

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 8 Agenda Service Oriented Architecture Ideal for high performance trading systems SOA requires enterprise data architecture Consistent and timely data Trading system case studies demonstrate benefits of well thought-out and executed data architecture for SOA

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 9 Requirements For Data Services DB App Cache Data Services Distributed Caching O-R Mapping Replication Functional Services DB Data Caching Services: stage data with app for performance and scalability Data Replication Services: position data for distributed computing, high availability Data Mapping Services: native language bindings for optimal performance

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 10 When To Worry: The 50/50 Rule Object Model 50+ classes < 50 classes Request Rate (Peak transactions/sec) < 50 TPS50+ TPS Data- intensive applications Model- intensive applications Transaction- intensive applications Basic applications Requires intelligent caching Requires data services layer Requires model-driven O/R mapping

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 11 Real-Time Data Services Stack DB 1DB 3DB 2 Flexibility – bindings Performance –caching improves response time Scalability –cache replication enables scaling Availability–reliable sync improves app resilience Data Integration Virtualized Database C# AppJava AppC++ App Compute Grid Distributed Execution Cache Real-time Data Services Distributed Caching

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 12 The Iceberg Model For SOA SOA Strengths Loose task coupling Reuse of shared tasks Eliminate silos Messaging Services Data Services Functional Services Legacy Environment SOA Data Gotchas Data consistency Data bottlenecks Data availability

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 13 Agenda Service Oriented Architecture Ideal for high performance trading systems SOA requires enterprise data architecture Consistent and timely data Trading System Case Study demonstrate benefits of well thought-out and executed data architecture for SOA

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 14 Case Study: Sell-Side Bank Business Requirements n Project Requirements –Front & middle office equity trading: >40 global apps –High transaction volumes: >5,000 TPS, millions per day –High availability: max downtime from failure <30 seconds –High scalability: support 5x volume at minimal cost –Reference data usage: all apps share common reference & order book data = huge potential for bottleneck n Deployment Architecture –Service Oriented Architecture: trading tasks exposed as shared functional services –Progress Real-time Data Services: Java binding, mapping, replication, caching –Grid Deployment: Unix Servers (>100 CPUs), Multi-site (US, Europe, Asia), Messaging Middleware, SQL Database

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 15 NY Order Service Reporting Service NY Exchange Service Case Study: Real-time Data Services Architecture A-LS-ZM-R Real-time Data Services Distributed Caching, Mapping, Synchronization Counterparty Service Securities Service Counterparty Service Securities Service Counterparty Service Securities Service Order Book Service NJ Partitioned databases O/R Mapping Caching Replication App examples Trading desk, STP Auto-exec engine VWAP Pricing Relational Databases Vendor Feeds Reuters Bloomberg Validation Workflow Extract Transform Data cleanse Change mgmt

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 16 Case Study: Benefits Achieved n Scalability: grid data services infrastructure scaled to $7B/day in trades (mainframe maint savings > $4m/yr) n Availability: stateful failover between grid data services caches helped cut failover time from 5 min to 30 sec n Productivity: SOA delivered 50% productivity through service reuse, required up-front resource (~30% of team) n Grid Data Services: distributed caching required to grid enable stateful SOA services to run in compute grid

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 17 ROI For SOA* n 2x Developer productivity: reliable shared services should account for > 50% of new application functionality n 3x maintenance productivity: systems deployed using SOA can be maintained with 75% fewer resources n 2x virtual data center savings: distributed application deployment with centralized data storage (aka virtual data center) can achieve 40% capital cost savings, 30% annual operating cost savings vs traditional data centers * Source: Progress customer case studies

Copyright © 2005 Progress Software Corporation. All Rights Reserved. 18 SOA Data Architecture Roadmap 1. Start with data virtualization: create golden master data 2. Add data services: provide consistent language bindings, distributed caching 3. Migrate functionality to SOA: plan to invest 30% of dev resources into shared services Consolidate SW infrastructure: eliminate silos, DBs (2+yrs)

Data Services for Service Oriented Architecture in Finance D. Britton Johnston Chief Technology Evangelist