SOA-10: SOA Enable Your Mainframe Vincent Vanhauwaert Presales Consultant, DataDirect

What We’ll Cover Re-capturing The Value of Legacy Assets Mainframe Integration Complexity Mainframe Architectural Requirements DataDirect Shadow® Components z/Services z/Direct z/Events z/Presentation Solving The Mainframe TCO Problem zIIP zAAP SOA-10: Enable Your Mainframe

So Why Do Mainframes Still Matter > 60% of the world “system of record” data on mainframes Over 450 of Fortune 500 rely upon mainframes More commercial transactions processed on mainframe than any other platform The world’s top 25 banks…. 23 of the top US retailers…. 9 out of 10 of the world’s largest insurance companies run DB2 for z/Series Business Pressures Regulatory Compliance Real-time Enterprise Increased Agility Total Economic Impact Technological Initiatives Business Intelligence Business Process Optimization Business Activity Monitoring SOA & EDA SOA-10: Enable Your Mainframe

Re-capturing The Value of Legacy Assets Vital role within enterprise Not relics of the past, but essential working components of the present Mainframe interoperability has evolved Web services have emerged as the industry standard method for SOA SOA-10: Enable Your Mainframe

SOA in Action Idealised world where data and process flows naturally PORTAL SERVICE BATCH SYSTEM USER-DEFINED SERVICE APPLICATION SERVER RELATIONAL DATABASE PROCESS SERVER LEGACY APPLICATION SOA-10: Enable Your Mainframe

Mainframe Integration Complexity Complexity = natural product of innovation and growth More a result of change to growth than error Factors that contribute to complexity Disjointed legacy systems Continued innovation Economics – doing more with less Mergers/Acquisitions SOA-10: Enable Your Mainframe

Mainframe Integration Complexity Unchecked IT complexity can become a major obstacle Constricted access to data Increased costs to maintain Multiple points of failure Reduces infrastructure flexibility Heterogeneity – even within z/OS databases and systems Documentation – out of date, missing, SOA-10: Enable Your Mainframe

Typical Mainframe Accidental Architecture SOA-10: Enable Your Mainframe

DataDirect Shadow® – Unified Integration Architecture SOA-10: Enable Your Mainframe

Shadow Studio SOA-10: Enable Your Mainframe

Mainframe Architectural Requirements Web Services Support for Applications and Data Transform applications & access data for SOA deployments Real-time Events Capture/publish data changes in real-time Infrastructure Flexibility Ability to re-use and rapidly re-deploy IT assets Support for Current and Emerging Technologies Meet current integration needs & support evolving technologies SOA-10: Enable Your Mainframe 11

Shadow Product Components z/Services Publish and Consume applications and data as Web services z/Events Real-time capture and publishing of critical mainframe business events z/Direct SQL access to mainframe Data and Applications z/Presentation Web-enablement of mainframe 3270 screens BLI – Business logic Integration as web service SLI – Screen Logic Integration as web service WS-Data – SQL Integration as web service SOA-10: Enable Your Mainframe 12

Shadow z/Services Supports both Publish and Consumption Simplifies mainframe integration Flexible deployments Mainframe Shadow Server CICS Distributed Shadow z/Services exposes mainframe data and applications as web services and can enable mainframe applications to consume external web services. Through the use of standards like SOAP and WSDL, mainframe integration is very much simplified and calling applications need not worry about the underlying idiosyncrasies of the back-end source. While the Shadow deployment will offer the best performance and scalability, other deployment options are available to fit every need. SOA-10: Enable Your Mainframe 13

Shadow z/Services - Provider Web services - SOAP-based mainframe integration Screens, Programs, Data‏ Sources - CICS, IMS, IDEAL, IDMS, Natural, databases Automated generation: WSDL Transformation logic Starter Programs Flexible deployments Mainframe Shadow Server CICS Distributed Exposing mainframe data and applications enables the mainframe as a web services provider. The services provided can be based upon screens (utilising sophisticated screen processing call introspection, rather than screen-scraping), programs (that include business logic but not screens) or data (parameterised SQL statements that narrow database operations to specific calls). The generated web services can be called over http/https or MQ and automatically provide the WSDL, transformation logic and starter (test) programs, all via the Shadow Studio. SOA-10: Enable Your Mainframe 14

Shadow z/Services - Consumer SOA fit Consume distributed Web services & fully participate in SOA WSDL first Automatic parsing of WSDL Generates: COBOL COPY Books Runtme infrastructure JCL and test program Flexible deployments Mainframe Distributed Shadow z/Services also allows existing mainframe applications, whether batch or online, to consume external web services. For example, currency exchange rate web service, ensuring the mainframe applications can fully participate in SOA. Using a .NET framework to automatically parse the WSDL of the service, COBOL programs, runtime environment and sample test JCL and programs are uploaded to the mainframe, deployed and tested. These objects can then be embedded into any new or existing mainframe application. SOA-10: Enable Your Mainframe 15

Shadow z/Events Non-invasive event capture Messaging support ADABAS, DB2, Native VSAM, VSAM-CICS, IDMS/CV, IMS/DATABASE Messaging support WMQ HTTP/HTTPS JCA 1.5 (inbound communication) ‏ Transformation XML template Complex events Data Enrichment Defined - “…a methodology for designing and implementing applications and systems in which real-time events (changes in data sources) are transmit between loosely coupled software components and services” An event-driven system is typically comprised of event manager, event consumers and event producers. When the event manager receives an event from a producer, the manager forwards the event to the consumer. Event-driven architecture allows applications and systems to be more responsiveness, since event-driven systems are, by design, more normalized to unpredictable and asynchronous environments. Shadow z/Events provides event capture from many mainframe application and data sources, such as DB2, ADABAS, IMS IDMS, VSAM & CICS, the producers. Events are capture from each of these sources non-invasively, without the use of proprietary hooks, but through recognised processes and APIs within the source. Shadow receives the event from the provider, processes it according to rules, filters, and enrichment needs and then publishes to a consumer destination over http/https, WMQ or JCA 1.5. The consumer or receiving application is forwarded an XML document, design of which is flexible through use of XML templates within Shadow z/Events, which would then be processed into the next business operation, updated into other data stores or added to BPM tasks. The XML forwarded could even be the input to an external web service as a SOAP request. Shadow z/Events will maintain the integrity of the sequence of events captured through a queuing mechanism for each destination. An event can be sent to multiple destinations and in different XML formats. SOA-10: Enable Your Mainframe 16

Shadow z/Direct Direct SQL access via ODBC, JDBC, or JCA No intermediate hardware gateway required Interfaces for major mainframe sub-systems Database: ADABAS, DB2, IMS/DB, VSAM Application (screen & program): CICS/TS, IMS/TM, CA/IDMS, Natural)‏ Custom: any RPC Transparent All sources like relational databases Utilising DMF 2-phase commit (XA)‏ Shadow z/Direct, for those of you who might remember NEON, was the first of the Shadow family. There are many companies relying on Shadow to provide ODBC, JDBC or JCA connectivity to their mainframe data and applications, including some of the largest DB2 and IMS users. Even before SOA or web services, Shadow exposed all mainframe sources as a standard relational database, this includes application programs and screens and non-relational datasources such as IMS – levelling the complexity involved in accessing disparate mainframe sources. Shadow achieves this through a Data Mapping Facility and the Shadow Metadata repository. Shadow z/Direct has enabled 2-phase commit (XA) operations between multiple mainframe sources and distributed sources long before other point-solutions were able to provided it and some still do not today. This know-how is now being made available across the other pluggable features of Shadow . Shadow z/Direct also improves upon specific database operations through use of optimisation facilities, which enable Shadow to perform better than perhaps the original datasource provider. SOA-10: Enable Your Mainframe 17

Shadow z/Presentation Suite of offerings which allows for: Repurposing Rejuvenation Combining Non-invasive development Protects proven legacy logic Deployment options: Mainframe Windows SOA-10: Enable Your Mainframe

Shadow Unified Architecture SOA-10: Enable Your Mainframe 19

Solving The Mainframe TCO Problem Upgrades trigger a cascade of software cost Certain workloads could be more effectively handled Processing Java™ on mainframe not MSU friendly Enter the new IBM® specialty engines (IFL, zAAP, zIIP) Run un-measured Not speed restricted Workloads on specialty engines do not count IBM specialty engines are processors that can help users expand the use of the mainframe for new workloads, while helping to lower total cost of ownership zIIP - System z9 Integrated Information Processor the zIIP's execution environment will accept eligible work from z/OS, which will manage and direct the work between the general purpose processor and the zIIP zAAP - System z Application Assist Processor specialized processing engines that provide a strategic z/OS Java™ execution environment The IBM Mainframe Base: Alive and Kicking Published: July 10, 2007 by Timothy Prickett Morgan SOA-10: Enable Your Mainframe

Exploiting IBM Innovation Strategic new mainframe innovation IBM introduces new architectural features - specialty engines - Improves mainframe viability IFL (Linux) Addresses competitive threats zAAP (Java) zIIP (database) New innovation Shadow uniquely exploits zIIP/zAAP specialty engines Significant performance enhancements for SOA Dramatic improvement in mainframe TCO SOA-10: Enable Your Mainframe

IBM Exploitation of zIIP Specialty Engine IBM’s original focus for the zIIP was related to DB2 and support for ERP/CRM/BI data intensive workloads Better performance and TCO associated with DB2 High Utilization of General Purpose Processor Reduced Utilization of General Purpose Processor SOA-10: Enable Your Mainframe

Exploiting zIIP for Enhanced SOA Performance Next generation middleware exploits zIIP for SOA related workloads Dramatic improvement in SOA performance and TCO Middleware Request Offload to zIIP – Low Utilization of GPP SOAP/XML Processing Results in High Utilization of GPP SOA-10: Enable Your Mainframe

Not All Middleware Is Created Equal Mainframe middleware deployments vary Distributed runtime Mainframe based server Most mainframe middleware is TCB based Middleware exploitation of specialty engines requires “genetic” alteration to threads Ability to run in SRB/TCB mode essential SOA-10: Enable Your Mainframe

Which Shadow Features Exploit zIIP? Shadow Networking & TCP/IP layer Shadow Instrumentation Server SOAP and XML Processing/Parsing Shadow Internal Messaging, XA support & Scripting Language Security Optimization & Mgmt. (SOM) Shadows SQL Engine, ODBC & JDBC processing Shadow Event Facility (SEF) Metadata Mapping & HTX Processing Shadow will provide some limited performance and MSU consumption benefits from the new extended architecture exploiting zIIP. Big benefits accrue when you have a zIIP. SOA-10: Enable Your Mainframe

Exploiting zAAP for Optimizing BPM Effectively handle Java workloads & participate in BPM initiatives BPEL provides a process oriented approach for orchestrating Web services Processing intensive BPEL (Java/XML) runs within zAAP Lower TCO - not counted against GPP Improved performance - not speed restricted Mainframe can now run BPEL workflows SOA-10: Enable Your Mainframe

Shadow BPEL Deployments zAAP exploited JVM Any JVM or BPEL 2.0 Runtime Mainframe IFL Deployment Flexibility SOA-10: Enable Your Mainframe

Benefits: zIIP/zAAP Exploitation Improved performance SRB’s are lighter than TCBs zIIPs and zAAPs are not speed restricted 30-90% reduction in middleware MSU consumption Faster XML/SOAP processing Faster ODBC/JDBC processing SOA-10: Enable Your Mainframe

Benefits: zIIP/zAAP Exploitation Lower TCO Workloads running on zIIP or zAAP are not counted MSU consumption of middleware will be lower Total Mainframe MSU usage will be lower SOA-10: Enable Your Mainframe

Typical Customer Capacity Growth Upgrade 166% 138% 115% 96% Middleware 80 % GPP Workload Middleware Middleware Middleware Middleware Today Year 1 Year 2 Year 3 Year 4 This scenario depicts: 20 % ACGR in MSU Consumption (sited by IBM as average rate) SOA-10: Enable Your Mainframe

Impact of Shadow’s Exploitation Original Upgrade Deferred Upgrade 80 % 166% 138% 115% 96% Middleware Specialty Engine Workload GPP This scenario depicts: 20 % ACGR in MSU Consumption (sited by IBM as average rate) Shadow’s zIIP/zAAP processing reduces GPP workload Shadow’s usage of the zIIP helps defer the upgrade SOA-10: Enable Your Mainframe

Shadow in a Nutshell Single Unified Architecture Reduces complexity and increases reuse Non-invasive Maximise value from existing systems and skill sets z/OS Applications becomes a full SOA participant Standards-based, ‘zero-latency’ technologies Maximizes both the zIIP and zAAP specialty engines resulting in unprecedented MSU savings SOA-10: Enable Your Mainframe

For More Information http://www.datadirect.com/products/mainframe-integration SOA-10: Enable Your Mainframe

? Questions SOA-10: Enable Your Mainframe

Thank You SOA-10: Enable Your Mainframe

SOA-10: Enable Your Mainframe