1. SOA-10: SOA Enable Your Mainframe
Vincent Vanhauwaert
Presales Consultant, DataDirect

2. What We’ll Cover Re-capturing The Value of Legacy Assets
Mainframe Integration Complexity
Mainframe Architectural Requirements
DataDirect Shadow® Components
z/Services
z/Direct
z/Events
z/Presentation
Solving The Mainframe TCO Problem
zIIP
zAAP
SOA-10: Enable Your Mainframe

3. So Why Do Mainframes Still Matter
> 60% of the world “system of record” data on mainframes
Over 450 of Fortune 500 rely upon mainframes
More commercial transactions processed on mainframe than any other platform
The world’s top 25 banks….
23 of the top US retailers….
9 out of 10 of the world’s largest insurance companies run DB2 for z/Series
Business Pressures
Regulatory Compliance
Real-time Enterprise
Increased Agility
Total Economic Impact
Technological Initiatives
Business Intelligence
Business Process Optimization
Business Activity Monitoring
SOA & EDA
SOA-10: Enable Your Mainframe

4. Re-capturing The Value of Legacy Assets
Vital role within enterprise
Not relics of the past, but essential working components of the present
Mainframe interoperability has evolved
Web services have emerged as the industry standard method for SOA
SOA-10: Enable Your Mainframe

5. SOA in Action Idealised world where data and process flows naturally
PORTAL SERVICE
BATCH SYSTEM
USER-DEFINED SERVICE
APPLICATION SERVER
RELATIONAL DATABASE
PROCESS SERVER
LEGACY APPLICATION
SOA-10: Enable Your Mainframe

6. Mainframe Integration Complexity
Complexity = natural product of innovation and growth
More a result of change to growth than error
Factors that contribute to complexity
Disjointed legacy systems
Continued innovation
Economics – doing more with less
Mergers/Acquisitions
SOA-10: Enable Your Mainframe

7. Mainframe Integration Complexity
Unchecked IT complexity can become a major obstacle
Constricted access to data
Increased costs to maintain
Multiple points of failure
Reduces infrastructure flexibility
Heterogeneity – even within z/OS databases and systems
Documentation – out of date, missing,
SOA-10: Enable Your Mainframe

8. Typical Mainframe Accidental Architecture
SOA-10: Enable Your Mainframe

9. DataDirect Shadow® – Unified Integration Architecture
SOA-10: Enable Your Mainframe

10. Shadow Studio
SOA-10: Enable Your Mainframe

11. Mainframe Architectural Requirements
Web Services Support for Applications and Data
Transform applications & access data for SOA deployments
Real-time Events
Capture/publish data changes in real-time
Infrastructure Flexibility
Ability to re-use and rapidly re-deploy IT assets
Support for Current and Emerging Technologies
Meet current integration needs & support evolving technologies
SOA-10: Enable Your Mainframe 11

12. Shadow Product Components
z/Services Publish and Consume applications and data as Web services
z/Events Real-time capture and publishing of critical mainframe business events
z/Direct SQL access to mainframe Data and Applications
z/Presentation Web-enablement of mainframe 3270 screens
BLI – Business logic Integration as web service
SLI – Screen Logic Integration as web service
WS-Data – SQL Integration as web service
SOA-10: Enable Your Mainframe 12

13. Shadow z/Services Supports both Publish and Consumption
Simplifies mainframe integration
Flexible deployments
Mainframe
Shadow Server
CICS
Distributed
Shadow z/Services exposes mainframe data and applications as web services and can enable mainframe applications to consume external web services. Through the use of standards like SOAP and WSDL, mainframe integration is very much simplified and calling applications need not worry about the underlying idiosyncrasies of the back-end source. While the Shadow deployment will offer the best performance and scalability, other deployment options are available to fit every need.
SOA-10: Enable Your Mainframe 13

14. Shadow z/Services - Provider
Web services - SOAP-based mainframe integration
Screens, Programs, Data‏
Sources - CICS, IMS, IDEAL, IDMS, Natural, databases
Automated generation:
WSDL
Transformation logic
Starter Programs
Flexible deployments
Mainframe
Shadow Server
CICS
Distributed
Exposing mainframe data and applications enables the mainframe as a web services provider. The services provided can be based upon screens (utilising sophisticated screen processing call introspection, rather than screen-scraping), programs (that include business logic but not screens) or data (parameterised SQL statements that narrow database operations to specific calls). The generated web services can be called over http/https or MQ and automatically provide the WSDL, transformation logic and starter (test) programs, all via the Shadow Studio.
SOA-10: Enable Your Mainframe 14

15. Shadow z/Services - Consumer
SOA fit
Consume distributed Web services & fully participate in SOA
WSDL first
Automatic parsing of WSDL
Generates:
COBOL COPY Books
Runtme infrastructure
JCL and test program
Flexible deployments
Mainframe
Distributed
Shadow z/Services also allows existing mainframe applications, whether batch or online, to consume external web services. For example, currency exchange rate web service, ensuring the mainframe applications can fully participate in SOA. Using a .NET framework to automatically parse the WSDL of the service, COBOL programs, runtime environment and sample test JCL and programs are uploaded to the mainframe, deployed and tested. These objects can then be embedded into any new or existing mainframe application.
SOA-10: Enable Your Mainframe 15

16. Shadow z/Events Non-invasive event capture Messaging support
ADABAS, DB2, Native VSAM, VSAM-CICS, IDMS/CV, IMS/DATABASE
Messaging support
WMQ
HTTP/HTTPS
JCA 1.5 (inbound
communication) ‏
Transformation
XML template
Complex events
Data Enrichment
Defined - “…a methodology for designing and implementing applications and systems in which real-time events (changes in data sources) are transmit between loosely coupled software components and services”
An event-driven system is typically comprised of event manager, event consumers and event producers. When the event manager receives an event from a producer, the manager forwards the event to the consumer. Event-driven architecture allows applications and systems to be more responsiveness, since event-driven systems are, by design, more normalized to unpredictable and asynchronous environments.
Shadow z/Events provides event capture from many mainframe application and data sources, such as DB2, ADABAS, IMS IDMS, VSAM & CICS, the producers. Events are capture from each of these sources non-invasively, without the use of proprietary hooks, but through recognised processes and APIs within the source. Shadow receives the event from the provider, processes it according to rules, filters, and enrichment needs and then publishes to a consumer destination over http/https, WMQ or JCA 1.5.
The consumer or receiving application is forwarded an XML document, design of which is flexible through use of XML templates within Shadow z/Events, which would then be processed into the next business operation, updated into other data stores or added to BPM tasks. The XML forwarded could even be the input to an external web service as a SOAP request. Shadow z/Events will maintain the integrity of the sequence of events captured through a queuing mechanism for each destination. An event can be sent to multiple destinations and in different XML formats.
SOA-10: Enable Your Mainframe 16

17. Shadow z/Direct Direct SQL access via ODBC, JDBC, or JCA
No intermediate hardware gateway required
Interfaces for major mainframe sub-systems
Database: ADABAS, DB2, IMS/DB, VSAM
Application (screen & program): CICS/TS, IMS/TM, CA/IDMS, Natural)‏
Custom: any RPC
Transparent
All sources like relational databases
Utilising DMF
2-phase commit (XA)‏
Shadow z/Direct, for those of you who might remember NEON, was the first of the Shadow family. There are many companies relying on Shadow to provide ODBC, JDBC or JCA connectivity to their mainframe data and applications, including some of the largest DB2 and IMS users. Even before SOA or web services, Shadow exposed all mainframe sources as a standard relational database, this includes application programs and screens and non-relational datasources such as IMS – levelling the complexity involved in accessing disparate mainframe sources. Shadow achieves this through a Data Mapping Facility and the Shadow Metadata repository. Shadow z/Direct has enabled 2-phase commit (XA) operations between multiple mainframe sources and distributed sources long before other point-solutions were able to provided it and some still do not today. This know-how is now being made available across the other pluggable features of Shadow . Shadow z/Direct also improves upon specific database operations through use of optimisation facilities, which enable Shadow to perform better than perhaps the original datasource provider.
SOA-10: Enable Your Mainframe 17

18. Shadow z/Presentation
Suite of offerings which allows for:
Repurposing
Rejuvenation
Combining
Non-invasive development
Protects proven legacy logic
Deployment
options:
Mainframe
Windows
SOA-10: Enable Your Mainframe

19. Shadow Unified Architecture
SOA-10: Enable Your Mainframe 19

20. Solving The Mainframe TCO Problem
Upgrades trigger a cascade of software cost
Certain workloads could be more effectively handled
Processing Java™ on mainframe not MSU friendly
Enter the new IBM® specialty engines (IFL, zAAP, zIIP)
Run un-measured
Not speed restricted
Workloads on specialty engines do not count
IBM specialty engines are processors that can help users expand the use of the mainframe for new workloads, while helping to lower total cost of ownership
zIIP - System z9 Integrated Information Processor
the zIIP's execution environment will accept eligible work from z/OS, which will manage and direct the work between the general purpose processor and the zIIP
zAAP - System z Application Assist Processor
specialized processing engines that provide a strategic z/OS Java™ execution environment
The IBM Mainframe Base: Alive and Kicking
Published: July 10, 2007
by Timothy Prickett Morgan
SOA-10: Enable Your Mainframe

21. Exploiting IBM Innovation
Strategic new mainframe innovation
IBM introduces new architectural features - specialty engines -
Improves mainframe viability
IFL (Linux)
Addresses competitive threats
zAAP (Java)
zIIP (database)
New innovation
Shadow uniquely exploits zIIP/zAAP specialty engines
Significant performance enhancements for SOA
Dramatic improvement in mainframe TCO
SOA-10: Enable Your Mainframe

22. IBM Exploitation of zIIP Specialty Engine
IBM’s original focus for the zIIP was related to DB2 and support for ERP/CRM/BI data intensive workloads
Better performance and TCO associated with DB2
High Utilization of General Purpose Processor
Reduced Utilization of General Purpose Processor
SOA-10: Enable Your Mainframe

23. Exploiting zIIP for Enhanced SOA Performance
Next generation middleware exploits zIIP for SOA related workloads
Dramatic improvement in SOA performance and TCO
Middleware Request Offload to zIIP – Low Utilization of GPP
SOAP/XML Processing Results in High Utilization of GPP
SOA-10: Enable Your Mainframe

24. Not All Middleware Is Created Equal
Mainframe middleware deployments vary
Distributed runtime
Mainframe based server
Most mainframe middleware is TCB based
Middleware exploitation of specialty engines requires “genetic” alteration to threads
Ability to run in SRB/TCB mode essential
SOA-10: Enable Your Mainframe

25. Which Shadow Features Exploit zIIP?
Shadow Networking & TCP/IP layer
Shadow Instrumentation Server
SOAP and XML Processing/Parsing
Shadow Internal Messaging, XA support & Scripting Language
Security Optimization & Mgmt. (SOM)
Shadows SQL Engine, ODBC & JDBC processing
Shadow Event Facility (SEF)
Metadata Mapping & HTX Processing
Shadow will provide some limited performance and MSU consumption benefits from the new extended architecture exploiting zIIP.
Big benefits accrue when you have a zIIP.
SOA-10: Enable Your Mainframe

26. Exploiting zAAP for Optimizing BPM
Effectively handle Java workloads & participate in BPM initiatives
BPEL provides a process oriented approach for orchestrating Web services
Processing intensive BPEL (Java/XML) runs within zAAP
Lower TCO - not counted against GPP
Improved performance - not speed restricted
Mainframe can now run BPEL workflows
SOA-10: Enable Your Mainframe

27. Shadow BPEL Deployments
zAAP exploited JVM
Any JVM or
BPEL 2.0 Runtime
Mainframe IFL
Deployment Flexibility
SOA-10: Enable Your Mainframe

28. Benefits: zIIP/zAAP Exploitation
Improved performance
SRB’s are lighter than TCBs
zIIPs and zAAPs are not speed restricted
30-90% reduction in middleware MSU consumption
Faster XML/SOAP processing
Faster ODBC/JDBC processing
SOA-10: Enable Your Mainframe

29. Benefits: zIIP/zAAP Exploitation
Lower TCO
Workloads running on zIIP or zAAP are not counted
MSU consumption of middleware will be lower
Total Mainframe MSU usage will be lower
SOA-10: Enable Your Mainframe

30. Typical Customer Capacity Growth
Upgrade
166%
138%
115%
96%
Middleware
80 %
GPP
Workload
Middleware
Middleware
Middleware
Middleware
Today Year Year Year Year 4
This scenario depicts:
20 % ACGR in MSU Consumption (sited by IBM as average rate)
SOA-10: Enable Your Mainframe

31. Impact of Shadow’s Exploitation
Original
Upgrade
Deferred
Upgrade
80 %
166%
138%
115%
96%
Middleware
Specialty
Engine
Workload
GPP
This scenario depicts:
20 % ACGR in MSU Consumption (sited by IBM as average rate)
Shadow’s zIIP/zAAP processing reduces GPP workload
Shadow’s usage of the zIIP helps defer the upgrade
SOA-10: Enable Your Mainframe

32. Shadow in a Nutshell Single Unified Architecture
Reduces complexity and increases reuse
Non-invasive
Maximise value from existing systems and skill sets
z/OS Applications becomes a full SOA participant
Standards-based, ‘zero-latency’ technologies
Maximizes both the zIIP and zAAP specialty engines resulting in unprecedented MSU savings
SOA-10: Enable Your Mainframe

33. For More Information
SOA-10: Enable Your Mainframe

34. ?
Questions
SOA-10: Enable Your Mainframe

35. Thank You
SOA-10: Enable Your Mainframe

36. SOA-10: Enable Your Mainframe