1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment.

Slides:



Advertisements
Similar presentations
C:\user\ppt\ki\usergrou /7/2013 Benutzergruppe ADABAS C im Netz Kinzinger / Storr ADABAS C In The Network Horst Kinzinger Software AG Dieter Storr.
Advertisements

Chapter 10: Designing Databases
1 tRelational/DPS Overview. 2 ADABAS Data Transfer: business needs and issues tRelational & DPS Overview Summary Questions? Demo Agenda.
Information Resources Management January 16, 2001.
Chapter 7 LAN Operating Systems LAN Software Software Compatibility Network Operating System (NOP) Architecture NOP Functions NOP Trends.
Mainframe Modernization
Brian Alderman | MCT, CEO / Founder of MicroTechPoint Pete Harris | Microsoft Senior Content Publisher.
Offloading OpenVMS RMS data for Business Intelligence using CDC and Data Replication Menachem Brouk, Regional Director, Attunity
Agenda: ISUG : :05 Välkomna och agendaöversikt
Ch1: File Systems and Databases Hachim Haddouti
WFM-6103: Hydrologic Information System (HIS) Akm Saiful Islam Lecture-5: Database Management System April-October, 2006 Institute of Water and Flood Management.
Page 1Prepared by Sapient for MITVersion 0.1 – August – September 2004 This document represents a snapshot of an evolving set of documents. For information.
IBM Mainframe-Integration Mainframe Change Data Capture
Managing Data Resources. File Organization Terms and Concepts Bit: Smallest unit of data; binary digit (0,1) Byte: Group of bits that represents a single.
® IBM Software Group © IBM Corporation IBM Information Server Deliver – Federation Server.
Data Management Capabilities and Past Performance Dr. Srinivas Kankanahalli.
Doc Document Management Systems For Manufacturing Industry Infocrew Solutions Pvt.Ltd.
Data Warehouse Tools and Technologies - ETL
By N.Gopinath AP/CSE. Why a Data Warehouse Application – Business Perspectives  There are several reasons why organizations consider Data Warehousing.
Maintaining a Microsoft SQL Server 2008 Database SQLServer-Training.com.
SSIS Over DTS Sagayaraj Putti (139460). 5 September What is DTS?  Data Transformation Services (DTS)  DTS is a set of objects and utilities that.
Chapter 5 Lecture 2. Principles of Information Systems2 Objectives Understand Data definition language (DDL) and data dictionary Learn about popular DBMSs.
Data Warehousing Seminar Chapter 5. Data Warehouse Design Methodology Data Warehousing Lab. HyeYoung Cho.
The McGraw-Hill Companies, Inc Information Technology & Management Thompson Cats-Baril Chapter 3 Content Management.
Data: Migrating, Distributing and Audit Tracking Michelle Ayers, Advisory Solution Consultant
HDNUG 27-March-2007 SQL Server 2005 Suite as a Business Intelligence Solution.
XML & Mediators Thitima Sirikangwalkul Wai Sum Mong April 10, 2003.
Massively Distributed Database Systems - Distributed DBS Spring 2014 Ki-Joune Li Pusan National University.
Chapter Chapter 13-2 Accounting Information Systems, 1 st Edition Data and Databases.
DATABASE MANAGEMENT SYSTEMS IN DATA INTENSIVE ENVIRONMENNTS Leon Guzenda Chief Technology Officer.
Where Do You Need Your ADABAS Data Today? An overview of NatQuery and NatCDC
DataMigrator Data Analysis with WebFOCUS. 2 Metadata Data Lineage Data Profiling Data Transformation Administration Connectivity Portability DataMigrator.
Announcements. Data Management Chapter 12 Traditional File Approach  Structure Field  Record  File  Fixed All records have common fields, and a field.
DataDirect aka NEON Systems Advanced SOA Implementations October 19, Natural Conference Rex Bowe, Systems Consultant.
Information Builders : SmartMart Seon-Min Rhee Visualization & Simulation Lab Dept. of Computer Science & Engineering Ewha Womans University.
1 Distributed Databases BUAD/American University Distributed Databases.
1 Technology in Action Chapter 11 Behind the Scenes: Databases and Information Systems Copyright © 2010 Pearson Education, Inc. Publishing as Prentice.
Managing Data Resources. File Organization Terms and Concepts Bit: Smallest unit of data; binary digit (0,1) Byte: Group of bits that represents a single.
Pengantar Sistem Informasi Data Resource Management.
Integrating the Mainframe Liberating Enterprise Data.
Integrating the Mainframe Liberating Enterprise Data.
Opening the Box and Liberating S/390 Enterprise Data International Sales Meeting, June 1999 Bill Coleman and Peter King.
Chapter 9  Definition of terms  List advantages of client/server architecture  Explain three application components:
ViaSQL Technical Overview. Viaserv, Inc. 2 ViaSQL Support for S/390 n Originally a VSE product n OS/390 version released in 1999 n Identical features.
Dueling Middleware WAVV 2000, Colorado Springs. Middleware Defined LAN DBMS Web Browser Client Workstation Local Area Network Middleware Web Server S/390.
Chapter 1 Database Access from Client Applications.
Migrating Mainframe Data Liberating Enterprise Data.
Middleware Solutions for VSE and. 2 Middleware products for data access, delivery, and integration. Designed for organizations seeking the combined benefits.
Integrating the Mainframe Liberating Enterprise Data.
ViaSQL Transfer. Viaserv, Inc. Transfer – 2 The ViaSQL Transfer n Available only with ViaSQL Integrator n Move data between OS/390 and a LAN database.
Michael Miller Senior Director Real-Time Collaboration Products Oracle Collaboration Suite 10g Oracle Corporation.
TCCICOMPUTERCOACH ING.COM.  TCCI-Tririd Computer Coaching Institute provides best teaching in basic computer programming language at tcci-ahmedabad.
Managing Data Resources File Organization and databases for business information systems.
MQ Series Cross Platform Dominant Messaging sw – 70% of market
Data Management Capabilities and Past Performance
Defining Data Warehouse Concepts and Terminology
Overview of MDM Site Hub
with the Microsoft BI Ecosystem
PowerMart of Informatica
Contained DB? Did it do something wrong?
Real-time data delivery may be easier than you think
Defining Data Warehouse Concepts and Terminology
tRelational/DPS Overview
Snowflake Software Helping you “SWIM” into the future
Intuitive Development and Deployment of Web Applications from the Microsoft Azure Cloud “Thanks to Microsoft Azure our solution is available quickly and.
MQ Series Cross Platform Dominant Messaging sw – 70% of market
SEWICKLEY, PA.
David Gilmore & Richard Blevins Senior Consultants April 17th, 2012
Presentation transcript:

1 The Mainframe Data Access & Replication Conundrum In Today's Heterogeneous IT Environment

2 Mainframe Integration without Compromise

3 Agenda Introduction to Treehouse Software Today’s Situation IT Objective tcACCESS Data Integration tcACCESS SQL Engine tcACCESS Demo tcVISION Data Replication CDC Methods Processing Stages tcVISION Demo Summary

4 Introduction to Treehouse Software Established in 1982 Mainframe system tools vendor Leading ISV for Software AG 70% penetration in North American market Consultants with 20+ years experience More than 300 man years of experience Supporting all mainframe operating systems Focus for the past 15+ years on data migration, replication, and integration Over 700 customers worldwide 20 products 30 employees

5 Treehouse Customers

6 Today’s Situation Heterogeneous IT environments Legacy applications High-availability information systems Data silos Increasing data volumes Exploding costs

7 IT Objective Intelligent data integration Efficient data synchronization Cost effective solution Enterprise-wide Data Management through:

8

9 Enterprise Data Integration Bi-directional data-exchange across heterogeneous systems Direct data access across heterogeneous systems Data transformation for data analysis and exchange tcACCESS Concepts

10 Enterprise Data Integration Relational access to legacy data and applications Data federation – heterogeneous data views Integration of mainframe files and DBMS structures Data federation between mainframe and Windows/Open Systems data tcACCESS Concepts

11 tcACCESS SQL Engine Host/PC & Host & Web Integration

12 tcACCESS SQL Engine More than 90 SQL functions supported Operators (+, -, *, /, ||) Conditional Operators (>, <, =, BETWEEN, LIKE) Logic Operators (AND, OR) INNER and OUTER JOINS GROUP BY, ORDER BY Security may be applied (RACF, ACF/2, Top Secret) Stored Procedure Support

13 tcACCESS SQL Engine Different data sources can be JOINed: SELECT IMS.NR, IMS.NAME, VSAM.ADDRESS FROM IMS, VSAM WHERE IMS.NR = VSAM.ID VIEWS can be created Control Options available (MAXIO, MAXROW, NOORDERBY, etc) Global SQL Exit available Field Level Exits available

14 tcACCESS Architecture

15 Demo

16

17 CDC Replication Different data formats Different data models Large data volumes Limited batch window Requirement for up-to- date information Moving/replicating data... as much as needed as little... as transparent... as flexible... as secure......AS POSSIBLE The Problem: The Solution:...with

18 Data Latency Change Data Capture

19 Data volume Change Data Capture

20 Mainframe Change Data Capture Change Data Capture Efficient transfer of entire databases Analysis for data consistancy Best for Initial Load prior to log processing Best for periodic mass data transfer One step data transfer

21 Mainframe Change Data Capture Change Data Capture Comparison of data snapshots Efficient transfer of changed data since last processing IMS/DB, DL/I, VSAM, DB/2, ADABAS, CA-IDMS, DATACOM, sequential files Flexible processing options (SORT etc.) Automatic creation of deltas by tcVISION

22 Mainframe Change Data Capture Change Data Capture Usage of the DBMS logging capabilities IMS/DB, VSAM, DB/2, DL/I, ADABAS, IDMS, DATACOM Transfer of changed data in scheduled time frame Best for batch window Best for processing right after logfile creation

23 Mainframe Change Data Capture Change Data Capture Realtime capture of changed data Changes directly obtained from DBMS CA-IDMS, IMS/DB, VSAM, DB/2, DATACOM, ADABAS Secure data storage even across DBMS restart Flexible propagation methods

24 Stage 0: Data in internal raw format Stage 1: Data in tcVISION format (before and after images) Stage 2: Data normalized with structure definition Staged Processing Stage 3: Data in DML or Loader format

25 Stage 0: Data in internal raw format Stage 1: Data in tcVISION format (before and after images) Stage 2: Data normalized with structure definition Stage 3: Data in DML or Loader format Staged Processing Exit points available at every stage

26 Demo

27 Summary Relational access to legacy data and applications Data Federation – heterogeneous data views Change Data Processing Bi-Directional real time replication

28 Summary tcVISION Architecture

29 Summary Bi-directional data-integration and data-synchronization

30