CA Technologies TDM Mainframe Toolkit

CA-TDM Architecture & Process Register & Profile DB2/400 Flat Files (CSV, Excel, XML etc.) Test Data On-Demand (TDM Portal) Define Test Data Engineering Operation i/Series IBM DB2 & *IMS *CA IDMS & DATACOM Service Layer & Web Server ODBC/JDBC COBOL/JCL JAVA SQL CA TDM Install Libraries SAG Adabas VSAM & PS Oracle or SQL Server Repository Windows UI z/Series Process Run-time LUW *DMSII Oracle Hadoop Enable as On-Demand Request Big Data MSSQL Unisys Informix Teradata CA – Test Data Manager +More (ODBC/JDBC) LUW *using extract to file or other DB

Secure and effective test data engineering on Mainframe CA_World_2015_Employee_Template_v8-GR Mainframe Environment CA TDM Windows UI DB2 z/OS VSAM IMS non-indexed flat files Other DBs Validation Profiling PII Discovery Data Subset Definition Built-In Masking Functions Synthetic Data Rules ODBC/Copybooks Meta Data PDS (JCL & CTL) Rules and Definitions FTP Externalize Rules Mainframe Batch Operations CA TDM Repository (Project, Meta Store & Rules) Secure Masked Subsets of Data Data never has to leave the Mainframe

Installation Requirements Run lib.runjcl(receivev) for VSAM Create DB2 tables Load seedless data Bind DB2 tables Rename load message data Validate installation Check pre-requisites Setup JCL for XMIT files allocations Setup JCL to populate HLQ.LIB.RUNJCL Upload XMIT files via FTP Run lib.runjcl(receive) for DB2

Pre-Requisites DB2 CONNECT USER FTP USER Update/Insert/Delete/Select for TDM Reference tables Select for Source Schema tables Select/Update for Target Schema tables Alter for Target Schema tables -- optional FTP USER Read/Write for TDM datasets for the Mainframe toolkit installation (e.g. Provided default is GRIDT01.LIB.MAPCSV)

Pre-Requisites For Mainframe Files File (RACF) Access Read for source data/VSAM files for masking/subsetting/profiling Update for generated masked files Reporting/Auditing/Profiling/Unload files SDSF Access (or equivalent) Submit/Manage/Purge Job names

Pre-Requisites For DB2 z/OS Mask in Situ (JCL: GTXMSK) Select/Update for source schema tables Select/Update/Insert/Delete for TDM reference tables Select for SYSIBM schema tables (used in the job) Unload and Mask (JCL: GTXMSKL) Select/Update for TDM reference tables Select for source Schema tables Load for source Schema tables

JCL for XMIT Files Allocation Allocate the sequential file as: Sequential Record Format=FB Record length=80 Block Size=27920 Add the job card information for your site Make sure that the HLQ is the same as the XMIT files

JCL to Load lib.runjcl Job Allocate the sequential file as: Sequential Record Format=FB Record length=80 Block Size=27920 Add Job Card This job will create and load the HLQ.LIB.RUNJCL Need to provide location of the libjcl.xmi

Upload XMIT Files FTP files using echo quote site filetype=seq recfm=vb lrecl=300 blksize=27998 rdw >> ftpcmd.dat REM SPACETYPE CYLINDER PRIMARY 2 SECONDARY 5 echo quote mode b >> ftpcmd.dat echo put C:\zFull_Install\XMIT\libdbrm.xmi ‘HLQ.GRIDT01.libdbrm.xmi' >> ftpcmd.dat A FTP script is listed in the notes’ section of this slide @echo off echo user TDM > ftpcmd.dat echo %PSWD01% >> ftpcmd.dat echo bin >> ftpcmd.dat echo quote site filetype=seq recfm=vb lrecl=300 blksize=27998 rdw >> ftpcmd.dat REM SPACETYPE CYLINDER PRIMARY 2 SECONDARY 5 echo quote mode b >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libdbrm.xmi ‘HLQ.LIBDBRM.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libdef.xmi ‘HLQ.LIBDEF.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libjcl.xmi ‘HLQ.LIBJCL.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libload.xmi ‘HLQ.LIBLOAD.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libmap.xmi ‘HLQ.LIBMAP.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libparm.xmi ‘HLQ.LIBPARM.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libproc.xmi ‘HLQ.LIBPROC.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libspufi.xmi ‘HLQ.LIBSPUFI.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libmsgdata.xmi ‘HLQ.LIBMSGDATA.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseedcard.xmi ‘HLQ.LIBSEEDCARD.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat1.xmi ‘HLQ.LIBSEEDDAT1.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat2.xmi ‘HLQ.LIBSEEDDAT2.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat3.xmi ‘HLQ.LIBSEEDDAT3.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat4.xmi ‘HLQ.LIBSEEDDAT4.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat5.xmi ‘HLQ.LIBSEEDDAT5.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat6.xmi ‘HLQ.LIBSEEDDAT6.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat7.xmi ‘HLQ.LIBSEEDDAT7.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libseeddat.xmi ‘HLQ.LIBDSEEDDATA.XMI' >> ftpcmd.dat echo put C:\<TDM_MF_KIT>\XMIT\libtestdat.xmi ‘HLQ.LIBTESTDAT.XMI' >> ftpcmd.dat echo quit >> ftpcmd.dat ftp -n -s:ftpcmd.dat <your_host> del ftpcmd.dat

Expand XMI Files Expand the XMI files HLQ.lib.runjcl(receive) for DB2 HLQ.lib.runjcl(receivev) for VSAM

Create DB2 Tables Create the following tables GTSRC_REFERENCE_LOV1 GTSRC_XREF GTSRC_SUBSET Create the tables as defined in the *.LIB.SPUFI members

Load Seed Tables Run the job Change job card HLQ.LIB.RUNJCL(SEEDLOAD) This job will populate GTSRC_REFERENCE_LOV1 with seed data via the DB2 Load utility. This job reads HLQ.SEED.CARDS, which specifies the target table to be loaded via the line “INTO HLQ.GTSRC_REFERENCE_LOV1”. Change job card Change the PROCLIB data set name, which is set to DSN810.PROCLIB Change SYSTEM parameter, which is set to DB8G The SEEDLOAD job should complete with a condition code no higher than 4. Run the SQL given in the member “GRIDT01.LIB.SPUFI(SEEDLIST)” This will show you the seedlists inserted along with the number of entries for each seedlist.

Bind DB2 Tables Run the job Change job card HLQ.LIB.RUNJCL(BIND) This job will bind the TDM programs with the DB2 tables Change job card SYSTSIN parameters can be found in “TDM.LIB.PARM” Members BGTXDMP, BGTXMSK, BGTXMSKF and BGTXMSKL Change lines “DSN SYSTEM(DB8G)” and lines containing “QUALIFIER (GRIDT01)”

Load Message Data Run the job Change job card HLQ.LIB.RUNJCL(MSGLOAD) This proc will generate the MSG.KSDS The contents of this procedure will have to be renamed to the proper file names Change job card The MsgData.xmi needs to be present for the procedure to work correctly

Update the HLQ.LIB.RUNJCL(GTXMSK) to point the right schema DB2 Validation Run the job HLQ.LIB.SPUFI(TEST) This job will create and populate the populate GT_TEST Change job card Update the HLQ.LIB.RUNJCL(GTXMSK) to point the right schema Submit the GTXMSK job Submit the HLQ.LIB.RUNJCL(GTXMSKL)

Flat File Validation Run job HLQ.LIB.RUNJCL(GTXPRT) Run job HLQ.LIB.RUNJCL(GTXGEN) Run job HLQ.LIB.RUNJCL(GTXMSKF) Change job card

VSAM Installation Steps required for the installation of the VSAM reference data Define and populate a VSAM KSDS file to hold the lookup data Define and populate a VSAM KSDS file to hold Grid Tools message data Define VSAM KSDS files to hold XREF data (optional) Define VSAM KSDS files to hold Subsetting data (optional) Check that the installed programs run

VSAM Creation and Loading Run the job TDM.LIB.RUNJCL(KSDSSEED) Update the VOLUME entry This job creates and populates a VSAM (TDM.VSEED) with seed data from the dataset TDM.SEED.DATA. Update the STEP03.PARMCD to select the seed lists to load Update STEP05.PARMCD to add seed lists desired: HASHLOV1, RANDLOV1, SEQLOV1 Change job card

VSAM Optional Files - KSDSXREF Run the job TDM.LIB.RUNJCL(KSDSXREF) Update the datasets Update VOLUME info This job creates an empty (but usable) VSAM (TDM.VXREF) file to store/lookup XREF data masking Change job card

VSAM Optional Files - KSDSSUB Run the job TDM.LIB.RUNJCL(KSDSSUB) Update the datasets Update VOLUME info This job creates an empty (but usable) VSAM (TDM.VSUBSET) file to store/lookup XREF data masking Change job card

VSAM Verification Run the job Change job card TDM.LIB.RUNJCL(GTXPRT) TDM.LIB.RUNJCL(GTXGEN) TDM.LIB.RUNJCL(GTXMSKVS) Change job card The seedlist ‘US STATE ZIP CITY COUNTY’ is being used, if the seedlist has not been loaded the test will fail with return code 8

QUESTIONS?