©2014 Automated Financial Systems, Inc. All Rights Reserved. AFS and all AFS product trademarks are registered trademarks of Automated Financial Systems,

Slides:



Advertisements
Similar presentations
StarBuilder Payroll/GL/AP Importing Session - 203
Advertisements

Georgia Department of Audits & Accounts Michael Johnson, CPA & Seth Grad, CPA Auditing Medicaid Systems.
Welcome www. xlaccount.com Url : Contact Us : India – Mob #
The Binary Numbering Systems
 2005 Pearson Education, Inc. All rights reserved Introduction.
Winmail.dat what it is and what to do with it This guide tells you all about winmail.dat files and the WMDecode decoder Instructions for installing WMDecode.
1.  As per Income Tax Department (ITD) circular no. 03/2011 dated May 13, 2011 Companies and Banks are required to issue Form 16A from TIN to their deductees.
Transmission Characteristics 1. Introduction (Information Interchange codes) 2. Asynchronous and Synchronous Transmissions 3. Error detection (bit errors)
PPA 502 – Program Evaluation Lecture 5b – Collecting Data from Agency Records.
6 th Annual Focus Users’ Conference Texas Reporting Presented by: Bethany Heslam.
Broadcast service Core tools. Agenda 1.Introduction – tool and its main features 2.Setting up and sending a simple broadcast 3.Achieving.
CCE-EDUSAT SESSION FOR COMPUTER FUNDAMENTALS Date: Session III Topic: Number Systems Faculty: Anita Kanavalli Department of CSE M S Ramaiah.
COMPUTER FUNDAMENTALS David Samuel Bhatti
Understanding SAS Data Step Processing Alan C. Elliott stattutorials.com.
Internet Banking Standard and Standard-Hybrid Registration Intuit Financial Services University Internet Banking Certification Training.
Product Retrieval Statistics Canada / Statistique Canada Chuck Humphrey ACCOLEDS/DLI Training December, 2001.
What is RobotC?!?! Team 2425 Hydra. Overview What is RobotC What is RobotC used for What you need to program a robot How a robot program works Framework.
Seiler Instrument January 7, 2013
PHP Tutorials 02 Olarik Surinta Management Information System Faculty of Informatics.
Solutions Summit 2014 Discrepancy Processing & Resolution Terri Sullivan.
Topics Introduction Hardware and Software How Computers Store Data
1 Lab Session-III CSIT-120 Fall 2000 Revising Previous session Data input and output While loop Exercise Limits and Bounds Session III-B (starts on slide.
SAS Workshop Lecture 1 Lecturer: Annie N. Simpson, MSc.
Input & Output: Console
Creating Context definitions for your own data.  RUN CONTEXT/TOOLS ◦ Application ◦ Application Data File ◦ Master File Record ◦ Context Definition.
ENTERING ELIGIBLE ENERGY RESOURCE APPLICATIONS IN DELAFILE Version 2.0 August 25, 2015.
Learning Web Design: Chapter 4. HTML  Hypertext Markup Language (HTML)  Uses tags to tell the browser the start and end of a certain kind of formatting.
IPC144 Introduction to Programming Using C Week 1 – Lesson 2
Cosc 2150: Computer Organization
Digital Logic Lecture 4 Binary Codes The Hashemite University Computer Engineering Department.
Copyright © 2002 W. A. Tucker1 Chapter 7 Lecture Notes Bill Tucker Austin Community College COSC 1315.
Data Representation and Storage Lecture 5. Representations A number value can be represented in many ways: 5 Five V IIIII Cinq Hold up my hand.
1 INFORMATION IN DIGITAL DEVICES. 2 Digital Devices Most computers today are composed of digital devices. –Process electrical signals. –Can only have.
© 2008 The McGraw-Hill Companies, Inc. All rights reserved. ACCESS 2007 M I C R O S O F T ® THE PROFESSIONAL APPROACH S E R I E S Lesson 13 – Advanced.
Colleague, Excel & Word Best of Friends Presented by: Joan Kaun & Yvonne Nelson College of the Rockies.
Chapter 7 File I/O 1. File, Record & Field 2 The file is just a chunk of disk space set aside for data and given a name. The computer has no idea what.
GTR Data Inc. Welcome to our EDI Demonstration G.T.R. Data Inc. August 1997.
JCL Day 2. 2 Copyright © 2005, Infosys Technologies Ltd ER/CORP/CRS/OS02/003 Version No: 1.0 Agenda for Day 2  DD statement  Syntax  Parameters  Procedures.
Lecture 31 Creating Executable Programs on the Mainframe Tuesday, January 20, 2009.
BMTRY 789 Lecture 11: Debugging Readings – Chapter 10 (3 rd Ed) from “The Little SAS Book” Lab Problems – None Homework Due – None Final Project Presentations.
A SAS User's Guide to Storage Management Allan Page Senior Marketing Analyst Canadian Tire Financial Services.
Chapter # 10 Data Transfer Prepared by :Sir Mazhar Javed.
Data Representation. What is data? Data is information that has been translated into a form that is more convenient to process As information take different.
tool kit. USER GUIDE Etiquette (Acceptable use policy) – a list of rules that we observe Use a suitable subject in the - this helps.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Chapter 5A Transforming Data Into Information.
© 2012 IBM Corporation 3 rd Party Registration & Account Management 1 1 SMT Post R 4.3 Potential Enhancements.
PHP Form Processing * referenced from
A PC Wakes Up A STORY BY VICTOR NORMAN. Once upon a time…  a PC (we’ll call him “H”) is connected to a network and turned on. Aside: The network looks.
Variables in C Topics  Naming Variables  Declaring Variables  Using Variables  The Assignment Statement Reading  Sections
CMSC 104, Version 8/061L09VariablesInC.ppt Variables in C Topics Naming Variables Declaring Variables Using Variables The Assignment Statement Reading.
Do not put content on the brand signature area NOBS for Noobs David B. Horvath, CCP, MS PhilaSUG Winter 2015 Meeting NOBS for Noobs.
Comp 335 – File Structures Hexadecimal Dumps Interpreting File Contents.
Text2PTO: Modernizing Patent Application Filing A Proposal for Submitting Text Applications to the USPTO.
IPEmotion License Management PM (V1.2).
Working Efficiently with Large SAS® Datasets Vishal Jain Senior Programmer.
Classification : Internal DFSORT Utility. Classification : Internal Overview DFSORT is IBM's high-performance product for z/OS. Following operations can.
Hints and Tips SAUSAG Q SORTING – NOUNIQUEKEY The NOUNIQUEKEY option on PROC SORT is a useful way in 9.3 to easily retain only those records with.
Topics Introduction Hardware and Software How Computers Store Data
Net 323 D: Networks Protocols
Product Retrieval Statistics Canada / Statistique Canada Title page
Data File Import / Export
TOPICS Information Representation Characters and Images
GDSS – Digital Signature
Data Types.
ELECTRONIC MAIL SECURITY
ELECTRONIC MAIL SECURITY
Net 323 D: Networks Protocols
Comparative Reporting & Analysis (CR&A)
Chapter 3 - Binary Numbering System
Presentation transcript:

©2014 Automated Financial Systems, Inc. All Rights Reserved. AFS and all AFS product trademarks are registered trademarks of Automated Financial Systems, Inc. The content of this document represents confidential and proprietary information of AFS. This information may not be disclosed to any third party, other than the direct addressee and its employees, agents, and representatives. The infringement of this prohibition may violate AFS proprietary and trade secret rights with resulting irreparable damage to AFS. Your cooperation is requested and appreciated. Thank you for your help in this matter. AFS 123 Summit Drive, Exton, Pennsylvania Telephone (610) Fax (610) Washington DC SAS Users 1 st Quarter Meeting March 3, 2015 Reading EBCDIC in an ASCII Environment - Input Statement in SAS Data Step, including dealing with Variable Length EBCDIC Files

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 2 March 27, 2014 Achieving Success through Execution So what’s the problem? (just one of many examples) Hi, I am lost in MVS and COBOl land. Any help would be appreciated. I am trying to work of a file that is located on our IBM mainframe. This file is not a SAS dataset and is an extract created by our MIS staff. I am having a problem when using this file to create a SAS dataset. The fields I am having issues with are all packed decimal fields, I am using the format PD5. and PD3. to read these into SAS. My SAS dataset ends up with 0 obs. The COBOL record layout of couple of these variables is as follows: Variable COBOL format SAS format SIZE USAGE IS COMP-3 PIC S9(5). PD5. AGE USAGE IS COMP-3 PIC 9(3). PD3. The error message I am getting is something like this NOTE: Invalid data for SIZE in line NOTE: Invalid data for AGE in line Looking at SAS format documentation, I thought that PD5. and PD3. were the right ones for the COBOl formats above. Am I just deluded? And if the formats are correct, why is the program bombing at line Could there really be some invalid data that is causing this? Hopefully this makes some sense. If not, let me know, and I’ll try to be more descriptive. Muchos gracias! Newbie

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 3 March 27, 2014 Achieving Success through Execution So what’s the problem? (tech talk but in English)  Large data sources often come from applications that run on IBM Mainframes. The IBM Mainframe stores data in EBCDIC (Extended Binary Coded Decimal Interchange Code) while smaller organizations and data consumers run on systems that use ASCII (American Standard Code for Information Interchange)  If the file contains data other than printable characters (like binary or packed decimal), simple conversion techniques cannot be used. The techniques for easy conversions as well as complex (using SAS Formats) will be covered along with methods of viewing the data outside of SAS  Both the IBM Mainframe and the Windows Server/PC environment will be the focus of this session. The specific tools include IEBGENER, PKZIP, FTP, and UltraEdit, in addition to SAS.

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 4 March 27, 2014 Achieving Success through Execution So what do I need to do? (What we will cover now) Run an IEBGENER Utility to Unformat the data into text Run PKZIP (optional depending on file size) RUN FTP with “BIN” Option (mainframe to server) Use NotePad and/or UltraEdit to view data for correctness (Optional?) Create the proper field SAS Informat statements to read the data into SAS allowing for the offset in starting position to include the 4-byte Record Control Characters

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 5 March 27, 2014 Achieving Success through Execution IEBGENER Utility The transfer process from mainframe to server ends up dropping the 4byte RDW (the 4bytes in front of each record of a variable length file that gives you the record length) So we ask to receive files that have been converted to an unformatted RECFM with an LRECL= This format puts a 4byte block of data in front of each record that holds the actual record length We run this unformatted file through a program that reads the 4 byte block of data and give us the length of each record so that we can re-constitute the file

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 6 March 27, 2014 Achieving Success through Execution IEBGENER Utility Sample JCL Here's the sample JCL for creating the unformatted files, it is just an IBM utility job - //********************************************************************** //IEBGENR1 EXEC PGM=IEBGENER //SYSPRINT DD SYSOUT=* //SYSUDUMP DD SYSOUT=* //SYSIN DD DUMMY //SYSUT1 DD DSN=YOUR.DATA.FILE, <--- YOUR SOURCE FILE // DISP=SHR // DCB=(RECFM=U,LRECL=32760) <--- GENERATES THE RDW - THIS NEEDS TO BE CODED JUST AS IS //SYSUT2 DD DSN=YOUR.DATA.FILE.PREZIP, <--- FILE THAT IS SENT TO YOU // DISP=(NEW,CATLG,DELETE), // UNIT=SYSDA,SPACE=(CYL,(100,100),RLSE), // DCB=(RECFM=U,LRECL=32760 )

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 7 March 27, 2014 Achieving Success through Execution PKZIP - What works and what doesn’t work There are limitations to PKZIP on the mainframe depending on what type of licenses your company has Some licenses only handle files up to a certain size i.e. 5G If you use PKZIP on the mainframe to compress your files before the FTP you will need an “UnZip” utility in your server environment that is compatible with PKZIP Not a requirement to use compression but will greatly reduce the download time; even including the zip and unzip time.

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 8 March 27, 2014 Achieving Success through Execution FTP Thingy (Option) you need to know Important note: when you transfer the files around between your multiple environments you need to keep the "BIN" option on during the FTP process or the files would switch over to ASCII automatically. We need these files in EBCDIC (thus bin) The default is EBCDIC to ASCII which will transform the target file into ASCII Though this ASCII file looks to be correct upon visual inspection, the packed fields will not transform correctly to be read correctly into your SAS program Most transmission folks are not aware of the above “bin” option to keep the file in EBCDIC when it downloads to the server

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 9 March 27, 2014 Achieving Success through Execution A Notepad View of EBCDIC ( this is how it should look)

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 10 March 27, 2014 Achieving Success through Execution A UltraEdit View of EBCDIC (this is how it should look)

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 11 March 27, 2014 Achieving Success through Execution A UltraEdit View of ASCII (this is how it should not look)

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 12 March 27, 2014 Achieving Success through Execution SAS Input Statement Informats – S370 and EBCDIC 19 APPL_CODE S370FZD1.0 /* APPLICATION 35 PROCTYP1 S370FZD2.0 /* PROCESS TYPE 1DBID=FC038,MC TYP1DIGIT2 S370FZD1.0 /* PROC TYP1 DIGIT 2 36 BOOKENTR S370FZD1.0 /* CBPRC1B 37 PROCTYP2 S370FZD2.0 /* PROCESS TYPE 2 37 TYP2DIGIT1 S370FZD1.0 /* PROC TYP2 DIGIT 1 38 TYP2DIGIT2 S370FZD1.0 /* PROC TYP2 DIGIT 2 39 DELAVAIL $EBCDIC1.0 /* CBINCTN DBID=FC039,MC NAME $EBCDIC15.0 /* SHORT NAME DBID=FC040,MC OBL_TYPE S370FPD2.0 /* OBLIGATION TYPE DBID=FC043,MC EFFECTDX S370FPD4.0 /* EFFECTIVE DATE DBID=FC044,MC POSTEDDX S370FPD4.0 /* POSTED DATE DBID=FC045,MC LSTCHGDX S370FPD4.0 /* LAST CHANGE DATE DBID=FC046,MC LSTACTDX S370FPD4.0 /* LAST ACTIVE DATE DBID=FC047,MC LGLMATDX S370FPD4.0 /* LEGAL MATURITY DATE DBID=FC048,MC ESTMATDX S370FPD4.0 /* ESTIMATED MATURE DATE DBID=FC049,MC OUTDBTDX S370FPD4.0 /* DATE OUT OF DEBT DBID=FC050,MC ORIGPRIN S370FPD8.2 /* ORIGINAL PRINCIPAL BAL DBID=FC060,MCO6O 107 CURRPRIN S370FPD8.2 /* CURRENT OUTSTANDING BAL DBID=FC061,MC MCUMMBAL S370FPD8.2 /* MONTHLY CUMMLATIVE BAL DBID=FC062,MC PUEARN S370FPD8.2 /* PLUS UNEARNED DBID=FC064,MC CHOFFBAL S370FPD8.2 /* CHARGE OFF BALANCE DBID=FC066,MC CHOFREOP $EBCDIC1.0 /* CHARGE OFF RECOVERY OPT DBID=FC067,MC ORIGOBLN S370FPD8.2 /* ORIGINAL OBLIGATION AMT DBID=FC070,MC ORGOBLDX S370FPD4.0 /* ORIG OBLIGATION DATE DBID=FC071,MC ORGMATDX S370FPD4.0 /* ORIGINAL MATURITY DATE DBID=FC073,MC RENEWTY $EBCDIC1.0 /* RENEWAL TYPE DBID=FC075,MC RNEWPRNO S370FPD6.0 /* RENEWAL PREVIOUS NUMBER DBID=FC076,MC RNEWTONO S370FPD6.0 /* RENEWAL TO NUMBER DBID=FC077,MC RNEWTIMZ S370FPD2.0 /* RENEWAL NUMBER OF TIMES DBID=FC078,MC SERVUNIT S370FZD5.0 /* SERVICE UNIT DBID=FC080,MC ASSIGNUN S370FZD5.0 /* ASSIGNMENT UNIT NUMBER DBID=FC081,MC ASSIGNUX $EBCDIC5.0 /* ASSIGNMENT UNIT CHAR DBID=FC081,MC OFFICER $EBCDIC5.0 /* OFFICER NUMBER DBID=FC082,MC GEN_LEDG S370FZD7.0 /* GENERAL LEDGER NUMBER DBID=FC083,MC083 */

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 13 March 27, 2014 Achieving Success through Execution Tips from Dave – SAS TS-642 a great place to start Tips from David B. Horvath of PNC Bank in Wilmington, DE SAS TS-642 is a great place to start

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 14 March 27, 2014 Achieving Success through Execution More Tips from Dave – Examples of Input Formats More Tips from David B. Horvath of PNC Bank in Wilmington, DE Input formats: $ebcdicNN. – converts EBCDIC character data to ASCII (COBOL pic X and 9 usage display – the default) s370fpdN.M. – converts packed data (2 binary coded decimal digits per byte, COBOL pic 9 usage comp-3) s370fzdN. – converts zoned decimal (COBOL S9 usage display where sign is not separate leading/trailing character) s370fibN. – converts binary data (COBOL pic 9 usage comp)

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 15 March 27, 2014 Achieving Success through Execution Upcoming PhilaSUG Meetings Save the Dates Check out for details M&T BankWinter 2015 Wilmington,DE March 12 Drexel UniversitySpring 2015 Penn State Fall 2015 Great Valley

© 2014 Automated Financial Systems, Inc. All Rights Reserved. Confidential & Proprietary. 16 March 27, 2014 Achieving Success through Execution Thank You for inviting me to speak today! Questions? Randy Noga