1. Agenda ISC Client Care Graduate Admissions CollegeNet Project NGSS bits – Banner GUID – Tuition Distribution plan – Q & A News / upcoming events How data enters the warehouse – 1994 version Student Data User Group October 8, 2014

2. Opened 10/06. Initially, AIT and DW not included. For DW support, contact da-staff@isc as before. For all other IS support, contact Client Care Website: www.upenn.edu/isc/help Email: help@isc.upenn.edu Phone: 215-898-1000 Hours and location: M-F 8AM-6PM, Sansom West, Suite 202 Work together to redefine support for AIT/DW Student Data User Group October 8, 2014 ISC Client Care

3. CollegeNet Implementation CollegeNet components Applications Form (Aug – Sep 2014) Two separate forms, subsystems, data. 1.Wharton www.applyweb.com/UPENNW 2.Graduate Shared www.applyweb.com/UPENNG Inquiry Form ( Oct 2014) Admit Review Module (~Oct 2014) Prospect CRM Module (~Dec 2014) Student Data User Group October 8, 2014

4. CollegeNet Implementation Data Warehouse changes New CN Reporting data collection – Designed for CN data structures – Includes data previously available only in School Staging tables. – Application data feed defined, testing in-progress. – Admit data feed will be next. – No plans to load CN Prospect, Inquiry data to warehouse CN applications will be in CN Reporting data collection only. Historical Application data to-be converted, added to CN collection. Not Changing Some application data not fed to DW: documents, essays, etc. Data loaded daily. Student Data User Group October 8, 2014

5. CollegeNet Implementation Model Comparison – GA Reporting Universe – CN Reporting Universe with CN Application-specific tables Student Data User Group October 8, 2014

6. NGSS bits Banner GUID on PennCommunity Tuition Distribution changes For Release 1, the only change is that amount paid and billed will come from new AR tables. Under Release 2, bigger impacts as student data is sourced from Pennant (Banner) Town Hall Q & A

7. News / Upcoming Events Student Census Snapshot (STDTTERM universe) – Friday night 10/10/2014 – Count Students as of Today snapshot will be run/saved on 10/11 REQBUILD training – Mandatory for requirement builders; optional for report writers – now available on KnowledgeLink Starting planning for BO upgrade from v3.1 -> 4.1 Student Data User Group October 8, 2014

8. How data enters the warehouse – 1994 version The first Student load was Dec 19, 1994 from SRS data on the mainframe into the warehouse (per Tad) The student load processes – Reference (lookup tables) – Student Data – Course Data – Academic Program Worksheet – SIDS for changes in Student and Course data The presence of a SID in the student/course extract means – Deletion of all data for that student / course – Extraction and refresh of all data for that student / course Series of scripts handled by Zeke (job scheduling program) Student Data User Group October 8, 2014

9. How data enters the warehouse – Part 1 Mainframe Script steps – DW0010P - Reads the mainframe PLOG to list any student IDs where changes made since last run – DW0100P – Pulls bio/demographic, academic program, student term, degree, equivalent credit, leaves, holds for each student ID GPAs are computed using a COBOL program and Programs are compressed for degree pursual Writes to an extract file with a record type for each table to be loaded – DW0200P Pulls course section, instructor and meeting data Writes to extract file – DW0900P Extracts the reference data from the SRS Data Dictionary – Course and student extract files are merged into one Student Data User Group October 8, 2014

10. How data enters the warehouse – Part 2 FTP Script steps – DW1000P – apply header and trailer to each output file and send Formats the PLOG SID file Formats the PLOG Course file Formats the Student & Course file Formats the APW Extract Formats the Reference Table extract – DW1100P – verifies the results of the FTP’d file on the warehouse Student Data User Group October 8, 2014

11. How data enters the warehouse – Part 3 Warehouse Script steps – Revoke access privileges on all student tables – Drop indexes – Split student / course file, reference file and APW into separate data files by record type – Delete all student and course data for those SIDS in the PLOG files – Use SQL*Loader to push last night’s data into the tables – Custom scripts run to update various tables Course Inventory Descriptions Course Section Tuit School for TD Current Addresses using today’s date and a predefined pecking order of addresses Photo ID from Penn Card system Set Penn IDs and Email addresses for Students, Instructors, Advisors – Create indexes – Analyze tables – More custom scripts Update dissertation term counts Sets pilot curriculum flag on Degree Pursual Fill out student worksheets with “boilerplate” data – Restore access to users Student Data User Group October 8, 2014

12. How data enters the warehouse – summary Student Data User Group October 8, 2014 Duration Depends on volume of changes Dependent on other jobs to finish Script Steps Mainframe extract 1300 SIDS = 15 mins 16000 SIDS = 1.75 hour Warehouse Load Starts after the Mainframe Extract and FTP jobs finish Takes between 3-4 hours to load everything Reasons for delays Competing processes on the warehouse Dependent jobs are slow Something Breaks

13. How data enters the warehouse – 2012 Student Data User Group October 8, 2014 Next Time We’ll talk about advances in loading the warehouse Dimensional modeling Staging servers