EVOLUTION FROM EXCEL PIVOT TABLES TO

Slides:



Advertisements
Similar presentations
Importing Transfer Equivalencies: How to Maximize Efficiency How Columbia College Office of Registrar improved productivity through third party solutions.
Advertisements

Introduction to SPSS Allen Risley Academic Technology Services, CSUSM
Visualizing Multiple Physician Office Locations Exercise 9 GIS in Planning and Public Health Wansoo Im, Ph.D.
A Simple Guide to Using SPSS© for Windows
 Explore the principles of cost-volume-profit relationships  Perform a basic what-if analysis  Use Goal Seek to calculate a solution  Create a one-variable.
From Your Spreadsheets to UAccess Analytics An Introduction to Utilizing MyAnalytics Lists.
McGraw-Hill/Irwin © 2004 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 9 Processing the Data.
Introduction to MATLAB Session 1 Prepared By: Dina El Kholy Ahmed Dalal Statistics Course – Biomedical Department -year 3.
Introduction to SPSS Edward A. Greenberg, PhD
IPC144 Introduction to Programming Using C Week 1 – Lesson 2
Ch2: Exploring Data: Charts 13 Sep 2011 BUSI275 Dr. Sean Ho HW1 due Thu 10pm Download and open “SportsShoes.xls”SportsShoes.xls.
Collection of Assessment Results
Data Analysis Lab 02 Using Crosstabs to compare percentages.
Sizing Basics  Why Size?  When to size  Sizing issues:  Bits and Bytes  Blocks (aka pages) of Data  Different Data types  Row Size  Table Sizing.
MK346 – Undergraduate Dissertation Preparation Part II - Data Analysis and Significance Testing.
A Simple Guide to Using SPSS ( Statistical Package for the Social Sciences) for Windows.
Analysis Introduction Data files, SPSS, and Survey Statistics.
CHAPTER 17 INTRODUCTION TO SPREADSHEETS. SPREADSHEETS Application Software designed to aid users in entering, moving,copying, labeling, displaying and.
Overview Excel is a spreadsheet, a grid made from columns and rows. It is a software program that can make number manipulation easy and somewhat painless.
TIMOTHY SERVINSKY PROJECT MANAGER CENTER FOR SURVEY RESEARCH Data Preparation: An Introduction to Getting Data Ready for Analysis.
Social Science Research Design and Statistics, 2/e Alfred P. Rovai, Jason D. Baker, and Michael K. Ponton Selecting Cases PowerPoint Prepared by Alfred.
Data Entry Goal is to accurately transcribe data from data sheets into electronic form –Good database design helps –Validation rules help –Good data sheet.
Review for MassHunter and reporting
Chapter 21: Controlling Data Storage Space 1 STAT 541 ©Spring 2012 Imelda Go, John Grego, Jennifer Lasecki and the University of South Carolina.
CSCI 161 Lecture 3 Martin van Bommel. Operating System Program that acts as interface to other software and the underlying hardware Operating System Utilities.
Understanding SPSS II Workshop Series August 9, 2016.
Workshop Series May 17, 2017 Brandon Aragon
Session 1 Retrieving Data From a Single Table
Session 15 Merging Data in SPSS
Formulas, Functions, and other Useful Features
The University of Delaware Higher Education Consortia
Understanding SPSS II Workshop Series July 19, 2017.
Independent t-Test PowerPoint Prepared by Alfred P. Rovai
College Credit Plus Updates September 12, 2016.
CHP - 9 File Structures.
The University of Delaware Higher Education Consortia
Software Specification Tools
Required Data Files Review
FAFSA and Financial Aid 101
Survey Training Pack Session 9 – Data Entry.
Download/Upload Receipts
Chapter 2: Getting Data into SAS
The Selection Structure
Introduction to WRDS data platform
SAS Programming Introduction to SAS.
Advanced Excel Helen Mills OME-RESA.
Survey Redesign Division of Quality Improvement
Preliminaries: -- vector, raster, shapefiles, feature classes.
Data quality 1: Individual records
Chapter 1: Introduction to SAS
TRAINING OF FOCAL POINTS ON THE CountrySTAT/FENIX SYSTEM
Designing and Debugging Batch and Interactive COBOL Programs
Chapter 4: Sorting, Printing, Summarizing
2018 NM Community Survey Data Entry Training
Gaining Efficiencies in IPEDS Reporting to Increase IR Capacity
TRAINING OF FOCAL POINTS on the CountrySTAT SYSTEM based on FENIX
Click ‘browse’ to search your device for
Workplace Equity Information Management System (WEIMS)
Lab 3 and HRP259 Lab and Combining (with SQL)
Web SA: File Upload Function
Never Cut and Paste Again
Workplace Equity Information Management System (WEIMS)
Microsoft Office Illustrated Introductory, Windows XP Edition
Topic 3 Lesson 2 – Flexible Models
Business Analytics Novo Nordisk Using IBM Business Analytics solutions to automate the collection and collation of medical survey data The need: Diabetes.
The Basics of Excel Part I Monday, April 3rd 2017
Databases WOW!! A database is a collection of related data.
Excel Tips & Tricks July 18, 2019.
The Web and Using the VTAC Analysis Tool
Item 5 Modernisation of the EU-SILC Production
Presentation transcript:

EVOLUTION FROM EXCEL PIVOT TABLES TO UPLOADING SAS-GENERATED FILES FOR IPEDS Robert June and Alexandra Riley, Marquette University Introduction SAS Code – Key Value Pair SAS Code – Fixed Width Data Verification As the workload of our office increased, we looked for ways to do more with less. The IPEDS surveys were one area in which SAS could help us increase: Accuracy – Efficiency – Reproducibility This poster focuses on Part A of the Completions Survey, and presents two possible methods for generating a data upload file: key value pair and fixed width. The general techniques presented can be used to generate data upload files for other IPEDS surveys. The data in the text file are specified by a set of key value pairs For each pair, the “key” is the name of a characteristic and the “value” is the level/category. (e.g. SEX=1) Key value pairs are separated by commas in each row The data in the text file are specified by their position in the columns of the text file Each field in the file has a starting column and a length The values for each field are put in the prescribed column position Important to confirm that data were accurately uploaded to the IPEDS survey. Verify that data appearing in IPEDS corresponds to uploaded data file Key value pair file is easier to read and compare Step 1: Data Preparation Step 1: Data Preparation Create SAS dataset where data fields are re-coded from institutional values to IPEDS specified values according to the IPEDS import specification Part A fields to re-code are: major number, cipcode, award level, gender, race/ethnicity (e.g. gender recoded from M,F to 1,2) Create a generic analysis variable where values all equal 1 Create SAS dataset where data fields are re-coded from institutional values to IPEDS specified values according to the IPEDS import specification Part A fields to recode are: major number, cipcode, and award level (e.g. award level recoded from Bachelor’s to 3) Need to create 18 binary analysis fields corresponding to each combination of gender and ethnicity Evolution of IPEDS at MU Step 2: Data Aggregation The responsibility and efficiency of submitting data to IPEDS has evolved over the years at Marquette. Calculate the number of degrees conferred for each combination of fields defined in Step 1 using the analysis variable (cnt = 1) Use the MEANS procedure in SAS Key holder in Public Affairs Acted as coordinator; each functional area compiled report Process was labor intensive, time consuming, and error prone Key holder in Institutional Research Reports prepared using SPSS with limited use of syntax and Excel pivot tables Data entry performed manually; time consuming; still error prone Adoption of SAS in IR Use SAS to generate aggregate data and upload files, minimizing data entry Significantly less time consuming and error prone Step 2: Data Aggregation PROC MEANS has 18 analysis variables corresponding to those created in Step 1 Resulting dataset will have fewer rows but more columns than key value pair method Structure of PART_A data set generated from PROC MEANS Is it worth it? Costs SAS has a steep learning curve, requiring a significant time investment in training Licensing costs can be significant, especially in year 1 Benefits Significant time savings; upload process takes minutes instead of hours Automated process reduces errors Code can be reused year after year. Step 3: Upload File Generation Step 3: Upload File Generation Create text file from PART_A_FW dataset from Step 2 @n moves the pointer to column n Zw. is a format which pads a number with leading zeros where w is the total width of the variable. Create a text file from the PART_A dataset in Step 2 DATA _NULL_ processes DATA step without creating a dataset FILE statement specifies the location and name of the text file PUT statement writes lines to the file specified in FILE statement as specified by the IPEDS Import specs +(-1) in PUT statement moves the pointer back one, eliminating unnecessary space Degree Data File Clear Path for Implementation The subsequent examples in this poster focus on the Part A of the Completions Survey. The structure of the data used is: Start with Completions. This survey provides the greatest return on investment. Human Resources is very challenging. Use the other surveys to gain experience before attempting this one. Partial implementations work. Missing information can be manually entered on the data entry screens. Read the IPEDS documentation very carefully. Don’t be afraid to call the Help Desk or reach out to other resources. Sample upload file Sample upload file Robert June, robert.june@marquette.edu, 414-288-1906 Alexandra Riley, alexandra.riley@marquette.edu, 414-288-8049