1. CSUMB Undergraduate and Graduate Alumni Experience Studies
Institutional Assessment and Research CSU Monterey Bay

2. Charge and Instrument Development
Provost - Academic Program Review
Existing Program Review Instruments
Other Universities’ Alumni Instruments
Campus Involvement

3. Data Acquisition and Preparation

4. Data Acquisition and Evaluation
Population and contact information from Alumni Relations (Raiser’s Edge)
Demographics from CMS
Data inconsistent and missing some elements
Some alumni missing entirely
After graduation, data are fed by Enrollment Management to the Alumni Relations department and maintained in the latter’s system, Raiser’s Edge, for development purposes.
For this survey, IAR requested contact information and several variables for recent - last 5 years - alumni, including an identifier for merging with CMS Student data. The use of institutional data allows us to drop demographic questions from the instrument, thereby reducing survey-taker burden.
Having received these data, IAR found cleanup to be necessary. Data were inconsistent, missing elements, and some alumni were completely absent.

5. Data Cleansing and Preparation
Specific issues
2 reported for Science Illustration when there should be 119
Inconsistent date formats
Some dates outside recent range
Some Degree Types inconsistent with majors
Wrong / invalid IDs
Missing s
Worked with Deans and Chairs to improve dataset
Prepared for vendor (CampusLabs)
Returned improved data to Alumni Relations
Specific issues included…
We worked with the Deans and Chairs to validate the data and enhanced it from CMS Student. In all, we had 850 graduate and 5378 undergraduate invitees. After cleanup approximately 96% of records were usable; some had to be dropped for lack of an address from Alumni, CMS, or the Academic units. We had to accept some level of missing current location records given no alternative data source.
Then we prepared the data for our vendor, CampusLabs, to be used for distribution of the survey, including a mail merge to populate appropriate Dean and Chair senders, along with recipient names.
After performing cleanup, data were returned to Alumni Relations and use for the CO Alumni survey.

6. Survey Administration

7. Survey Administration
CampusLabs Baseline used for the survey tool
Survey administered 9/ /30
Campus Administration Partners
Incentives
Typical Alumni response rate: 8%
Typical Alumni response (CSU):
up to 12 s sent (incentive starts with #3) partners: Dean, Chair, Alumni Association President incentive $400 prize, threshold 35% national rate from:

8. Typical Alumni Response (CSU)

9. Survey Response Rates Undergraduate Alumni Survey

10. Data Visualization and Reporting

11. We built the full reports of the studies in Tableau and published them in Tableau Public.
To give our campus audience a summary teaser of the findings of the alumni studies, we made them the topic of our Spring 2018 IAR Insights, which is like a newsletter or research brief we do in the Fall and Spring semesters.
All of the graphics for the IAR Insights and those used on the summary overview page in each of the Tableau reports were created using Adobe Illustrator.
For the IAR Insights, we focused on first time freshmen, upper division transfer and graduate (including credential/certificate) admission basis groups. However, the full reports in Tableau allow users to filter by other admission basis groups.

15. What were alumni’s experiences with internships while at CSUMB?

16. What further education experiences did alumni have after graduating from CSUMB?

17. How did alumni’s experience at CSUMB impact their employment and career?

18. Full Reports Built in Tableau Public
Undergraduate Alumni Experience Study Report
Graduate Alumni Experience Study Report

19. Qualitative Responses and Synthesis

20. Qualitative Tool/Data
Qualitative Survey Reporting Tool - Home Grown
Top 5 Comments
Number of Graduate Comments: 532
Skills
Courses
Majors
Work/career
Faculty
Number of Undergraduate Comments: 1,859
Top 5 Comments
Majors
Work/career
Courses
Faculty
Skills
Ask about whether anyone is using SPSS Modeler for Qualitative analysis

21. Questions?
Institutional Assessment and Research -
Veronica Chukwuemeka
Director of Institutional Assessment and Research
Michael Dorsch
Data and Visualization Analyst
Sathyan Sundaram
Research Analyst