1. The Fractal World of Student Engagement 26 th Annual Georgia Perimeter College Mathematics Conference February 15, 2013 Patricia (Patti) Gregg, Ph.D. Acting Director GPC Office of Institutional Research and Planning

2. My fractal world What faculty think I do What my mother thinks I do

3. What I think I do What I really do

5. Our students have such varied backgrounds and life experiences, is it really possible to understand them?

6. If it were impossible, we wouldn’t have dozens of commercial surveys on the market, but …. If it were easy, we wouldn’t have dozens of commercially available surveys on the market!

7. Measurement Tools: The National Surveys The “Grandaddy of them all” CIRP Freshman Survey http://www.heri.ucla.edu/cirpoverview.php

10. The Heirs Apparent National Survey of Student Engagement http://nsse.iub.edu/ Community College Survey of Student Engagement http://www.ccsse.org/ Survey of Entering Student Engagement http://www.ccsse.org/sense/

16. The Also-Rans College Student Experiences Questionnaire (CSEQ) http://cseq.iub.edu/cseq_generalinfo.cfm College Student Expectations Questionnaire (CSXQ) http://cseq.iub.edu/csxq_generalinfo.cfm Community College Student Experiences Questionnaire http://www.memphis.edu/cshe/ccseq.php

22. While they each have slightly different emphases and/or target audiences, the common approach of all these surveys is to ask about specific behaviors rather than general opinions. They “operationalize” engagement.

23. What do the findings tell us? Generally, institutions receive a report that shows the frequency distribution of responses to each survey item, along with benchmark data from the national sample for comparative purposes. Depending upon the survey, the comparison group might be based on institutional type or size. In most cases, the survey publishers define the comparison group, not the institution.

24. Nationally-benchmarked survey findings can be useful …

25. But unless your institution is made up entirely of you probably want to know how particular groups of students responded.

26. Most of the big national surveys will provide your institution with the raw data file, so that your Institutional Research office can do further analysis of the responses based on factors that are important to you. At GPC we look at the usual demographic “suspects” (Age, Gender, Race/Ethnicity) as well as Campus, Major, Full/Part-time Status and SCH-earned.

27. Sample CCSSE Findings - Engagement In a typical 7-day week, 80.0% of all survey respondents spent no time participating in college-sponsored activities: As expected, full-time students were more likely than part-time students to participate in activities. Across ethnic groups, Black students were most likely (24.6%) and White students least likely (13.7%) to participate in activities. Regarding other extra- or co-curricular activities, 60.2% of all survey respondents said that within the past year they never attended an art exhibit or performance, and 42.4% never exercised or participated in physical fitness activities: Black students were most likely (15.5%) and White students least likely (10.4%) to attend cultural events “Very Often” or “Often.” White students were most likely (41.6%) and Hispanic students least likely (23.9%) to exercise “Very Often” or “Often.”

30. Can these surveys be scaled down for just my department or even just my class? Absolutely! The most important idea to keep in mind is to ask your questions in a way that operationalizes the behaviors or experiences that are most relevant to your situation. Keep in mind that when students are not anonymous, they are less likely to answer sensitive questions candidly. Only gather information you can actually act upon.

33. Oh and by the way … “Engagement” doesn’t always have to be all We want our students to be engaged intellectually as well! One tool we are using at GPC is the Critical Thinking Assessment Test (CAT)

38. Let’s stay engaged with one another! I welcome your questions and comments, from the abstract to the concrete, and all points in between. Patricia.Gregg@gpc.edu 678-891-2571 Georgia Perimeter College Office of Institutional Research and Planning 1975 Lakeside Parkway, Suite 350-B Tucker GA 30084