Center for Learning Outcomes Assessment Indiana State University, Terre Haute, IN The University Learning Outcomes Assessment (UniLOA) Measuring the “rest” of student growth, learning, and development Center for Learning Outcomes Assessment, Inc.
What is the UniLOA? The University Learning Outcomes Assessment is a highly valid and reliable instrument designed to measure student behaviors consistent with desirable student learning outcomes Center for Learning Outcomes Assessment, Inc.
Properties of the UniLOA 70 behavior-specific items 30 Demographics questions Administered either on paper or in electronic format Additional, locally-added questions permitted 20 minutes average completion time required Center for Learning Outcomes Assessment, Inc.
Behavioral Domains Measured Critical Thinking Self-awareness Communication Diversity Citizenship Membership and Leadership Relationships Center for Learning Outcomes Assessment, Inc.
Question Sample with Response Options (Cognitive trigger with a behavioral stem) I use good skills in confronting others. For example I share my observations of another person in a constructive and non- threatening way to influence changes in their behavior Don’t tell us what you think we want to hear, tell us what you really do. Never – A B C D E F G H I J – Always Center for Learning Outcomes Assessment, Inc.
Report Format - Domains UniLOA Domain Scores Center for Learning Outcomes Assessment, Inc. Critical ThinkingSelf-AwarenessCommunicationDiversityCitizenshipMembership and Leadership Relationships Means Means
Report Format - Items UniLOA Sample Item Scores Center for Learning Outcomes Assessment, Inc. Item National Mean National Mean My presentations in classes are concise, precise, and persuasive. For example, they are always within the time limit and don’t wander off the point and I typically get an A on my presentations I list my personal goals for a class or activity. For example, I list my learning goals for a class beyond the learning outcomes listed in the syllabus, as well as my goal for a grade I make sure that when I am talking with someone I change my communication style to be consistent with their world view. For example, when speaking to someone who is devoutly religious I take that into account when I speak with them I act on the values of diversity and social justice. For example, I work with an organization or with my church to help others
What does the UniLOA Tell Us - Diagnosis - How students at an institution or organization score in comparison to the “average” student nationwide Specific behaviors students are engaging at an appropriate level* Specific behaviors students are failing to engage at an appropriate level* *appropriate levels are determined by the institution consistent with their articulated desired student learning outcomes Center for Learning Outcomes Assessment, Inc.
Within Group Comparisons Exemplar vs. Institutional Averages Center for Learning Outcomes Assessment, Inc. Student Exemplar National Average Number of Hours Studying per Week Number of Hours Watching Television or Engaging in Online Entertainment per week 2 or less6.95 Cumulative Grade Point Average Number of Organizational memberships31.78 Number of Leadership Positions Held2.71 Number of Volunteer Hours per Week42.39
What does the UniLOA Tell Us - Prescription - What areas are in need of institutional level attention to increase desirable student behaviors What specific behaviors can be targeted through the development of intentional supports, services, interventions, and programs designed to increase positive behaviors How can appropriate allocation of resources (attention, time, money) be made to maximize return on investment What will be the anticipated outcomes in terms of enrollment, persistence, retention and graduation as a result of improved supports, services, interventions, and programs Center for Learning Outcomes Assessment, Inc.
For More Information Please contact us at: Mark Frederick, Ph.D. Will Barratt, Ph.D. Center for Learning Outcomes Assessment, Inc.