Center for Learning Outcomes Assessment Indiana State University, Terre Haute, IN The University Learning Outcomes Assessment (UniLOA) Measuring the “rest”

Slides:



Advertisements
Similar presentations
Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Advertisements

Data Collection Strategies An Overview. How Do We Assess ?
Goals-Based Evaluation (GBE)
Maximizing Your NSSE & CCSSE Results
UniLOA The University Learning Outcomes Assessment The Center for Learning Outcomes Assessment, Inc. ©
Identifying Future Leaders Warren Bobrow, Ph.D. All About Performance
Measurement  The process whereby individual instances within a defined population are scored on an attribute according to rules Usually given a numeric.
Hosted by We’ve gone live…Now What? A 10-step Post-Implementation Road Map Presented by Doug D. Whittle, PhD Partner The Diagonal Group, LLC
© 2003 The Diagonal Group LLC After Go-Live: A SAP post-implementation roadmap to success Presented by Doug D. Whittle Session.
Assessing Student Learning Outcomes – Jeff Mackay/Dan Fergueson Welcome.
Fact: We constantly employ the entire assessment cycle in our daily lives Determining our desired outcomes Designing an assessment methodology Collecting.
A Tale of Two Cities: Comprehensive Assessment of College Student Readiness Paul Gore, Ph.D. University of Utah
UniLOA The University Learning Outcomes Assessment The Center for Learning Outcomes Assessment, Inc. ©
BENCHMARKING EFFECTIVE EDUCATIONAL PRACTICE IN COMMUNITY COLLEGES What We’re Learning. What Lies Ahead.
ACA and Youth Development M. Deborah Bialeschki, Ph.D., ACA Marge Scanlin, Ed.D., ACA Michelle Gambone, Ph.D., YDSI Funded by Lilly Endowment Inc.
Sources:
OCTOBER ED DIRECTOR PROFESSIONAL DEVELOPMENT 10/1/14 POWERFUL & PURPOSEFUL FEEDBACK.
Copyright © 2001 by The Psychological Corporation 1 The Academic Competence Evaluation Scales (ACES) Rating scale technology for identifying students with.
Dr. Albrecht Research Team EXAMPLE of EVALUATIO N RESEARCH SERVICE LEARNING
SENSE 2013 Findings for College of Southern Idaho.
Mountain View College Spring 2008 CCSSE Results Community College Survey of Student Engagement 2008 Findings.
Jennifer P. Hodges, Ph.D. Bucking the Trend: Balancing Work, Family, Commuting, and Academics.
MPI Mission Perception Inventory Institutional Characteristics and Student Perception of Mission: What Makes a Difference? Ellen Boylan, Ph.D. ● Marywood.
NAVIGATING THE PROCESS OF STUDENT LEARNING OUTCOMES: DEVELOPMENT, EVALUATION, AND IMPROVEMENT Shannon M. Sexton, Julia M. Williams, & Timothy Chow Rose-Hulman.
The WASL : What do Our 10th Graders Think about It? Washington Educational Research Association 22nd Annual Washington State Assessment Conference December,
IDEA Student Ratings of Instruction Shelley A. Chapman, PhD Insight Improvement Impact ® University of Alabama Birmingham September 11, 2012.
EFFECTIVE COMMUNICATION How to Use Emotional Intelligence to Effectively Communicate in the Workplace Dr. Martin Armstrong, CPP, MBA, DBA.
Effective Communication Some Practical Strategies for Understanding Others and Making Sure They Understand You 1,2 A Presentation for the SOMC Physician.
© 2015 Jenzabar, Inc. Increase Your Prediction Accuracy and Achieve Maximum Student Success Paul Gore Xavier University Burt Rubenstein.
Community Business Leaders of Tomorrow Kyle Merten Jeanie Long “Leading towards a better tomorrow.”
Organizational Behavior Professor Rhonda Shannon
{ Principal Leadership Evaluation. The VAL-ED Vision… The construction of valid, reliable, unbiased, accurate, and useful reporting of results Summative.
Research Participation Program (RPP). For students: – An opportunity to experience primary research in psychology, organizational behavior, economics,
How did our school get involved? Iowa Sustaining Parent Involvement Network i S P I N.
Dr. Marsha Fralick. What is CollegeScope? Interactive online curriculum for a college success course Integrated career and learning style assessment Increased.
OCTOBER ED DIRECTOR PROFESSIONAL DEVELOPMENT 10/1/14 POWERFUL & PURPOSEFUL FEEDBACK.
Learn how to Think Like a Patron Dr. Ann Feldmann, Iowa City Community School District Ken DeSieghardt, Patron Insight, Inc.
 Shelley A. Chapman, PhD Texas A & M University February 2013.
INACOL Standard D: CLEAR EXPECTATIONS PROMPT RESPONSES REGULAR FEEDBACK.
Session 4 Reliability and Validity. Validity What does the instrument measure and How well does it measure what it is supposed to measure? Is there enough.
English 95, Read Right 2 credits per session Welcome to English 95.
Assessment Information from multiple sources that describes a student’s level of achievement Used to make educational decisions about students Gives feedback.
PLC Team Leader Meeting
Building Exams Dennis Duncan University of Georgia.
STEM Center Math and Technology STEMstitute – June 26, 2013 Presented by the Clermont County Gifted Program Fay Wagner, Gifted Intervention Specialist.
Welcome to MT302 Organizational Behavior Professor Rhonda Shannon Unit 2 Seminar – Individual Behavior, Diversity, Attitudes & Job Satisfaction This seminar.
DON’T REINVENT THE WHEEL: INFORMING OUTCOMES ASSESSMENT WITH EXISTING SURVEY DATA Holly Hoffman, Ph.D. Research Analyst University of San Diego.
Center for Learning Outcomes Assessment – Bayh College of Education – Indiana State University – Terre Haute, Indiana.
Welcome to MT302 Organizational Behavior Professor Rhonda Shannon Unit 2 Seminar – Individual Behavior, Diversity, Attitudes & Job Satisfaction This seminar.
Challenges of Quantitative Reasoning Assessment Donna L. Sundre Center for Assessment and Research Studies
CCSSE 2014 Findings Southern Crescent Technical College.
Intro to Public Speaking Bellwork: Write your own definition of public speaking. Objectives: List the 3 main.
Syllabus for SPE 523 Dr. Karin Dyke January 13, 2010.
Entry-Level Health Educator.  Great differences existed in professional preparation programs  1978 Initial Bethesda Conference  Development of a.
Henderson College ‘Your child Matters’ School Improvement Supported by Independent Schools Victoria -National Partnerships Model.
LEARNING GOALS AND PERFORMANCE SCALES PLC FOCUS FOR BVS
ACUI/EBI Assessments Users’ Meeting. Educational Benchmarking, Inc. Number of National Assessments for Higher Education: 65 Number of Colleges/Universities:
Leaping Ahead: 4-H Public Speaking Life Skills Evaluation Report by Ben Silliman, Youth Development Specialist.
Title I Annual Meeting What Every Family Needs to Know!
Deepening Student Impact Via Instructional Practice Data Joe Schroeder, PhD Associate Executive Director, AWSA.
Christopher Jacobson Frederick Community College Cindy Nicodemus Howard Community College.
Melanie Taylor Horizon Research, Inc.
Will Barratt, Ph.D. Indiana State University ACPA 2010, March 22, 2010
THE JOURNEY TO BECOMING
A Portrait of Today’s College Student
Standards and Assessment Alternatives
Addressing the challenges of preceptor development and recruitment
Reading Between the Pixels
EDUC 2130 Quiz #10 W. Huitt.
Session 5 – Where do we go from here
Presentation transcript:

Center for Learning Outcomes Assessment Indiana State University, Terre Haute, IN The University Learning Outcomes Assessment (UniLOA) Measuring the “rest” of student growth, learning, and development Center for Learning Outcomes Assessment, Inc.

What is the UniLOA? The University Learning Outcomes Assessment is a highly valid and reliable instrument designed to measure student behaviors consistent with desirable student learning outcomes Center for Learning Outcomes Assessment, Inc.

Properties of the UniLOA 70 behavior-specific items 30 Demographics questions Administered either on paper or in electronic format Additional, locally-added questions permitted 20 minutes average completion time required Center for Learning Outcomes Assessment, Inc.

Behavioral Domains Measured Critical Thinking Self-awareness Communication Diversity Citizenship Membership and Leadership Relationships Center for Learning Outcomes Assessment, Inc.

Question Sample with Response Options (Cognitive trigger with a behavioral stem) I use good skills in confronting others. For example I share my observations of another person in a constructive and non- threatening way to influence changes in their behavior Don’t tell us what you think we want to hear, tell us what you really do. Never – A B C D E F G H I J – Always Center for Learning Outcomes Assessment, Inc.

Report Format - Domains UniLOA Domain Scores Center for Learning Outcomes Assessment, Inc. Critical ThinkingSelf-AwarenessCommunicationDiversityCitizenshipMembership and Leadership Relationships Means Means

Report Format - Items UniLOA Sample Item Scores Center for Learning Outcomes Assessment, Inc. Item National Mean National Mean My presentations in classes are concise, precise, and persuasive. For example, they are always within the time limit and don’t wander off the point and I typically get an A on my presentations I list my personal goals for a class or activity. For example, I list my learning goals for a class beyond the learning outcomes listed in the syllabus, as well as my goal for a grade I make sure that when I am talking with someone I change my communication style to be consistent with their world view. For example, when speaking to someone who is devoutly religious I take that into account when I speak with them I act on the values of diversity and social justice. For example, I work with an organization or with my church to help others

What does the UniLOA Tell Us - Diagnosis - How students at an institution or organization score in comparison to the “average” student nationwide Specific behaviors students are engaging at an appropriate level* Specific behaviors students are failing to engage at an appropriate level* *appropriate levels are determined by the institution consistent with their articulated desired student learning outcomes Center for Learning Outcomes Assessment, Inc.

Within Group Comparisons Exemplar vs. Institutional Averages Center for Learning Outcomes Assessment, Inc. Student Exemplar National Average Number of Hours Studying per Week Number of Hours Watching Television or Engaging in Online Entertainment per week 2 or less6.95 Cumulative Grade Point Average Number of Organizational memberships31.78 Number of Leadership Positions Held2.71 Number of Volunteer Hours per Week42.39

What does the UniLOA Tell Us - Prescription - What areas are in need of institutional level attention to increase desirable student behaviors What specific behaviors can be targeted through the development of intentional supports, services, interventions, and programs designed to increase positive behaviors How can appropriate allocation of resources (attention, time, money) be made to maximize return on investment What will be the anticipated outcomes in terms of enrollment, persistence, retention and graduation as a result of improved supports, services, interventions, and programs Center for Learning Outcomes Assessment, Inc.

For More Information Please contact us at: Mark Frederick, Ph.D. Will Barratt, Ph.D. Center for Learning Outcomes Assessment, Inc.