Herding Cats: The Initial Roundup

Slides:



Advertisements
Similar presentations
Eli Collins-Brown, Ed.D. Illinois State University July 12, 2006 Aspects of Online Courses That Are More Effective and Successful than Traditional, Face-to-Face.
Advertisements

© 2008 Brigham Young University–Idaho. © 2010 Brigham Young University–Idaho COURSE LEAD RESPONSIBILITIES TRAINING Feb. 7,
Training Kirkpatrick’s Four Levels of Evaluation Kelly Arthur Richard Gage-Little Dale Munson Evaluation Strategies for Instructional Designers.
Evaluating the Quality of Online Programs Diane Ruiz Cairns, Ed.S. Lawrence Technological University eLearning Services.
Supporting Quality of Student Learning Online: Using Quality Matters to Strengthen Online Teaching and Learning Valencia College - Orlando, Florida Charles.
Coordinator of Assessment Coordinate assessment efforts on campus Maintain the NCCC General Education Assessment Plan Collect assessment results from course.
“Any Time, Any Where” Faculty and Curriculum Development: Using Asynchronous Learning Tools Beyond the Classroom Cathy Dwyer and Constance Knapp Information.
Peer-to-Peer Development with Media-Rich Faculty Case Studies Gail Matthews-DeNatale, Ph.D. Associate Director, Academic Technology Elizabeth Santiago,
A Mathematics Specialist Program: Its Structure and Impact on Practicing Elementary Teachers Nadine Bezuk & Susan Nickerson.
Distanced Professional Education to Support Instructional Technology: A Cost Effective Necessity Shawn M. Cressler December 2012.
Open Educational Resources (OER): their role in faculty development Lynn Johnson, PhD The University of Michigan USA.
 Jennifer Azzaro & Jon Townsend SJDC Professional Development Center.
The Role of Assessment in the EdD – The USC Approach.
1 Partnership in Allied Health Nini Cardoza Terri Maddux Sierra College.
Custom Faculty Development: Reach Faculty Where They Live Linda A. Leake, M. Ed. Instructional Designer/Blackboard Support Specialist University of Louisville.
Communities of Practice and Innovation An Overview.
Management of the School Library Media Center
Empowering practitioners through reflection: the key to successful professional development Associate Professor Jenny Sim Programme Director Medical Imaging.
Learning and Teaching at The University of Bradford.
Implementation and Delivery of AMS Online Ocean Studies at the Community College Level.
Marian University is a small liberal arts college located in Fond du Lac, Wisconsin. “Our vision of ‘transforming lives through academic excellence, innovation,
Krystal Rodriguez EDC 594.  We represent the university commitment to providing an exciting live and learning environment.  Residence Life Staff: 
Oregon’s Future Starts Here Superintendents’ vision for turning our good schools into great schools.
Background Information Audience Response Systems (ARS) are a technology used in classrooms that consist of an input device controlled by the learner, a.
Review Characteristics This review protocol was prospectively registered with BEME (see flow diagram). Total number of participants involved in the included.
Professional Development: Finding the Keys to Unlocking the Door to School Improvement Catherine Stickney February 26, 2011.
Faculty Development Models
Overarching CIE Mission To develop a comprehensive system for the professional development of the instructional workforce in pedagogy and best practices.
By: Frank J. Ball Sr. – James Sheridon Ochoa – Jason Oxley – Justin Hefner.
Learning from Engineering Disaster Gary Halada Stony Brook University Keywords: Ethics, values, authenticity, failure analysis,
THE USE OF QUALITY MATTERS™ AND THE INSTRUCTIONAL DESIGN PROCESS Presented by Meridith Bergeron, M.Ed. Director of Educational Technology Our Lady of the.
Students who graduate college should be prepared with the knowledge and skills necessary to succeed in their selected profession. One necessary skill is.
Quality Online Preparation: Qualities of Faculty, Courses, and Preparation Programs By Dr. Erin O’Brien Valencia College League of Innovation Conference,
Carin Chuang, Assoc. Professor of Computer Information Technology
Student engagement in quality: an introduction for staff
“Excuse Me Sir, Here’s Your Change”
Essential Attributes of Faculty Professional Development: The Excellence in Online Education Initiative Carol McQuiggan, D.Ed. Senior Instructional Designer,
The Assessment Process: A Continuous Cycle
Presenter: E. John Shinsky, Ph.D. Grand Valley State University
The Learning Practitioner: A performance in five acts
Student Learning Outcomes (SLOs) Module #4: SLO Annual Report
Madalina Tincu, Ed. D. Mitchell Strauss, Ed. D.
Using Streaming Videos and Blogs in Web-Enhanced Pharmacology
UMBC’S ALTERNATE DELIVERY PROGRAM: SUPPORTING HYBRID COURSE REDESIGN
December 5, 2016 c&I Board committee
Major Conceptual Frameworks
How Does Student Engagement in QM Courses
No Instructional Designer! Now What?
Melissa Kaufman, MS – Instructional Designer
Designing Professional Development for Elementary School Teachers
Herding Cats: The Initial Roundup
Taia L.C. Reid, Assistant Director of the Peer Educator Program
EDUCAUSE 2001 Mid-Atlantic Conference
BEST PRACTICES IN LIBRARY INSTRUCTION FORUM November 7, 2007
Providing Customized Training on Quality Online Design and Delivery
SPIRIT OF HR.in TRAINING EVALUATION.
الجــودة الشاملة في مؤسسات التعليم العالي
Peer Mentoring for Online Course Development
John Symons, Department of Philosophy
Faculty Perspectives on the Gold Review
Running with the COLT Course to Maintain Quality Across the Board
Aspects of Online Courses That Are More Effective and Successful Than Face-to-Face Courses Eli Collins-Brown, Ed. D. Methodist College of Nursing.
Pedagogical Practice, Shift, and Professional Growth in Online Courses
Developing Online Discussion Forums to Promote Higher-Order Thinking
Doctoral Students as Co-Teachers in Graduate Courses: An Application of Apprenticeships in Graduate Education Katherine McKee, Agricultural & Extension.
Overcoming Roadblocks to QM Adoption
Evaluating Diversity Programs
Leadership and Engaging Stakeholders November 3, 2015 Micheline Besner
Quality Matters How USFSP leads the way in online course excellence Nelson Poynter Library.
Quality Assurance in Blended Learning Standards and Rubrics
Presentation transcript:

Herding Cats: The Initial Roundup Debbie Beaudry Joy McDonald Academic Technology Services

Context Rutgers University Rutgers University-Newark Three campuses 65,000 students and 9,000 faculty members Four learning management systems Rutgers University-Newark 12,000 students and 585 faculty members Blackboard learning management system

Classes in Blackboard Spring 2014 Face-to-face: 1,430 Hybrid: 15 Online: 30

Quality Matters at Rutgers Adopted in spring 2013 Some units developing course with QM focus No courses have been through the formal QM review process

Designing Quality Online Courses (DQOC) Goals Build a shell course based on selected QM standards Experience online course as a student Model QM-based course design Format Nine weeks Completely online Offered through Blackboard

Pair & Share What types of faculty development programs for QM… Do you have? Would you like to have?

Start Here

Nine Modules

Module content

How to Videos

How to Measure Effectiveness of PD? Calls for more rigorous evaluation of professional development in higher education. Brooks, Marsh, Wilcox, & Cohen, 2011 Kucsera & Svinicki, 2010 Existing models suggested measuring program’s impact at a series of levels Guskey, 2000 Kirkpatrick, 1994

Quality Transformation Faculty Development Assessment Framework (Ragan & McQuiggan, 2014) Step 1: Participation metrics Step 2: Faculty input & satisfaction metrics Step 3: Attitude and knowledge metrics Step 4: Instructor performance metrics Step 5: Student performance Step 6: Return on investment metrics

How do you measure the effectiveness of your professional development? Pair & Share How do you measure the effectiveness of your professional development?

DQOC Participants Numbers Study participant status Ten course participants Nine study participants Seven reported part of stipend program Study participant status Full time faculty = 43% Part-time faculty = 43% Graduate assistant = 14%

Online Experience Teaching Learning 57% never taught completely online 43% taught hybrid course 14% taught a course that was completely online Learning 43% took a completely online course 43% took a hybrid course 29% never took an online course before

Analysis of Data Compared course to 82-point protocol Tallied 43 possible points

Results by Stipend Status

Results by Completed vs. Not Completed

Pair & Share What pieces of this course/evaluation method can you apply to your setting?

References Brooks, D. Christopher, Marsh, L., Wilcox, K., & Cohen, B. (2011). Beyond satisfaction: Toward an outcomes-based, procedural model of faculty development program evaluation, Journal of Faculty Development, 25(3), 5-12. Guskey, T.R. (2000). Evaluating professional development. Thousand Oaks, CA: Corwin Press. Kirkpatrick, D. L. (1994). Evaluating Training Programs: The Four Levels. San Francisco: Berrett-Koehler. Kucsera, J., & Svinicki, M. (2010). Rigorous evaluations of faculty development programs. Journal of Faculty Development, 24(2), 5-18. Ragan, L.C. & McQuiggan, C.A. (2014) A model for determining the effectiveness and impact of faculty professional development. In K. Shattuck (Ed.), Assuring quality in online education (pp. 91-109). Sterling, VA: Stylus Publishing.