Quality Matters : Inter-Institutional Quality Assurance in Online Learning Teaching with New Technologies May 2007.

Slides:



Advertisements
Similar presentations
Quality Matters Building a Quality Online Course.
Advertisements

Troy University eTROY Colloquium April 17-18, 2012.
Course Selected Institutions decide to examine an online or hybrid course as part of a peer review. Since institutions make a significant investment in.
What is it? What is it? Quality Matters (QM) is a nationally recognized, faculty- centered, peer review process designed to certify the quality of online.
A GUIDE TO CREATING QUALITY ONLINE LEARNING DOING DISTANCE EDUCATION WELL.
A Quality Matters “Quickie”
The Quality Matters Rubric ® ©MarylandOnline, Inc All rights reserved.
Institutional Policy & Quality Matters Standards: The impact of policy on course quality Deb Adair, QM Director Sloan-C Conference November 9-11, 2011.
Jennifer Strickland, PhD,
Quality Matters! Using the Quality Matters Rubric to Improve Online Course Design Susan Bussmann and Sandy Johnson NMSU Quality Matters Institutional.
Using the Quality Matters Rubric to Improve Online Course Design
Applying the QM Rubric August 2008
Quality Bucks Inter-Collegiate Quality Assurance in Online Learning.
Defining and Implementing Quality Assurance Standards for Online Courses Lawrence C. Ragan, Director, Instructional Design/Development, The Pennsylvania.
Quality Matters TM : Introduction to QM and to the Rubric The Quality Matters™ Rubric 2008 – 2010 Edition Updated July 08.
Supporting Quality of Student Learning Online: Using Quality Matters to Strengthen Online Teaching and Learning Valencia College - Orlando, Florida Charles.
Introducing the Quality Matters Continuing Education Rubric
Quality Matters TM Professional Development and Certifications ©MarylandOnline, Inc All rights reserved.
Quality Assurance Initiative. What is it anyway? The Quality Assurance (QA) Initiative is a faculty-centered, peer review process designed to assess the.
1 Quality Matters: A FIPSE project for Peer Course Review A Grant Initiative of MarylandOnline Sponsored by the U.S. Department.
Online Course Quality and Peer Review Adapted from Maryland Online FIPSE Project “QUALITY MATTERS” Inter-Institutional Quality Assurance in Online Learning.
Online Course Observation. Objectives: 1.Articulate the steps of an online faculty observation 2.Explain the elements of the GRCC Online Course Observation.
Quality Matters: Inter-Institutional Quality Assurance in Online Learning A Grant Initiative of MarylandOnline Sponsored by the U.S. Dept. Education Fund.
Design and Development Awards Spring 2015 TLOS Networked Learning Design and Strategies (NLDS)
Quality Matters and Online Courses in Sakai Brian Dashew, Instructional Designer, Marist College Dr. Reba-Anna Lee, Assistant Director for Academic Technology.
Welcome to NROC An Introduction to the The National Repository of Online Courses Featuring NROC Courses and the NROC Network Module 1.
HOW TO DESIGN A SIMPLE ONLINE COURSE April 28, 2009 ED 641 STEPHEN CHESKIEWICZ, MS.ED AND IMPROVE STUDENT SUCCESS.
CA12 Assessing Online Courses Howard University November 2013.
Comparing Cookies to Courses Best Practice Session at Detroit Lakes Based on Quality Matters Project Resources from the Maryland Online Consortium Deborah.
Finding the Good Fit: Faculty Members, Instruction, Evidence, and Technology Patricia A. McGee, PhD Associate Professor/2003 NLII.
GUIDELINES ON CRITERIA AND STANDARDS FOR PROGRAM ACCREDITATION (AREA 1, 2, 3 AND 8)
Peer Reviewer Training(f2f) Quality Matters : Inter-Institutional Quality Assurance in Online Learning Updated January 2007 Proposed for use by all QM.
The IR Role in Subscriber Managed Course Reviews QM Institution Representative Training © MarylandOnline, Inc., All rights reserved.
Introduction to Quality Matters ™ Inter-Institutional Quality Assurance in Online Learning © MarylandOnline, Inc., All rights reserved.
March 26-28, 2013 SINGAPORE CDIO Asian Regional Meeting and Workshop on Engineering Education and Policies for Regional Leaders Programme Evaluation (CDIO.
Asst. Prof. Thapanee Thammetar, Ph.D. Director of Thailand Cyber Univ. Quality Assurance, e-Learning content development and operation ASEAN-ROK Session.
CA12 Assessing Online Courses Howard University Spring 2015.
Pedagogical Standards and Sustainable Distance Education Programming Karen Gersten Associate Provost for Academic Programs and Faculty Development Laura.
Averett University November 5, 2012 Presenter: Barbara Jacoby, Ph.D.
Dances with Faculty: Empowering Success in the Online Environment Lawrence C. Ragan, Ph.D. & Marilynne Stout, Ph.D. Penn State’s World Campus.
QM for MOOCs: Results of QM Reviews of Gates Foundation-Funded MOOCs 5th Annual QM Conference October 1-4, 2013 Nashville, TN Deb Adair, QM Managing Director.
Using NROC Content Getting Started with NROC Course Content Syllabi, Media Lessons, Assignments, Assessments, Instructor Guides and more… Module 3, Part.
30/10/2006 University Leaders Meeting 1 Student Assessment: A Mandatory Requirement For Accreditation Dr. Salwa El-Magoli Chair-Person National Quality.
Quality Matters Jennifer Strickland, PhD,
Tips on Discussing the Standards & Giving Peer Feedback February 2010.
Mapping Your Online Course Susie Bussmann, Ph.D. & Sandy Johnson, M.A. & M.S.
Success in the Online Environment Lawrence C. Ragan, Ph.D., Penn State’s World Campus Mount St. Vincent University April 12th 2005.
Through the Looking Glass: Examining QM through Different Lenses in the Development of an Online EMBA. Presenters: Dr. Karen Donovan Ms. Cindy Hart & Dr.
Online Quality Course Design vs. Quality Teaching:
Colorado Community Colleges Online
Pilot’s Log: Getting Our Professional Development Course QM Recognized
Implementing QM towards Program Certification
Essential Attributes of Faculty Professional Development: The Excellence in Online Education Initiative Carol McQuiggan, D.Ed. Senior Instructional Designer,
The Academic Technology Center
Set Sail on a Three-Course Tour: Three examples of a QM Reviewed Course Krista MacDonald Doña Anna Community College Sharon Lalla New Mexico State University.
A community of learners improving our world
Harvesting the Benefits of QM Culture for Institutional Accreditation
Online Teaching Conference
(c) 2011 MarylandOnline, Inc.
SESSION FIVE: TIPS FOR IMPLEMENTATION AND EVALUATION
Tools for Infusing QM Standards into the Course Development Process
Providing Customized Training on Quality Online Design and Delivery
Leveraging Instructional Design Teams
Assessing Academic Programs at IPFW
PRESENTATION TITLE Faculty Enhancement and Instructional Development (FEID) Proposal Support Sharon Seidman, Ph.D. (HHD) and Erica Bowers, Ed.D. (Director,
Trying to get the Horse in Front of the Buggy
Aligning QM Standards with Higher Education Accreditation Hallmarks
Aligning QM Standards with Higher Education Accreditation Hallmarks
Quality Matters Overview
Presentation transcript:

Quality Matters : Inter-Institutional Quality Assurance in Online Learning Teaching with New Technologies May 2007

Session Goals Provide an overview of the critical materials, processes, and administrative elements of the Quality Matters online course quality assurance program. Describe the Peer Course Review process. Explore lessons learned in creating a quality assurance program and applications of the QM process.

About Quality Matters

Peer Course Review Feedback Course Course Meets Quality Expectations Course Revision Instructional Designers Institutions Faculty Course Developers National Standards & Research Literature Rubric Faculty Reviewers Training Quality Matters: Peer Course Review Process

Factors that Affect Course Quality

Factors Affecting Course Quality Course design QM REVIEWS THIS Course delivery (i.e. teaching, faculty performance) Course content Course management system Institutional infrastructure Faculty training and readiness Student engagement and readiness

Underlying Principles of QM The QM toolset and process are: –based in national standards of best practice, the research literature and instructional design principles –designed to promote student learning –part of a faculty-driven, peer review process Process designed to ensure all reviewed courses will eventually meet expectations Collegial review process, not an evaluation process

For Our Purposes, Quality Is… More than average; more than “good enough” An attempt to capture what’s expected in an effective online course at about an 85% level Based on research and widely accepted standards 85 %

QM Process Provides Institutional toolset and process to meet quality expectations: –Online course design –Student learning –Improved instruction –Assessment and feedback loops –Professional development

What’s In It For Institutions … External validation Strengthen accreditation package Raise QA as a priority activity Access to a sustainable, replicable, scalable QA process Inform online course training & practices Provide professional development activities

What’s In It For Faculty … Improve online courses External quality assurance Review other courses and gain new ideas for own course; expand professional community Participation useful for professional development plan and portfolio

What this process is NOT Not about an individual instructor (it’s about the course) Not about faculty evaluation (it’s about course quality) Not about “win/lose” or “pass/fail” (it’s about continuous improvement in a supportive environment)

Design vs. Delivery The faculty member is integral to both design and delivery. Course Design … is the forethought and planning that a faculty member puts into the course. Course Delivery … is the actual teaching of the course, the implementation of the design. QM is about DESIGN - not delivery or faculty performance

Quality Matters Toolset

The Instructor Worksheet Worksheet

Instructor Worksheet Includes info such as: –Institutionally mandated objectives, materials, practices, policies –Materials outside course pages –Types of interaction used & instructor’s statement on the appropriateness of interaction in the course –Additional items that may require review

The Rubric

Eight standards: –Course Overview and Introduction –Learning Objectives –Assessment and Measurement –Resources and Materials –Learner Interaction –Course Technology –Learner Support –Accessibility Key components must align.

What is Alignment? Critical course elements work together to ensure that students achieve the desired learning outcomes.

The Rubric Essential Standards (14) Essential Standards (14)

General Standard I: Course Overview and Introduction 1.1: Navigational instructions make the organization of the course easy to understand. 1.2:A statement introduces the student to the course and to the structure of the student learning, and, in the case of a hybrid course, clarifies the relationship between the face-to-face and online components.

General Standard II: Learning Objectives (Competencies) II.I: The course learning objectives describe outcomes that are measurable. II.2:The module/unit learning objectives describe outcomes that are measurable and consistent with the course-level objectives.

General Standard III: Assessment and Measurement III.1:The types of assessments selected measure the stated learning objectives and are consistent with course activities and resources. III.2:The course grading policy is stated clearly. III.3:Specific and descriptive criteria are provided for the evaluation of students’ work and participation.

General Standard IV: Resources and Materials IV.I:The instructional materials support the stated learning objectives. IV.2:The instructional materials have sufficient breadth, depth, and currency for the student to learn the subject.

General Standard V: Learner Interaction V.1:The learning activities promote the achievement of stated learning objectives. V.2:Learning activities foster instructor- student, content-student, and if appropriate to this course, student-student interaction. V.3:Clear standards are set for instructor response and availability (turn-around time for , grade posting, etc.)

General Standard VI: Course Technology VI.I:The tools and media support the learning objectives and are appropriately chosen to deliver the content of the course.

General Standard VII: Learner Support No 3-point elements This standard has no “essential” 3-point elements because it’s primarily concerned with academic support services, student support services and technical support services….usually thought to be the primary responsibility of the institution and not the individual instructor.

General Standard VIII: Accessibility VIII.1:The course acknowledges the importance of ADA requirements. To meet this standard, the course must include BOTH of these elements: The course must be offered using software that is accepted as “ADA compliant.”. AND The course should include a brief statement that clearly tells students how to access ADA services at the institution.

The Rubric Scoring Scoring

Rubric Scoring StandardsPointsRelative Value 143Essential 122Very Important 141Important TOTALS 4080 Team of three (3) reviewers One score per standard based on team majority Assigned point value; not sliding scale

To Meet Expectations… A course must achieve: “Yes” on all 14 of the 3-point “essential” standards. A minimum of 68 out of 80 points 68/80 = 85%

Online & Hybrid Courses Rubric designed for application to fully online and hybrid/blended courses Same set of standards apply to both How we achieve the standards may differ For hybrids, focus on pedagogical integration of online and F2F components

Recommendations

Peer Course Review Process

The Peer Review Team 3 faculty peer reviewers: –must be experienced online instructors –must attend QM training –one MUST be external to the course’s originating institution –there must be a subject matter expert (SME) on the team. NOTE: The SME could also be the external reviewer. AND Faculty course developer: –access to rubric prior to review –involved in pre-review discussions –consulted during review

About the Course QM is designed to review “mature” courses (taught at least two semesters) QM logo indicates year course met expectations Triggers for subsequent reviews: Faculty request More than 3 years since original review New textbook or instructor Professional or accreditation review pending

About the Review On average, a course review takes 7-10 hours; active review period approximately 3 weeks Factors affecting review time include Reviewer familiarity with the discipline Reviewer familiarity with the CMS Reviewer familiarity with the QM review process Organization of the course

Review Outcome If meets expectations: –Recognized by Quality Matters –Notifications distributed –ID support provided if requested If does not yet meet expectations: –ID support provided if requested –Team Chair and ID approve revisions –Course meets expectations

Roles and Responsibilities Faculty Developer Peer Reviewers Team Chair

QM To Date

QM in Transition 2003 – August 2006 –QM project funded by FIPSE grant money –materials and some services freely available August 2006 and beyond –QM project funded by MarylandOnline –Some limited materials will be freely available –Other materials available to individuals and institutions at nominal fees –Institutional membership affords full access to materials and services

QM to Date Overall Participation –Individuals & programs from 150 institutions across 30 states Course Reviews Peer Reviewer Rubric Training –900+ trained

Quality Matters Quality MattersApplications

Multiple Uses of QM Reported Uses of QM System: Guidelines for initial online course development Quality assurance of existing courses Ongoing faculty professional development Institutional reaccredidation packages Formation of distance learning policies & steering committees

Thanks to YOU… Thanks to YOU… Quality Matters!