CA12 Assessing Online Courses Howard University November 2013.

Slides:



Advertisements
Similar presentations
Quality Matters Building a Quality Online Course.
Advertisements

Assessing the Quality of Online Courses Rayane Fayed Instructional Designer American University of Beirut June 2013.
Troy University eTROY Colloquium April 17-18, 2012.
What is it? What is it? Quality Matters (QM) is a nationally recognized, faculty- centered, peer review process designed to certify the quality of online.
A Quality Matters “Quickie”
Jennifer Strickland, PhD,
Quality Matters! Using the Quality Matters Rubric to Improve Online Course Design Susan Bussmann and Sandy Johnson NMSU Quality Matters Institutional.
Using the Quality Matters Rubric to Improve Online Course Design
Distance Education Faculty Technology Workshop Teaching and Learning Technologies Best Practices in the development of quality online courses.
► Why regular and effective student contact matters. ► Definition of regular and effective student contact. ► How to achieve regular and effective student.
Designing Instructionally Sound Courses Kristina Leonardo, Senior Consultant Blackboard, Inc. April 14, 2005.
E-Learning Center Deanship of Academic Development.
Quality Matters TM : Introduction to QM and to the Rubric The Quality Matters™ Rubric 2008 – 2010 Edition Updated July 08.
Supporting Quality of Student Learning Online: Using Quality Matters to Strengthen Online Teaching and Learning Valencia College - Orlando, Florida Charles.
Introducing the Quality Matters Continuing Education Rubric
Quality Matters TM Professional Development and Certifications ©MarylandOnline, Inc All rights reserved.
What are the necessary ingredients?. Necessary Ingredients Design Considerations Design Considerations –Planning the media depends on lifestyle, lifestyle,
Quality Matters : Inter-Institutional Quality Assurance in Online Learning Teaching with New Technologies May 2007.
Managing an Online Course Personal Philosophy of Josh Eastwood.
Blackboard 201 Communication Workshop Barbara Cooper. OCC Faculty Online Coordinator.
Blackboard Course Design and Quality Matters
Blackboard Strategies: Using Blackboard Pedagogically.
The New Teaching Institute Program Evaluation Report Lin Chengyan Eric Whitmer Anastasia Kalmykova.
School’s Cool in Kindergarten for the Kindergarten Teacher School’s Cool Makes a Difference!
Instructional Planning If you build it, will they learn?
MCCWDTA Sharing Blended Learning Strategies Barbara Treacy January 15, 2014 Massachusetts Community Colleges and Workforce Development Transformation Agenda.
Center for Distributed Learning Nancy Swenson Accessing Higher Ground November 2014.
Finding the Good Fit: Faculty Members, Instruction, Evidence, and Technology Patricia A. McGee, PhD Associate Professor/2003 NLII.
Using Technology to Enhance Instruction. Educational Technologies Blackboard, Content- Based Tools Distribution Tools Communicatio n Tools Presentatio.
Q&A Anytime, any place, any pace learning in TAFEVC and Moodle Mary Schooneveldt And you.
Learners’ Attitudes and Perceptions of Online Instruction Presented by: Dr. Karen S. Ivers Dr. JoAnn Carter-Wells Dr. Joyce Lee California State University.
The IR Role in Subscriber Managed Course Reviews QM Institution Representative Training © MarylandOnline, Inc., All rights reserved.
GSU Online Degree and Certificate Programs Preparation for North Central Association Accreditation Visit.
Teaching in a Web-Based Distance Learning Environment: An Evaluation Summary Based on Four Courses Charles Graham, Joni M. Craner, Byung-ro Lim, & Kursat.
CA12 Assessing Online Courses Howard University Spring 2015.
Dakota State University.
Formative Peer Review at Ocean County College. Guiding Principle “Ideally, the peer review of teaching is a critically reflective and collaborative process.
Preparing Students for an Online Learning Community Designing an Effective Online Orientation November 9, 2001.
Overview of a Recommended Course Development Process.
Instructional Strategies Teacher Knowledge, Understanding, and Abilities The online teacher knows and understands the techniques and applications of online.
Literacy instruction: Connecting to online faculty and students Dr. Marilyn Harhai, Department of Library Science Mary Buchanan, University Libraries Clarion.
Virtually Indistinguishable: Keeping Course integrity while changing to an online format Jenny C. Wells, Ph.D. and Drue E. Narkon, Ph.D. University of.
Quality Matters Jennifer Strickland, PhD,
MCCWDTA Sharing Blended Learning Strategies Barbara Treacy January 15, 2014 Massachusetts Community Colleges and Workforce Development Transformation Agenda.
Information Literacy Instruction Sessions in Online Classes Dr. Marilyn Harhai, Department of Library Science Mary Buchanan, University Libraries Clarion.
Online Quality Course Design vs. Quality Teaching:
Pilot’s Log: Getting Our Professional Development Course QM Recognized
Online / Hybrid Workshop: Course Design, Development, and Delivery
The Academic Technology Center
Set Sail on a Three-Course Tour: Three examples of a QM Reviewed Course Krista MacDonald Doña Anna Community College Sharon Lalla New Mexico State University.
Objectives Discuss aligning learning activities to stated learning objectives within a course, and brainstorm various approaches to meeting Standard 5.1.
Harvesting the Benefits of QM Culture for Institutional Accreditation
OTL Meets QM: Getting Started in an Online Course
No Instructional Designer! Now What?
Melissa Kaufman, MS – Instructional Designer
Mid-Atlantic Regional Conference
It’s Not Just Course Design… It’s EPIC
Professional Development
Proficient Level Training Workshop
Tools for Infusing QM Standards into the Course Development Process
Developing Faculty to Teach Online
Professor Lindsay Henning Program Director,
Trying to get the Horse in Front of the Buggy
Aspects of Online Courses That Are More Effective and Successful Than Face-to-Face Courses Eli Collins-Brown, Ed. D. Methodist College of Nursing.
Katherine M. Hitchcock, Ph.D. Michelle Franz
Aligning QM Standards with Higher Education Accreditation Hallmarks
Aligning QM Standards with Higher Education Accreditation Hallmarks
Quality Matters How USFSP leads the way in online course excellence Nelson Poynter Library.
Quality Matters Overview
Presentation transcript:

CA12 Assessing Online Courses Howard University November 2013

Workshop Objectives Upon completing this workshop, you will be able to do the following: 1.Explain how the assessment of online courses differs from that of face-to-face courses. 2.List the benefits of assessing online courses. 3.Access an online course on Blackboard. 4.Assess the design of an online course, using the Quality Matters rubric. 5.Assess course delivery in an online course. 6.Introduce colleagues to CETLA’s resources for online teaching.

Workshop Resources CETLA’s DL Assessment Webpage

Definitions F2F (face-to-face) Hybrid* (30-79% online and reduced classroom time) DL(80-100% online) Online (Hybrid* and DL) How many of you have taught an online course? How many of you have taught with Blackboard? *aka “Blended”

Why Assess Online Courses? Reaccreditation Better Student Learning Better Teaching

How Does Assessment Differ for F2F vs. Online Courses? F2F Students – Student evaluations – Student performance Peers – Review of course materials – Classroom observation Administrators + Implementation of policies Online Students – Student evaluations (online with additional questions)additional questions – Student performance Peers – Review of course materials – Course site visit Administrators + Implementation of policies, including HU Distance Ed PolicyHU Distance Ed Policy

Why Should Peer Reviewers Visit the Coursesite? The syllabus alone cannot reveal enough about the course design and delivery. Poor course design or delivery can lead to high student attrition rates and low student achievement. Careful peer reviews of coursesites help faculty improve their online courses.

Who Should Visit the Course? IDEALLY A team of three reviewers All experienced QM- certified online instructors One Master Reviewer One subject-matter expert (SME) One external reviewer REALISTICALLY A team of three reviewers At least one DL-certified online instructor ? At least one subject-matter expert (SME) ? Note: Visitors should request background information from the instructor (see the QM Instructor’s Worksheet) prior to the visit.

How Can You Visit a Course? Ask the instructor to add you as a student. Ask the instructor to make all assignments and tests available—password- protected if necessary. Log into om. om If you can’t log in, contact ETS’s Blackboard System Administrator, Umesh Giri

What Affects the Quality of Online Courses? Technology Administrative infrastructure Faculty training Student readiness Course content Course design Course delivery

Why Is Assessing Course Design So Important in an Online Course? “When learners can’t find what they need or are confused about where to go and what to do, it is harder for them to learn. Being an online learner is challenging enough without these additional barriers. Plus, frustrated learners tend to either drop out or drive the instructor crazy….” Patti Shank Watch this video:

How Can You Assess Course Design? Use the Quality Matters (QM) rubric! Based on research, best practices, and instructional design principles Aligned with national standards (e.g., Sloan Consortium Pillars) Aligned with accreditation standards for distance- learning (e.g., Middle States) Consistent with HU Provost’s syllabus guidelines

What Is the QM Rubric? Rubric Standards Annotated Rubric

How Do You Rate a Course? If at least two reviewers agree that a course meets a standard, award full points. If at least two reviewers agree that a course does not meet a standard, do not award any points. A course must meet all 3-point standards. The instructor may make minor changes during the review. An effective course will earn 81 of the 95 points (85%).

Standard 1.1 “Instructions make clear how to get started and where to find various course components.” 0 points 3 points

Standard 5.2 “Learning activities provide opportunities for interaction that support active learning.” 0 points 3 points

Standard 6.3 “Navigation throughout the online components of the course is logical, consistent, and efficient.” 0 points 3 points

Why Is Assessing Course Delivery So Important in an Online Course? Watch this video:

How Can You Assess Course Delivery? Ask the instructor to generate two Blackboard course reports: – “Overall Summary of User Activity” for all students – “Overall Summary of User Activity” for the instructor Visit the coursesite.

What Should You Look for in the Site? What to Assess* 1.Social Presence & Availability 2.Instructor Feedback 3.Student Retention What to Check 1.Announcements, Contacts, Syllabus 2.Discussion Board and other social media (but no access to Grade Center) 3.Course activity report (especially statistics for Early Warning System, Performance Dashboard, and day-by-day student “hits”) © The Learning House, 2013

What Should You Look for in the Site? What to Assess* 4. Instructor Forum (or Chatroom) Participation 5. Communication of University and/or Course Policies 6. Pacing What to Check 4. Discussion Board and/or Chatroom (“Collaboration”) 5. Syllabus, Announcements, and Content Areas 6. Announcements, Content Areas, and External Links (or “Resources”) © The Learning House, 2013

What DL resources does CETLA offer? Faculty can upload CETLA’s template to facilitate course development and assessment.CETLA’s template Faculty can earn Blackboard certification via seven workshops, one three-day seminar, a previous certificate, or a demo.Blackboard certification Faculty can earn DL certification via a 5-day online seminar, a certificate, or a demo.DL certification Faculty can find other resources on CETLA’s Distance-Learning Resource webpage. Distance-Learning Resource