COM 535, S08 Designing and Conducting Formative Evaluations April 7, 2008.

Slides:



Advertisements
Similar presentations
By: Edith Leticia Cerda
Advertisements

Team 6 Lesson 3 Gary J Brumbelow Matt DeMonbrun Elias Lopez Rita Martin.
SEM A – Marketing Information Management
What is the ADDIE Model? By San Juanita Alanis. The ADDIE model is a systematic instructional design model consisting of five phases: –Analysis –Design.
Composed Portraits OTEC Spring 2010 Michael Childers - John Coney Jean Javellana - Myla Gumayagay.
Summative Evaluation The Evaluation after implementation.
Effective Implementation Formative and Summative Project Evaluation.
Survey Design Steps in Conducting a survey.  There are two basic steps for conducting a survey  Design and Planning  Data Collection.
Evaluation is a professional and ethical responsibility and is a core part of PHN professional practice Commitment to evaluation helps build the PHN intelligence.
Midterm Review Evaluation & Research Concepts Proposals & Research Design Measurement Sampling Survey methods.
Formative and Summative Evaluations
Digital Library Resources Instructional Design (5100:631) Dr. Savery April 27, 2010.
Dr. Pratibha Gupta Associate professor Deptt. of Community Medicine ELMC & H, Lucknow.
Designing and Developing Interactive Multimedia EDCI 663 Educational Technology Purdue University.
Curriculum Development Center (CDC) Curriculum Development Process Continue.
Literacy Textual: The ability to read and write Oral: The ability to listen and speak Visual: The ability to interpret visual messages accurately and.
Instructional Design Dr. Lam TECM 5180.
Measuring Learning Outcomes Evaluation
The ADDIE Model The ADDIE Model Instructional Design Brenda Galvan.
AnalyseDesignDevelopImplementEvaluate ADDIE - Model.
Instructional System Design
ASSESSMENT Formative, Summative, and Performance-Based
Revising instructional materials
Questionnaires and Interviews
Instructional Design Brian Newberry. Instructional Design Instructional Design is a systematic process for the creation of educational resources.
Instructional System Design
Welcome to EDTL1720 – Instructional Design School of Education Facilitator: Debra Ferdinand,PhD May
10/08/05Slide 1 Instructional Systems Design in Distance Education Goal: This lesson will discuss Instructional Systems Design as it relates to distance.
Instructional Design Hany Alzahri. Instructional Design Instructional Design is a systematic process that is well designed in order to improve the education.
1 QIM 501- INSTRUCTIONAL DESIGN AND DELIVERY Dick & Carey Instructional Design Module Prepared by :- Omar Abdullah M. Al-Maktari PQM0025/08 Lecturer :-
A Model for EAP Training Development Zhiyun Zhang IDE 632 — Instructional Design & Development II Instructor : Dr. Gerald S. Edmonds.
Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
Understanding Meaning and Importance of Competency Based Assessment
Title of Training Module Design Plan
Developing Structured Activity Tools. Aligning assessment methods and tools Often used where real work evidence not available / observable Method: Structured.
© E. Kowch iD Instructional Design Evaluation, Assessment & Design: A Discussion (EDER 673 L.91 ) From Calgary With Asst. Professor Eugene G. Kowch.
Cleo Sgouropoulou * Educational Technology & Didactics of Informatics Educational Technology & Didactics of Informatics Instructional.
What is design? Blueprints of the instructional experience Outlining how to reach the instructional goals determined during the Analysis phase The outputs.
By: Catherine Mendoza. Evaluate Implement Develop Analyze Design.
1 Evaluating the Quality of the e-Learning Experience in Higher Education Anne Jelfs and Keir Thorpe, Institute of Educational Technology (IET), The Open.
Research Design and Instrument Development
“We will lead the nation in improving student achievement.” CLASS Keys TM Module 4: Professional Growth Plan Spring 2010 Teacher and Leader Quality Education.
Developing an Effective Evaluation to Check for Understanding Part 2 Susan E. Schultz, Ph.D. Evaluation Consultant PARK Teachers.
The Curriculum Development Process Dr. M
The Online Academy Evaluation Plan. Need for Evaluation 1.Inform and direct current and future development 2.Examine the usability of the checklist 1.
Program Evaluation Making sure instruction works..
Instructional Design Ryan Glidden. Instructional Design The process of planning, creating, and developing instructional or educational resources.
Data Driven Planning and Decision-making for Continuous School Improvement: Developing a Program Evaluation Plan Leadership for Innovative Omani Schools.
Barry Williams1 Designing & Conducting Formative Evaluation Dick & Carey Chp. 10.
Writing Instructional Objectives Dr. Belal Hijji, RN, PhD October 18, 2011.
Instructional Design Course Evaluation Phase. Agenda The Evaluation Process Expert Review Small Group Review The Pilot Feedback and Revision Evaluation.
Conducting a Needs Analysis
Providing Evidence Based Feedback to Improve Student Work Presented by: Kelly Philbeck
CEIT 225 Instructional Design Prof. Dr. Kürşat Çağıltay
Design Evaluation Overview Introduction Model for Interface Design Evaluation Types of Evaluation –Conceptual Design –Usability –Learning Outcome.
COM 535, S08 Writing Performance Objectives February 20, 2008.
School – Based Assessment – Framework
ADDIE & ASSURE Jasper (Jia) Pan Oct
Risk Analysis of Autonomous Cars in Mixed Traffic Streams
Levels of learning in the psychomotor Domain An introduction to the assessment of Learning in the Psychomotor and Affective Domains.
DEVELOPING TEACHING SKILLS IN PE (GED3043)
Instructional Design Models
پرسشنامه کارگاه.
Survey Design Steps in Conducting a survey
Adjunct Training – August 2016 | Jason Anderson
Designing & Conducting Formative Evaluation
Prepared by : Sereen alsabi Dareen alzubaidi.
The FIDGE Model – ANALYSIS Phase
Evaluation Research Defined as the process of making judgments about the merits, value, or worth of any component of education. (e.g. best text books to.
Presentation transcript:

COM 535, S08 Designing and Conducting Formative Evaluations April 7, 2008

COM 535, S08 How to Think About Formative Evaluations (FEs) FEs DO NOT… Evaluate learners’ ability to achieve performance objectives. Evaluate instructor delivery methods. Present a replica of what instruction will actually be like. FEs DO… Evaluate instructional materials. Generate feedback on methods of learner participation. Evaluate assessment instruments. Provide data that can shape instructional revision.

COM 535, S08 Phases (and Audiences) of Formative Evaluations Phases of FEs 1.One-to-One (clinical) evaluations 2.Small-Group evaluations (8-20 learners) 3.Field Trial (real- world testing) FE Audiences Subject Matter Experts (SMEs) Learners

COM 535, S08 Developing FE Tools Useful to frame FE tools using the instructional strategy developed in Phase 2. Pre-Instructional Activities Content Presentation/Examples Learner Participation Assessment Follow-through Activities Different audiences (i.e., SMEs, learners) require different tools

COM 535, S08 Focusing FEs for SMEs When developing criteria for SMEs to assess materials, consider: 1.Accuracy: Is the information/process/theory accurate? 2.Emphasis: Does the information emphasize the right components of the process? 3.Audience: Will the pretest measurements collect the necessary information we need about learners?

COM 535, S08 Focusing FEs for Learners When developing criteria for learners to assess materials, consider: 1.Clarity: Is the message/content clear to target learners? 2.Impact: What is the impact of the instruction on the learners’ attitudes? 3.Feasibility: How feasible is the instruction given the available resources?

COM 535, S08 FE Data Collection Measures The following research tools can be used to collect data: Interview (collected by designer) Observations (collected by designer and/or manager/supervisor) Sample Tests (completed by users) User questionnaire (completed by users) Others?

COM 535, S08 Managing the FE Process 1.Identify and contact users who will be tested. 2.Identify major issues/components of instruction that you’d like feedback on. 3.Construct FE tools to use with SMEs and learners. 4.Conduct FE. 5.Review results for areas of similarities and differences. 6.Revise ID based on FE feedback.

COM 535, S08 FOR WEDNESDAY Create one sample data collection tool that you plan to use with either your SME/learners.