Designing & Conducting Formative Evaluation

Slides:

Advertisements

Similar presentations

Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.

Advertisements

By: Edith Leticia Cerda

Developing and writing learning objectives

Session 3 The evidence should be credible & helpful. Implications: the assessments should – ◦ Be grounded in real-world applications, supplemented as.

Team 6 Lesson 3 Gary J Brumbelow Matt DeMonbrun Elias Lopez Rita Martin.

Course Design: The Basics Monica A. Devanas, Ph.D. Director, Faculty Development and Assessment Programs Center for Teaching Advancement and Assessment.

What is the ADDIE Model? By San Juanita Alanis. The ADDIE model is a systematic instructional design model consisting of five phases: –Analysis –Design.

General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.

Designs to Estimate Impacts of MSP Projects with Confidence. Ellen Bobronnikov March 29, 2010.

Assisting Peers to Provide W orthwhile Feedback UC Merced SATAL Program.

The ADDIE Model By: Elva Juarez LEARNING THEORIES.

Summative Evaluation The Evaluation after implementation.

Effective Implementation Formative and Summative Project Evaluation.

Instructional System Design.  The purpose of instructional design is to maximize the value of instruction for the learner especially the learner's time.

Formative and Summative Evaluations

Grade 12 Subject Specific Ministry Training Sessions

Literacy Textual: The ability to read and write Oral: The ability to listen and speak Visual: The ability to interpret visual messages accurately and.

 ADDIE Model Instructional Design Natalie Cavazos.

Unit 9: Program Evaluation CERT Program Manager. CERT Program Manager: Program Evaluation 9-2 CERT Program Manager: Program Evaluation Unit Objectives.

6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?

FORMATIVE EVALUATION Intermediate Injury Prevention Course August 23-26, 2011, Billings, MT.

Instructional System Design

The draft NSW English K-10 syllabus Version 2 February, 2012.

Revising instructional materials

1 DEVELOPING ASSESSMENT TOOLS FOR ESL Liz Davidson & Nadia Casarotto CMM General Studies and Further Education.

Instructional Design Eman Almasruhi.

Instructional Design Aldo Prado. Instructional Design Instructional design is the process of easing the acquisition of knowledge and making it more efficient.

Instructional System Design

Instructional Design Eyad Hakami. Instructional Design Instructional design is a systematic process by which educational materials are created, developed,

ADDIE Instructional Design Model

Instructional Design Hany Alzahri. Instructional Design Instructional Design is a systematic process that is well designed in order to improve the education.

Learner Validation One-to-One Evaluation Purpose identify gross problems in the instruction, such as typographical errors, unclear sentences, poor or missing.

Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI

Understanding Meaning and Importance of Competency Based Assessment

David Steer Department of Geosciences The University of Akron Learning objectives and assessments May 2013.

Session Objectives At the end of the session you should be able to:- Explain how learning theories such as Kolb and Blooms impact teaching practice Identify.

 Read through problems  Identify problems you think your team has the capacity and interest to solve  Prioritize the problems and indicate the.

Research Problem In one sentence, describe the problem that is the focus of your classroom research project about student learning: That students do not.

What is design? Blueprints of the instructional experience Outlining how to reach the instructional goals determined during the Analysis phase The outputs.

Leading (and Assessing) a Learning Intervention IMPACT Lunch and Learn Session August 6, 2014 Facilitated By Ozgur Ekmekci, EdD Interim Chair, Department.

By: Catherine Mendoza. Evaluate Implement Develop Analyze Design.

Learning to Read Sight words: Learning to read Student behavior: Manage student’s behavior an Important part to student learning.

Assessment. Workshop Outline Testing and assessment Why assess? Types of tests Types of assessment Some assessment task types Backwash Qualities of a.

Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.

Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.

Barry Williams1 Designing & Conducting Formative Evaluation Dick & Carey Chp. 10.

Instructional Design Course Evaluation Phase. Agenda The Evaluation Process Expert Review Small Group Review The Pilot Feedback and Revision Evaluation.

ASK STANDARDS Assessment and Accountability CNS 610 Written & Narrated by: Kelcie Dixon Western Kentucky University.

CEIT 225 Instructional Design Prof. Dr. Kürşat Çağıltay

COM 535, S08 Designing and Conducting Formative Evaluations April 7, 2008.

Student Learning Outcomes Assessment Montgomery College Fall 2011 Orientation.

Welcome! These slides are designed to help you think through presenting your evaluation planning and results. Feel free to pick and choose the slides that.

Copyright © Springer Publishing Company, LLC. All Rights Reserved. BECOMING A SCHOLAR IN NURSING EDUCATION – Chapter 16 –

Ways of doing Needs Assessment

Quality Assurance processes

School – Based Assessment – Framework

Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov March 23, 2011.

APPROACH TO INSTRUCTIONAL SYSTEM DESIGN

NEEDS ANALYSIS.

Training Trainers and Educators Unit 6 – Developing Aims and Learning Outcomes and Planning a Learning Session Aim To provide participants with the knowledge.

Evaluating a Task-based English Course: A Proposed Model

MATERIALS ASSESSMENT AND TEACHING

Instructional Design Gibran Carter.

Instructional Design Models

Classroom test and Assessment

Principles of Assessment & Criteria of good assessment

Matthew McCullagh Linking the Principles of Assessment to the QA Criteria.

Training Trainers and Educators Unit 6 – Developing Aims and Learning Outcomes and Planning a Learning Session Aim To provide participants with the knowledge.

TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1

Student Learning Outcomes Assessment

Presentation transcript:

Designing & Conducting Formative Evaluation Instructional Design : Unit ,6 Evaluation Phase

Objectives: Describe the purposes of the various stages of formative evaluation. Describe the instruments used in formative evaluation Collect data according to a formative evaluation plan for a given set of instructional strategy.

Formative Evaluation - Why? To determine Weakness(es) in the Instruction

Why are there Weaknesses? Teachers/Trainers are not good predictors of the effectiveness of instructional content (Rosen, 1986, Rothkipf, 1963) Instructional Theory is not a perfect science Few courses are evaluated with learners Designer can’t see the forest for the trees

Formative Evaluation Has Six Stages Design Review Expert Review One-To-One Small Group Field Trials Ongoing Evaluation

Design Reviews (Ask these 4 questions) Does the instructional goal match the problem identified in the needs assessment? Does the learner & environmental analysis match the audience? Does the task analysis include all the prerequisite skills? Are the test items reliable and valid, and do they match the objectives?

Expert Review (Ask these 5 questions) Is the content accurate & up-to-date? Does it present a consistent perspective? Are examples, practice exercises, & feedback realistic & accurate? Is the pedagogy consistent with current instructional theory? Is the instruction appropriate to the audience?

One-On-One Review to identify gross problems in the instruction, such as typographical errors, unclear sentences, poor or missing directions, etc. Is the message clear? What is the impact on: learner attitudes achievement of objectives & goals Feasibility of instruction and training

Small Group Review Look for the effects caused by the changes made in the one-to-one review Identify any remaining learning problems

Field Trials (Review) Look for effects in changes made in small group Can the instruction be used in the context in which it was intended

Ongoing Evaluation Viewed through the Lens of: Project Size Life span of content Audiences change One-To-One Small Group Tryouts Field Trials

Learner Evaluation “Testing” Do learners understand the instruction? Do they know what to do during the practice & the tests? Can they interpret graphics in the text? Can they read all the material? How much time does it take?

Session summary Formative Evaluation is critical Complete as many stages as practical Don’t depend on SME’s opinion Document your evaluation