Barry Williams1 Designing & Conducting Formative Evaluation Dick & Carey Chp. 10.

Slides:



Advertisements
Similar presentations
Ed-D 420 Inclusion of Exceptional Learners. CAT time Learner-Centered - Learner-centered techniques focus on strategies and approaches to improve learning.
Advertisements

By: Edith Leticia Cerda
Developing and writing learning objectives
Assessment Adapted from text Effective Teaching Methods Research-Based Practices by Gary D. Borich and How to Differentiate Instruction in Mixed Ability.
Session 3 The evidence should be credible & helpful. Implications: the assessments should – ◦ Be grounded in real-world applications, supplemented as.
What is the ADDIE Model? By San Juanita Alanis. The ADDIE model is a systematic instructional design model consisting of five phases: –Analysis –Design.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Instructional Design JMA 503. Overview and Purpose Courseware evaluation DB connectivity Menu, etc. Morae.
The ADDIE Model By: Elva Juarez LEARNING THEORIES.
Overall Layout of Curriculum Development System in Organization of Educational Research and Programming.
Summative Evaluation The Evaluation after implementation.
Effective Implementation Formative and Summative Project Evaluation.
Formative and Summative Evaluations
Grade 12 Subject Specific Ministry Training Sessions
Literacy Textual: The ability to read and write Oral: The ability to listen and speak Visual: The ability to interpret visual messages accurately and.
Barry Williams1 Developing an Instructional Strategy Dick & Carey 8.
Barry Williams1 Writing Objectives Dick & Carey Chp. 6.
Barry Williams1 Welcome to Training and Development 518 Barry Williams Ph.D. Fall Semester Mondays 6 - 8:30 P.M.
Instructional Design Aeman Alabuod. Instructional Design instructional Design (also called Instructional Systems Design (ISD)) is the practice of creating.
Developing Evaluation Instruments
Instructional System Design
Revising instructional materials
Conduct Instructional Analysis Identify Instructional Goal(s) Analyze Learners & Contexts Write Performance Objectives Develop Assessment Instruments Develop.
LISA HOLMES INSTRUCTIONAL DESIGN. The process of creating an effective learning experience that takes into consideration: what needs to be learned what.
Instructional Design Diana Fisher. Instructional Design Instructional Design (ID) is a dynamic process with constant movement back and forth between steps.
Instructional Design Rafael Ruvalcaba.
Instructional Design Eman Almasruhi.
Instructional Design Aldo Prado. Instructional Design Instructional design is the process of easing the acquisition of knowledge and making it more efficient.
Instructional System Design
Instructional Design Gayle Henry. Instructional Design Instructional Design is creating experiences for the learner where how they learn is achieved in.
“… Nothing anyone says will do any more than inspire you. You must internalize procedures to do a better job. To do this, you must try them out and receive.
10/08/05Slide 1 Instructional Systems Design in Distance Education Goal: This lesson will discuss Instructional Systems Design as it relates to distance.
Instructional Design Hany Alzahri. Instructional Design Instructional Design is a systematic process that is well designed in order to improve the education.
Barry Williams1 Analyzing Learners & Context Dick & Carey, Chp. 5.
Standards-Based Science Instruction. Ohio’s Science Cognitive Demands Science is more than a body of knowledge. It must not be misperceived as lists of.
Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI
Let’s review questions on pgs. 6-8 in the workbook.
Preparing Pre-Service Educators in Assessment Edward Roeber MSU.
 Read through problems  Identify problems you think your team has the capacity and interest to solve  Prioritize the problems and indicate the.
What is design? Blueprints of the instructional experience Outlining how to reach the instructional goals determined during the Analysis phase The outputs.
Leading (and Assessing) a Learning Intervention IMPACT Lunch and Learn Session August 6, 2014 Facilitated By Ozgur Ekmekci, EdD Interim Chair, Department.
Developing Assessment Instruments
Assessment. Workshop Outline Testing and assessment Why assess? Types of tests Types of assessment Some assessment task types Backwash Qualities of a.
1 TESL Evaluating CALL Packages:Curriculum/Pedagogical/Lingui stics Dr. Henry Tao GUO Office: B 418.
The Value in Formative Assessment Prepared By: Jen Ramos.
Copyright © 2014 by Educational Testing Service. All rights reserved. Influencing Education: Implementing Online Reporting Systems to Support Assessment.
Assessing Learners The Teaching Center Department of Pediatrics UNC School of Medicine The Teaching Center.
Assessment Ice breaker. Ice breaker. My most favorite part of the course was …. My most favorite part of the course was …. Introduction Introduction How.
UbD - Stage 2 Assessment Evidence. Our Big Idea Making Best Practices, Common Practice *create a variety of assessments, to be used throughout the lesson,
The Instructional Design Process
Barry Williams1 Assessing Needs to Identify Instructional Goal(s) Chapter 2: Dick & Carey.
Instructional Design Course Evaluation Phase. Agenda The Evaluation Process Expert Review Small Group Review The Pilot Feedback and Revision Evaluation.
 Teaching: Chapter 14. Assessments provide feedback about students’ learning as it is occurring and evaluates students’ learning after instruction has.
Dick & Carey Instructional Design Model Sabri Elamin ED 6615.
CEIT 225 Instructional Design Prof. Dr. Kürşat Çağıltay
COM 535, S08 Designing and Conducting Formative Evaluations April 7, 2008.
Welcome! These slides are designed to help you think through presenting your evaluation planning and results. Feel free to pick and choose the slides that.
Copyright © Springer Publishing Company, LLC. All Rights Reserved. BECOMING A SCHOLAR IN NURSING EDUCATION – Chapter 16 –
Quality Assurance processes
School – Based Assessment – Framework
MATERIALS ASSESSMENT AND TEACHING
Test Design & Construction
Chapter 14 Assembling, Administering, and Appraising classroom tests and assessments.
Instructional Design Gibran Carter.
Instructional Design Models
Diagnostic Essay Feedback Analysis
Reliability and Validity Illustrated
Matthew McCullagh Linking the Principles of Assessment to the QA Criteria.
Chapter 4 Instructional Media and Technologies for Learning
Designing & Conducting Formative Evaluation
Presentation transcript:

Barry Williams1 Designing & Conducting Formative Evaluation Dick & Carey Chp. 10

Barry Williams2 Formative Evaluation - Why? To determine Weakness(es) in the Instruction To determine Weakness(es) in the Instruction

Barry Williams3 Weaknesses Teachers/Trainers are not good predictors of the effectiveness of instructional content (Rosen, 1986, Rothkipf, 1963) Instructional Theory is not a perfect science Few instructional products are ever evaluated with learners Designer can’t see the forest for the trees

Barry Williams4 Formative Evaluation Has Six Stages Design Review Expert Review One-To-One Small Group Field Trials Ongoing Evaluation

Barry Williams5 Design Reviews (Ask these questions) Does the instructional goal match the problem identified in the needs assessment? Does the learner & environmental analysis match the audience? Does the task analysis include all the prerequisite skills? Are the test items reliable and valid, and do they match the objectives?

Barry Williams6 Expert Review Is the content accurate & up-to-date? Does it present a consistent perspective? Are examples, practice exercises, & feedback realistic & accurate? Is the pedagogy consistent with current instructional theory? Is the instruction appropriate to the audience?

Barry Williams7 One-On-One Review Is the message clear? What is the impact on: –learner attitudes –achievement of objectives & goals Feasibility of training

Barry Williams8 Small Group Review Look for the effects caused by the changes made in the one-to-one review Identify any remaining learning problems

Barry Williams9 Field Trials (Review) Look for effects in changes made in small group Can the instruction be used in the context in which it was intended

Barry Williams10 Ongoing Evaluation Viewed through the Lens of: Project Size Life span of content Audiences change One-To-One Small Group Tryouts Field Trials

Barry Williams11 Learner Evaluation “Testing” Do learners understand the instruction? Do they know what to do during the practice & the tests? Can they interpret graphics in the text? Can they read all the material? How much time does it take?

Barry Williams12 Chpt. Summary Formative Evaluation is critical Complete as many stages as practical Don’t depend on SME’s opinion Document your evaluation