Dr. Marcia Cassidy presents … USING PRE- and POST-TESTS : - Characteristics and Cautions.

Slides:

Advertisements

Similar presentations

Training. Training & Development Definition “The systematic acquisition of attitudes, concepts, knowledge, roles, or skills, that result in improved performance.

Advertisements

Formulating The Method

RESEARCH METHODS Lecture 24

Summative Evaluation The Evaluation after implementation.

Research Design and Validity Threats

Seven Steps in Designing the eWriting Learning Objects (LOs) eWriting: ESL Writing Success September 2002 – August 2005 ESL/Foreign Languages Department.

Expert Appraisal. Types of Expert Appraisal Some modifications of the instructional material are based on the developer’s hindsight; Most should be based.

Assessment and Evaluation Considerations in Distance Education.

The Survey as an Assessment Method: Why, when and how surveys provide evidence to inform decision-making Carrie Towns, Office of Institutional Research.

Diana Chan, HKUST Enhancing Learning Experiences in Higher Education: International Conference 2 -3 December 2010.

Lesson Thirteen Standardized Test. Yuan 2 Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized.

Course Content Introduction to the Research Process

Chapter 9 Experimental Research Gay, Mills, and Airasian

Proposal Writing.

Experimental Design The Gold Standard?.

I want to test a wound treatment or educational program but I have no funding or resources, How do I do it? Implementing & evaluating wound research conducted.

The fundamentals of caring for you, your family and your child with mental illness Paul Deal, Ph.D. Missouri State University.

Chapter 10 Questionnaire Design Chapter Objectives explain why it is important for managers or business researchers to know how to design good questionnaires.

Teaching and Learning Plymouth Church. MATH DATA TEAMS MODEL.

Ch 6 Validity of Instrument

I want to test a wound treatment or educational program in my clinical setting with patient groups that are convenient or that already exist, How do I.

Deborah Gentry, Instructional Development Center Randi Sutter, Library 14 th Annual Illinois Community College Assessment Fair.

Measuring Changes in Teachers’ Mathematics Content Knowledge Dr. Amy Germuth Compass Consulting Group, LLC.

Sharps Injuries in the Operating Room Amanda M. Gust, MPH Raymond C. Sinclair, PhD Pat Hickey, RN, BSN, MS, CNOR Alice Weiss, RN Carmen Garcia, RN National.

PLAN AND ORGANISE ASSESSMENT. By the end of this session, you will have an understanding of what is assessment, competency based assessment, assessment.

McLendon and Polis1 An Administrator’s Guide to Assessment: A Menu of Assessment Options for MAERS and Instructional Guidance.

Elizabeth Godfrey 1.  Periodic assessment of results Appropriateness, effectiveness, efficiency, impact, sustainability  Identifies intended and unintended.

1 An Introduction to Language Testing Fundamentals of Language Testing Fundamentals of Language Testing Dr Abbas Mousavi American Public University.

The Genetics Concept Assessment: a new concept inventory for genetics Michelle K. Smith, William B. Wood, and Jennifer K. Knight Science Education Initiative.

Evaluating a Research Report

A. Parichart W. A. Chulamani C..  To describe how to design the questionnaire; introduction, question order, layout, and question length.  To explain.

Evaluating HRD Programs

Chapter Four Experimental & Quasi-experimental Designs.

Student Growth Measures in Teacher Evaluation Using Data to Inform Growth Targets and Submitting Your SLO 1.

1 Experimental Research Cause + Effect Manipulation Control.

Language Tests for Social Cohesion and Citizenship Issues of Quality Assurance An Outline for Policy Makers and Test Developers Henk Kuijper ALTE Authoring.

SURVEY RESEARCH.  Purposes and general principles Survey research as a general approach for collecting descriptive data Surveys as data collection methods.

Outlining the Average Journal Article: A Quick Look at the Sections Taken from Cantor A Guide to Academic Writing with additions Jennifer L. Bowie.

USING MUSIC TO SUPPORT LEARNING How Can the Use of Music as a Teaching Tool Support and Enhance Learning and Improve Learning Outcomes ? Millicent Howard.

Experimental Research & Understanding Statistics.

Assessment of Information Literacy Presented by Touro College Libraries Sara Tabaei, Information Literacy Director Bashe Simon, Director of Touro Libraries.

Evaluating Impacts of MSP Grants Ellen Bobronnikov Hilary Rhodes January 11, 2010 Common Issues and Recommendations.

Chapter 10 Experimental Research Gay, Mills, and Airasian 10th Edition

Ch 9 Internal and External Validity. Validity  The quality of the instruments used in the research study  Will the reader believe what they are readying.

Chapter 8 – Lecture 6. Hypothesis Question Initial Idea (0ften Vague) Initial ObservationsSearch Existing Lit. Statement of the problem Operational definition.

10 Questionnaire Design. Role of Questionnaire Survey research, by definition, relies on the use of a questionnaire. A questionnaire is a set of questions.

Nonexperimental and Quasi- Experimental Designs Distinction is the degree of control over internal validity.

Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.

Adult Education Assessment Policy Effective July 1 st, 2011.

UbD - Stage 2 Assessment Evidence. Our Big Idea Making Best Practices, Common Practice *create a variety of assessments, to be used throughout the lesson,

Chapter Nine Primary Data Collection: Experimentation and

Quantitative research Meeting 7. Research method is the most concrete and specific part of the proposal.

PREPARATION OF QUESTIONNAIRES PREPARATION OF QUESTIONNAIRES Chapter - 4 Dr. BALAMURUGAN MUTHURAMAN

Principles of Instructional Design Assessment Recap Checkpoint Questions Prerequisite Skill Analysis.

Table of Contents  Research Design  Threats to Internal Validity  Threats to External Validity  Proposed Data  Pre-Test Post-Test Data Results 

Jack B. Monpas-Huber, Ph.D. Director of Assessment and Student Information How Do We Know When They’ve Learned It? Guidance for Development of Common Assessments.

Mock Action Research Proposal Presentation Nena Williams Ashford University May 14, 2015.

Evaluation Structure. 2| Evaluation – A Multi-layered Approach All AHEC awardees are conducting pre and post tests as well as focus groups with an external.

Evaluation and Assessment Evaluation is a broad term which involves the systematic way of gathering reliable and relevant information for the purpose.

Types of test Test Types Based on Its Purposes. Placement Test The purpose is this test to place a student according to his/her language ability within.

SAMPLING BY Dr. Ali K. Al-mesrawi. Definition of sampling Sampling is the process by which inference is made to the whole by examining a part. Sampling.

Lesson Thirteen Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test.

Formulation of the Research Methods A. Selecting the Appropriate Design B. Selecting the Subjects C. Selecting Measurement Methods & Techniques D. Selecting.

Writing Effective Learning Outcomes Joe McVeigh Jenny Bixby TESOL New Orleans, Louisiana, USA March 19, 2011.

Chapter Eight: Quantitative Methods

Greg Miller Iowa State University

Experimental Research

Hypothesis Testing, Validity &

Presentation transcript:

Dr. Marcia Cassidy presents … USING PRE- and POST-TESTS : - Characteristics and Cautions

PRE-TEST **=too much; !=enough; ?=not a clue Rate the extent to which you know… What a pre-test is**!? What a post-test is**!? Why they are used**!? What the characteristics of these tests are What cautions exist when using these tests How to write pre- and post-tests

Definitions Pre-test : instrument to measure “starting points” or pre-existing knowledge

Definitions POST-TEST : instrument that measures learning that has taken place as a result of “treatment” (instruction).

Visual Plan Learning Activities Pretest Post-test Grant Design/Implementation Learning Object

Purposes To evaluate the extent to which the lesson objectives (as specified in grant proposal) have been attained To demonstrate that learning has occurred as a result of the activities contained within the learning object To gather information to refine grant design/implementation issues

Measure of Appropriateness Same respondents Quantitative or “selection-type” items Concrete way to show desired results Convenient, manageable

Cautions (disclaimers) Factors not controlled for: -age & other demographics -common extent/length of exposure -reading proficiency (esp.piloting phase) -”testing” literacy (bias, etc..) -”learning/interaction” time (“pilot” phase)

Characteristics Shared format ( emphasis, language ) Comparable level of difficulty Acceptable level of validity (Does it measure targeted ob?) Similar length Measures discrete items (limited “production”) (EX: Level 4, LO#9)

POST-TEST **=too much; !=enough; ?=not a clue Rate the extent to which you know… What a pre-test is**!? What a post-test is**!? Why they are used**!? What the characteristics of these tests are What cautions exist when using these tests How to write pre- and post-tests