Performance Samples Patricia L. Sitlington, Ph.D. University of Northern Iowa.

Slides:



Advertisements
Similar presentations
Program Evaluation: What is it?
Advertisements

Assessment Assessment should be an integral part of a unit of work and should support student learning. Assessment is the process of identifying, gathering.
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
Copyright © Questionmark Corporation and/or Questionmark Computing Limited, known collectively as Questionmark. All rights reserved. Questionmark.
Using the IDEA Student Ratings System: An Introduction University of Saint Thomas Fall
RESEARCH METHODS Lecture 24
Faith Maina Ph.D. (SUNY Oswego) Kefa Otiso Ph.D. (Bowling Green) Francis Koti Ph.D. (Northern Alabama)
Assessment/tests/measures Semantics??. “Definitions” n “Assessment” -- the gathering and integration of psychological-related data for the purpose of.
Job Analysis OS352 HRM Fisher January 31, Agenda Follow up on safety discussion Job analysis – foundation of HR – Purpose – Various techniques.
Causal-Comparative Research
Integrating Problem-Solving and Educational Software
Introduction: Psychological Assessment. Terms & Definitions Psychological Assessment The gathering and integrating of psychological data for psychological.
Classroom Assessment A Practical Guide for Educators by Craig A
MGT-555 PERFORMANCE AND CAREER MANAGEMENT
5.04 Discuss the Consumer Research Process. Consumer Research  Consumer research is used to gather information in order to know what consumers want and.
Conducting a Job Analysis to Establish the Examination Content Domain Patricia M. Muenzen Associate Director of Research Programs Professional Examination.
PhD Research Seminar Series: Writing the Method Section Dr. K. A. Korb University of Jos.
Research Tools and Techniques The Research Process: Step 6 (Research Design – Element 9 Data Collection Methods – Questionnaire Design) Lecture 19.
1 DEVELOPING ASSESSMENT TOOLS FOR ESL Liz Davidson & Nadia Casarotto CMM General Studies and Further Education.
Sophia Gatowski, Ph.D., Consultant National Council of Juvenile & Family Court Judges Sophia Gatowski, Ph.D., Consultant National Council of Juvenile &
PDHPE K-6 Using the syllabus for consistency of assessment © 2006 Curriculum K-12 Directorate, NSW Department of Education and Training.
Developing Business Practice –302LON Introduction to Business and Management Research Unit: 6 Knowledgecast: 2.
Assisting Students with Disabilities
Assessment 101 Center for Analytics, Research and Data (CARD) United Church of Christ.
ASSESSMENT OF STUDENT LEARNING Manal bait Gharim.
Lecture 8A Designing and Conducting Formative Evaluations English Study Program FKIP _ UNSRI
Classroom Assessment A Practical Guide for Educators by Craig A
Elizabeth Godfrey 1.  Periodic assessment of results Appropriateness, effectiveness, efficiency, impact, sustainability  Identifies intended and unintended.
Transition Assessment. IDEIA Requirements Non biased, reliable, valid Informal vs. formal –Good picture of the student across environments Assistive technology.
Comp 20 - Training & Instructional Design Unit 6 - Assessment This material was developed by Columbia University, funded by the Department of Health and.
Chapter 5 Job Analysis.
Rating Scales Patricia L. Sitlington, Ph.D. University of Northern Iowa.
Understanding Meaning and Importance of Competency Based Assessment
The Analysis of the quality of learning achievement of the students enrolled in Introduction to Programming with Visual Basic 2010 Present By Thitima Chuangchai.
Planning an Applied Research Project Chapter 3 – Conducting a Literature Review © 2014 by John Wiley & Sons, Inc. All rights reserved.
Exploring Evidence.
TRAINING & DEVELOPMENT Dr. Anil Mehta DEFINITION OF TRAINING “A PLANNED ACTIVITY TO MODIFY ATTITUDE, KNOWLEDGE OR SKILL THROUGH LEARNING EXPERIENCE TO.
“A Truthful Evaluation Of Yourself Gives Feedback For Growth and Success” Brenda Johnson Padgett Brenda Johnson Padgett.
Writing Lessons for Rigorous and Relevant Instruction Jim Miles Achieving Academic Excellence for All Students.
Assessment/tests/measures Semantics??. “Definitions” n “Assessment” -- the gathering and integration of psychological-related data for the purpose of.
EDUC 3004 Group A Team Members Jennifer Bateman Ralph Herrera III Reupena Lesa Lucas Paxton.
SIUC Instructor Workshop Introduction to Assessment and Evaluation.
EDUC 3004 Group A Team Members Jennifer Bateman Ralph Herrera III Reupena Lesa Lucas Paxton.
Assessment Ice breaker. Ice breaker. My most favorite part of the course was …. My most favorite part of the course was …. Introduction Introduction How.
Copyright © 2014 by The University of Kansas Data Collection: Designing an Observational System.
7/13/03Copyright Ed Lipinski and Mesa Community College, All rights reserved. 1 Research Methods Summer 2009 Using Survey Research.
The Kirkpatrick Model organizational change Richard Lambert, Ph.D.
Welcome! A-Team Session 4 Fall Overview for Today 1 Minute Message review Outcomes Feedback Methodology Review Assessment Steps  Sampling  Validity/Reliability.
M & E System for MI’s Training Program & Guidelines for MI’s Completion Report Presented by Monitoring and Evaluation Officer Mekong Institute January.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
APPROVED CLINICAL INSTRUCTOR WORKSHOP Evaluation.
Job Analysis (Session Four) Jayendra Rimal. What is Job Analysis & its Uses The procedure for determining the critical knowledge, abilities, skill and.
Chapter 29 Conducting Market Research. Objectives  Explain the steps in designing and conducting market research  Compare primary and secondary data.
Overview of Types of Measures Margaret Kasimatis, PhD VP for Academic Planning & Effectiveness.
Part Two.
Principles of Language Assessment
Classroom Assessment A Practical Guide for Educators by Craig A
ASSESSMENT OF STUDENT LEARNING
Scientific Method Foldable
Steps for development and evaluation of an instrument - Revision
پرسشنامه کارگاه.
Finding Answers through Data Collection
Chapter Eight: Quantitative Methods
Chapter 2 Performance Management Process
5 6 Selecting Employees C H A P T E R Training Employees
Job Analysis CHAPTER FOUR Screen graphics created by:
TESTING AND EVALUATION IN EDUCATION GA 3113 lecture 1
Identification of Job Roles and Functions
Chapter 3: How Standardized Test….
Presentation transcript:

Performance Samples Patricia L. Sitlington, Ph.D. University of Northern Iowa

Definition A performance sample is a structured learning and assessment activity involving tasks, materials, and tools that are identical or similar to those used in the actual living, learning, or working setting.

Examples of Performance Samples Washing Clothes Stripping and Refinishing Furniture Construction from Scale Drawing Changing Engine Oil and Filter Making a Cash Sale- Gift Shop Sales Clerk Taking a Food Order - Restaurant

Possible Data to be Collected from Performance Samples Interview from filled out by student noting Things he/she liked about the job Things he/she disliked about the job Tasks he/she did well Tasks with which he/she had problems If he/she would like to find out more about this job

Possible Data to be Collected from Performance Samples (Cont.) Quantitative Measures Data on each learning trial Time to complete Number of units correctly assembled Number of errors Quality scores

Possible Data to be Collected from Performance Samples (Cont.) Rating scale filled out by evaluator noting Student’s attention to task Student’s reaction to frustration Student’s attitude regarding the job Student’s following of instructions Student’s use of required tools

Possible Data to be Collected from Performance Samples (Cont.) Observational notes made by the evaluator How the student went about completing the tasks Student behaviors inappropriate to the situation Student behaviors that showed adaptability to this or similar task Comments that would be helpful in further work with the student

Steps in Developing a Performance Sample 1. Conduct a Survey of Living Tasks, Training Programs, or Jobs in the Community 2. Conduct Task, Program, or Job Analysis 3. Construct the Performance Sample 4. Establish Validity

Format for Self-Developed Performance Sample I. Introduction A. Title B. Description of Performance Sample Describe the purpose of the sample Provide a general overview of the sample

Format for Self-Developed Performance Sample (Cont.) C. List of Tasks Involved D. Living, Learning, or Working Tasks to Which Sample will Relate E. Argument for Content Validity of Performance Sample

Format for Self-Developed Performance Sample (Cont.) II. Instructions to Evaluator A. Prerequisite Skills Required Indicate the specific knowledge and skills (if any) the individual would need to possess before beginning the sample B. Detailed Description of Performance Sample Conditions Indicate the specific conditions (e.g. noise, heat) under which the sample should be administered C. Directions for Setup and Breakdown Provide specific directions so anyone could set up and break down the performance sample

Format for Self-Developed Performance Sample (Cont.) III. Administration A. Directions for the Individual Provide specific directions (exact wording) to be read to the individual B. Directions for the Evaluator for Instruction and Demonstration Provide specific directions for the evaluation in terms of instructing and demonstrating to the individual

Format for Self-Developed Performance Sample (Cont.) IV. Scoring and Interpreting the Information Gathered A. Overview of Types of Information to be Collected List the types of information to be collected, such as units correct, time to complete each task, observation of how the individual approached each task, work habits and attitudes,individual’s interest in the task, etc. B. Directions and Forms for Collecting Each Type of Information For each type of information listed in IV-A, include a form for collecting the information, and directions for completing this form.

Format for Self-Developed Performance Sample (Cont.) C. Insights into Comparing and Interpreting the Information Gathered D. Insights into Integrating the Information Gathered into the Overall Assessment and Transition Planning Process

Format for Self-Developed Performance Sample (Cont.) V. Construction of Performance Sample A. List of Materials Required for Administration Include a detailed list of material needed to construct and administer the sample B. Diagrams or Photographs Include anything that would help the evaluator construct and administer the sample C. Instructions for Assembly Provide any instructions needed VI. Additional Information (If Needed)

Determining Validity in Performance Samples Content Validity Extent to which the performance sample represents the content of the living, learning, or working situation Face Validity Extent to which the performance sample “looks like” the living, learning, or working situation