Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 7 Selecting, Administering,

Slides:



Advertisements
Similar presentations
Chapter 7 Legal and Ethical Concerns and Issues in Testing
Advertisements

Chapter 6 Process and Procedures of Testing
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 5 Reliability.
Defensible IEPs Douglas County School District 1 Module V: Documentation and Timelines.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 6 Validity.
An O*NET Academy Briefing Whole Person Assessment Using the O*NET Career Exploration Tools Presented by Dr. JanetWall Presented by Dr. Janet Wall Senior.
In Today’s Society Education = Testing Scores = Accountability Obviously, Students are held accountable, But also!  Teachers  School districts  States.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
1 QUANTITATIVE DESIGN AND ANALYSIS MARK 2048 Instructor: Armand Gervais
Designs to Estimate Impacts of MSP Projects with Confidence. Ellen Bobronnikov March 29, 2010.
Chapter 13 Survey Designs
Lesson Eight Standardized Test. Contents Components of a Standardized test Reasons for the Name “Standardized” Reasons for Using a Standardized Test Scaling.
Chapter 5 Instrument Selection, Administration, Scoring, and Communicating Results.
FOUNDATIONS OF NURSING RESEARCH Sixth Edition CHAPTER Copyright ©2012 by Pearson Education, Inc. All rights reserved. Foundations of Nursing Research,
Ed Cruz, Melissa Guzman, Nicole Murph, Gabriela Pelaez
Ethical and Legal Issues in Assessment
Chapter One: The Science of Psychology
Survey Designs EDUC 640- Dr. William M. Bauer
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 9 Assessment of Achievement.
The Multidisciplinary Team Testing Considerations, and Parental Participation in the Assessment Process Chapter Seven.
Copyright 2010, The World Bank Group. All Rights Reserved. Training the Enumerators and Collection of Data Part I.
Chapter 1 Assessment in Elementary and Secondary Classrooms
McGraw-Hill © 2006 The McGraw-Hill Companies, Inc. All rights reserved. The Nature of Research Chapter One.
School Counselors Doing Action Research Jay Carey and Carey Dimmitt Center for School Counseling Outcome Research UMass Amherst CT Guidance Leaders March.
Becoming a Teacher Ninth Edition
O*NET Ability Profiler™ Administrator Training ability profiler ™ Administrator Training Overhead Masters.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Classroom Assessment A Practical Guide for Educators by Craig A
Test Security and Special Populations. Test Security.
Evaluation of Nelson-Denny Reading Test Mini Project I By Becky Brandl.
Managing Marketing Information Chapter Learning Goals 1.Explain the importance of information to the company 2.Define the marketing information.
Evaluating a Research Report
Chapter 7 Selection Group 7 August 24, Employee Selection Selection is the process of choosing from a group of applicants those individuals best.
Understanding Meaning and Importance of Competency Based Assessment
Assessment in Education Patricia O’Sullivan Office of Educational Development UAMS.
Teaching Today: An Introduction to Education 8th edition
General Information Iowa Writing Assessment The Riverside Publishing Company, 1994 $39.00: 25 test booklets, 25 response sheets 40 minutes to plan, write.
ASSESMENT IN OPEN AND DISTANCE LEARNING Objectives: 1.To explain the characteristic of assessment in ODL 2.To identify the problem and solution of assessment.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 2 Fundamentals of Assessment.
Special Education Law for the General Education Administrator Charter Schools Institute Webinar October 24, 2012.
Chapter 1 Historical and Philosophical Foundations of Assessment
Observation and Assessment in Early Childhood Feel free to chat with each other. We will start class at 9:00 PM ET! Seminar Two: Using Standardized Tests.
Assessment and Testing
Assessing Learners with Special Needs: An Applied Approach, 6e © 2009 Pearson Education, Inc. All rights reserved. Chapter 5: Introduction to Norm- Referenced.
Fair and Appropriate Grading
Selection, Administration, Scoring, and Communicating Assessment Results Chapter 5.
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College Ability, Intelligence, Aptitude and Achievement Testing For Class #12 Copyright.
Alternative Assessment Chapter 8 David Goh. Factors Increasing Awareness and Development of Alternative Assessment Educational reform movement Goals 2000,
Technical Communication A Practical Approach Chapter 9: Technical Research William Sanborn Pfeiffer Kaye Adkins.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. English Language Learners Assessing.
Evaluation Requirements for MSP and Characteristics of Designs to Estimate Impacts with Confidence Ellen Bobronnikov February 16, 2011.
Appropriate Testing Administration
CE300-Observation and Assessment in Early Childhood Unit 2 Using Standardized Tests and Authentic Assessments Feel free to chat with each other. We will.
Chapter 3 Selection of Assessment Tools. Council of Exceptional Children’s Professional Standards All special educators should possess a common core of.
The Psychologist as Detective, 4e by Smith/Davis © 2007 Pearson Education Chapter One: The Science of Psychology.
Georgia Alternate Assessment The Importance of Portfolio Review Prior to Submission February 2011Dr. John D. Barge, State School Superintendent.
Assessment PS502 Dr. Lenz. When and why assessments are performed Pre-employment screenings Evaluation and placement of children in school programs Determination.
Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 16 Communicating Assessment.
Educational Research Chapter 8. Tools of Research Scales and instruments – measure complex characteristics such as intelligence and achievement Scales.
Alternative Assessment Larry D. Hensley University of Northern Iowa Chapter 8.
Ethics and the future of psychological testing. Almost any test can be useful in the right circumstances, but even the best test, when used inappropriately,
San Luis Valley Gifted Education Network Meeting October 17, 2013.
Copyright © 2009 Wolters Kluwer Health | Lippincott Williams & Wilkins Chapter 47 Critiquing Assessments.
BSB Biomanufacturing CHAPTER 4 GMP – Documentation Part I (SOP)
Classroom Assessments Checklists, Rating Scales, and Rubrics
Classroom Assessment A Practical Guide for Educators by Craig A
Classroom Assessments Checklists, Rating Scales, and Rubrics
Chapter 4 Standardized Tests.
Chapter 3: How Standardized Test….
Presentation transcript:

Assessment Procedures for Counselors and Helping Professionals, 7e © 2010 Pearson Education, Inc. All rights reserved. Chapter 7 Selecting, Administering, Scoring, and Interpreting Assessment Results

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-2 Selecting Assessment Instruments & Strategies 1. Identify the type of information needed 2. Identify available information 3. Determine the methods for obtaining information 4. Search assessment resources 5. Evaluate and select an assessment instrument or strategy

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-3 Identify the Type of Information Needed Any assessment instrument or strategy is useful only if it provides the information required for the assessment. Counselors determine what information to collect based on the purpose for assessment.

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-4 Identify Available Information Pre-existing assessment information about clients can include: intake questionnaires biographical data preliminary diagnoses school grades previous assessment results

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-5 Determine the Methods for Obtaining Information Counselors can choose from both formal and informal assessment instruments and strategies

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-6 Search Assessment Resources References sources Mental Measurement Yearbook Tests in Print Test Critiques Tests

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-7 Publisher catalogs provide important test information including: Cost of Materials and Scoring Types of Scoring Services While publisher catalogs are a valuable source of information, bias may exist. Catalogs should be used along with other sources of information. Test Publisher Catalogs

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-8 Test manuals are a primary source of information when selecting tests The Standards for Educational and Psychological Testing (1999) provides a list of key components that should be included in test manuals. Test Manuals

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved. 1-9 Academic journals dedicated to the exploration of testing and assessment can be valuable resources in test selection. Individual journal articles may explore the use of specific tests in various settings. Research Literature

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Professional Organizations American Educational Research Association Association for Assessment in Counseling & Education National Center for Research on Evaluation, Standards, and Student Testing (CRESST) National Council on Measurement in Education (NCME) American Counseling Association American Psychological Association

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Online test locator services can be valuable resources for selecting tests. Buros Institute ( Educational Testing Service ( Internet Resources

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Directories of Unpublished Instruments Directory of Unpublished Experimental Measures (2007) Measures for Psychological Assessment: A Guide to 3,000 Original Sources and Their Applications (1974)

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Evaluate and Select an Assessment Instrument or Strategy 1. What is the purpose of the instrument? Who is the intended population? 2. What sample of the population was used in instrument development, validation, and norming? 3. Are the results of the instrument reliable? 4. Do the instrument’s results have evidence of validity? 5. Does the instrument’s manual provide clear and detailed instructions about administration procedures? 6. Does the manual provide sufficient information about scoring, interpreting and reporting results? 7. Is the instrument biased?

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Evaluate and Select an Assessment Instrument or Strategy cont. 8. What level of competency is needed to use the instrument? Test User Qualifications A-level: no advanced training required B-level: master’s degree in counseling, psychology, education or related area, or have completed specialized training or expertise C-level: doctorate in psychology, education, or a related field, or licensure.

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Evaluate and Select an Assessment Instrument or Strategy cont. 9. What practical issues should be considered for this instrument? a. Time required for administering the instrument. b. Cost of the instrument c. Format d. Readability e. Ease of Administration f. Ease of Scoring g. Ease of Interpretation

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Modes of Administering Instruments: Self-Administered Individually Administered Group Administered Computer Administered Video Administered Audio Administered American Sign Language Nonverbal Administering Assessment Instruments

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Before Administration Counselor should be familiar with the instrument. Review manual, forms, other materials. Be familiar with the content of the instrument. Review directions for administering the instrument. For standardized tests: schedule date, room, facilities; obtain booklets, answer sheets, pencils, other materials Obtain informed consent from examinees Provide orientation for examinees

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved During Administration Final check of materials, lighting, ventilation, seating arrangements, work space, pencils, etc. For standardized instruments, follow administration procedures and deliver instructions verbatim. Establish rapport with client. Be alert to problems and client behaviors during administration.

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved After Administration Collect materials Count booklets and answer sheets Pack materials according to stated procedures Record any incidents.

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Scoring Assessment Instruments Hand-scoring Computer-scoring Sent to publisher for scoring Self-scored by client

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Scoring Performance Assessment Performance assessment: portfolios, projects, tasks, open-ended exercises. No clear-cut right or wrong answers. Scored using a scoring rubric.

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Scoring Errors Errors in Hand scoring: Assigning incorrect values to individual responses. Incorrectly recoding responses Incorrectly converting raw scores to standard scores Calculation errors Errors in Computer scoring: Inputting data incorrectly Incomplete erasures or stray marks (when using optical scanners)

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Interpreting Assessment Results Determine if score is norm-referenced or criterion-referenced. Explain the meaning of various standard scores and their implications to the test taker. Understand factors that can affect assessment interpretation: 1. Psychometric factors 2. Test taker factors 3. Contextual factors

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Interpreting Assessment Results cont. Computer-generated reports or narratives: Canned interpretations based on test results. May be very complex Not stand-alone interpretations: computers cannot incorporate uniqueness of the client Counselors ultimately accountable for accuracy of interpretations, even when using computer- generated reports.

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Consider any major differences between the norms or comparison groups and the actual test takers and any differences in test administration practices or familiarity with the specific questions on the tests. Avoid using a single test score as the sole determinant of decisions about test takers. Avoid using tests for purposes not specifically recommended by the test developer unless evidence is obtained to support an alternate use. Report test results accurately and clearly and in a manner than is understood by the test taker. Routinely review a sample of the test answer sheets to verify the accuracy of the initial scoring. Employ systematic procedures to verify the accuracy and consistency of computer scoring of answer sheets. Standards for Scoring and Interpreting Tests

Assessment Procedures for Counselors and Helping Professionals, 7e Drummond/Jones © 2010 Pearson Education, Inc. All rights reserved Obtain a separate and independent verification that appropriate scoring rules and normative conversions are used for each person tested. Verify as accurate the computation and conversion of raw scores and the conversion of raw scores to normative or descriptive scales prior to release of such information to the test taker or to users of the test results. Check routinely for accuracy of manual or computer reports of test results. The person performing this task must be qualified to recognize inappropriate or impossible scores. Develop and use systematic and objective procedures for observing and recording the conditions and behaviors of persons being tested and make this part of the scores or test results that are reported. Label clearly the scores that are reported and the date that a particular test was administered.