RATING SCALES By M. MUTHU SASI REKHA. SYNOPSIS  Introduction  Definitions  Rating  Principles of defining rating scale  Types of rating scales 

Slides:



Advertisements
Similar presentations
CHAPTER 10 PERFORMANCE MANAGEMENT AND FEEDBACK. 10–2 Performance Management and Feedback Organizations need broader performance measures to insure that:Organizations.
Advertisements

VALIDITY AND RELIABILITY
MGT-491 QUANTITATIVE ANALYSIS AND RESEARCH FOR MANAGEMENT
Ch. 5: Methods for Looking Within Ourselves
Collecting Data by Communication
CH. 9 MEASUREMENT: SCALING, RELIABILITY, VALIDITY
Assessment: Reliability, Validity, and Absence of bias
Research in Psychology Chapter Two
Appraising Performance You have to get ongoing constructive feedback to push you out of your comfort zone. —Kevin Sharer, CEO, Amgen Chapter 17 Copyright.
VALIDITY.
Research Methods in MIS: More on Measurement Scales Dr. Deepak Khazanchi.
Concept of Measurement
Performance Appraisal
© 2005 The McGraw-Hill Companies, Inc., All Rights Reserved. Chapter 8 Using Survey Research.
Performance Appraisals
Chapter 8 Appraising Employee Job Performance
9-1 Chapter Nine MEASUREMENT SCALES. 9-2 Scaling and Consideration What is Scaling? –Scaling is assigning numbers to indicants of the properties of objects.
Scaling and Attitude Measurement in Travel and Hospitality Research Research Methodologies CHAPTER 11.
Chapter 9 Flashcards. measurement method that uses uniform procedures to collect, score, interpret, and report numerical results; usually has norms and.
Chapter 7 Correlational Research Gay, Mills, and Airasian
Review Performance Management and Appraisal
8-1 McGraw-Hill/IrwinCopyright © 2009 by The McGraw-Hill Companies, Inc. All Rights Reserved. fundamentals of Human Resource Management 4 th edition by.
Performance Appraisal
Performance Appraisal
Revision Sampling error
Chapter 4 Performance Appraisal
PERFORMANCE APPRAISAL SYSTEM
Magister of Electrical Engineering Udayana University September 2011
SELECTION OF MEASUREMENT INSTRUMENTS Ê Administer a standardized instrument Ë Administer a self developed instrument Ì Record naturally available data.
Standardization and Test Development Nisrin Alqatarneh MSc. Occupational therapy.
Classroom Assessments Checklists, Rating Scales, and Rubrics
Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Chapter Performance Management and Appraisal 7.
Measuring Complex Achievement
8-1 McGraw-Hill/IrwinCopyright © 2011 by The McGraw-Hill Companies, Inc. All Rights Reserved. fundamentals of Human Resource Management 4 th edition by.
Raises, Merit Pay, Bonuses Personnel Decisions (e.g., promotion, transfer, dismissal) Identification of Training Needs Research Purposes (e.g., assessing.
Lecture 10: Performance Appraisal. Class Overview n Course Administration n Performance Appraisal Discussion.
Performance Assessment OSI Workshop June 25 – 27, 2003 Yerevan, Armenia Ara Tekian, PhD, MHPE University of Illinois at Chicago.
McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc. All rights reserved Performance Appraisals Chapter 11.
Performance Appraisal
Learning Objectives Copyright © 2002 South-Western/Thomson Learning Using Measurement Scales to Build Marketing Effectiveness CHAPTER ten.
 Employees are often frustrated about the appraisal process  Appraisals are too subjective  Possibility of unfair treatment by a supervisor  Way to.
CHAPTER 5 Evaluating Employee Performance
PERFORMANCE APPRAISAL. Performance is a systematic evaluation of the individual with respect to his performance on the job and his potential for development.
Assessment and Testing
Performance Appraisal
Slide 10-1 © 1999 South-Western Publishing McDaniel Gates Contemporary Marketing Research, 4e Using Measurement Scales to Build Marketing Effectiveness.
© 2008 by Prentice Hall8-1 Competencies Broad range of knowledge, skills, traits and behaviors that may be technical in nature, relate to interpersonal.
Psychometrics. Goals of statistics Describe what is happening now –DESCRIPTIVE STATISTICS Determine what is probably happening or what might happen in.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Criterion-Referenced Testing and Curriculum-Based Assessment EDPI 344.
WITH THE NAME OF ALLAH THE MOST MIGHTY AND MERCIFUL. 1.
Sampling Design & Measurement Scaling
Performance Appraisals
ASSESSMENT IN VALUES EDUCATION Fe Josefa G. Nava, Ph. D. Lecturer College of Education, University of the Philippines, Diliman, Quezon City, DISP 2009.
PERFORMANCE APPRAISAL. Performance Appraisal “Performance appraisal is the systematic evaluation of the individual with respect to his or her performance.
Research in Psychology Chapter Two 8-10% of Exam AP Psychology.
Chapter Twelve Copyright © 2006 McGraw-Hill/Irwin Attitude Scale Measurements Used In Survey Research.
8-1. P A R T P A R T Assessing Performance and Developing Employees Managing Employees’ Performance Developing Employees for Future Success Separating.
Performance Management
Classroom Assessments Checklists, Rating Scales, and Rubrics
Performance Appraisal
PERFORMANCE APPRAISAL
RELIABILITY OF QUANTITATIVE & QUALITATIVE RESEARCH TOOLS
CHAPTER 5 Evaluating Employee Performance
Classroom Assessments Checklists, Rating Scales, and Rubrics
Performance Management and Appraisal
OBSERVATIONAL TECHNIQUSE
PERFORMANCE AND TALENT MANAGEMENT
Rai University , November 2014
CHAPTER 6 Evaluating Employee Performance
Presentation transcript:

RATING SCALES By M. MUTHU SASI REKHA

SYNOPSIS  Introduction  Definitions  Rating  Principles of defining rating scale  Types of rating scales  Personality Profile  Sources of errors in rating scales  Merits of rating scales  Defects of rating scales  Improving the rating scales  Conclusion

INTRODUCTION  Rating scale is an important technique of evaluation. Rating is the assessments of a person by another person. This is one of the oldest methods of personality assessment.There are certain general approaches to assess personality like holistic or overall approach, projective test approach and trait approach. In this rating scales and inventories come under the trait approach.

DEFINITIONS  Barr & others define rating as: “Rating is a term applied to expression of opinion or judgement regarding some situation, object or character. Opinions are usually expressed on a scale of values. Rating techniques are devices by which such judgements may be quantified”.  A rating scale is a device by which the opinion concerning a trait can be systematized.

RATING  Three point scale Above average / Average / Below average  Five point scale Excellent / Very good / Good / Average / Poor  Seven point scale

PRINCIPLES OF DEFINING A RATING SCALE  The characteristics should be clearly defined  The characteristics should be readily observable  Degrees of the characteristics must be defined

TYPES OF RATING SCALES  Numerical Rating scale  Descriptive Rating Scale  Graphical Rating Scale  Score cards  The rank Order Scale  Method of Paired comparisons  Man-To-Man Scale

Numerical Rating scale In which numbers are assigned to each trait. If it is a seven point scale, the number 7 represents the maximum amount of that trait in the individual, and 4 represents the average. The rater merely enters the appropriate number after each name to indicate judgement of the person. A B C D E F G

Descriptive Rating Scale In which descriptive phrases or terms assigned to each trait. The rater enters the appropriate phrase after each name to indicate judgement of the person. A B C D E Excellent Good Average Below average poor

Graphical Rating Scale A straight line, may be represented by descriptive phrases at various points. To rate the subject for a particular trait a check mark is made at the particular point. Low Moral Good Moral High Moral

Score cards  It is a type of scale in which whatever is being rated is analysed into its component parts. An expert assigns each part of a maximum score. The rater assign a value to each item as he passes judgement, and these values are totaled a final score is pronounced.

The Rank Order Scale  In this type the judge is simply required to place the people being rated in a rank order from high to low on the attitude or opinion in question. A given individual’s scale position is given in relation to other people in the sample. The units of the scale are unequal.

Method of Paired comparisons  In which the rater compares each person being rated with respect to the trait of every other individual, being rated in the general terms of equal better or worse.

Man-To-Man Scale  In this case, an individual is asked to rate the person to be rated (the rate) by comparing him to a person already rated and assigned a position on the scales. The rate is assigned his position.

PERSONALITY PROFILE / PSYCHOGRAPH  When rating have been obtained on several traits of the same individual they may be combined in a diagram known as the Personality profile.  A number of rating scales of the same individual in a variety of traits may be combined in the form of a psychograph or personality profile.

Intelligence Honesty Persistance Cooperation Dominance Sociability Anxiety Average PERSONALITY PROFILE (OF BANK CASHIER)

SOURCES OF ERRORS IN RATING SCALES There are several common sources of error in rating scales. All these sources affect the validity of a rating. Errors may be due to : 1. Ambiguity 2. The personality of the rater - - Halo effect - Generosity error - Severity error - Central tendecy 3. Logical error 4. Attitude of the rater. 5. Oppurtunity for adequate abservation.

SOURCES OF ERRORS IN RATING SCALES – continued… 1.Ambiguity: This refers to the wording and meaning of the traits that are measured, e.g., To one rater, aggressiveness may be a positive trait suggesting self – assertion. To another it may connote hostility. The term such as honest, effective and fruitful learning, intelligent citizen, personality, ideal character etc. must be clarified. Unless all pupils are rated on the same attributes, the rating will be invalid and unreliable.

SOURCES OF ERRORS IN RATING SCALES – continued… 2. Personality of the Raters: The Halo effect Generosity error Severity error Central tendency error

SOURCES OF ERRORS IN RATING SCALES – continued… 3. Logical error: A logical error is closely related to the halo effect, but is not due to personal bias. It occurs when two traits, such as intelligence and socio- economic status are closely related and the rater is influenced in his rating of one by the presence or absence of the other intelligent persons posses a high socio-economic status.

SOURCES OF ERRORS IN RATING SCALES – continued… 4. Attitude of Raters: Accurate observation is a very time-consuming process. Unless the raters truly believe that there is some value to be derived from ratings, they may consider them only as another administrative process and not to do a conscientious job.

SOURCES OF ERRORS IN RATING SCALES – continued… 5. Opportunity for Adequate Observation: This is the most serious error. The error is committed when the rater does not know well enough the pupil he is rating. The only reasonable thing to do is to refuse to rate the pupil on those traits about which you have little or no knowledge.

MERITS OF RATING SCALES Less subjective than casual observation, An analytical judgement. Helps comparison of individuals. Stimulates person being rated.

DEFECTS OF THE RATING SCALES Error of Lenience or severity Error or central tendency Halo effect

IMPROVING THE RATING SCALE i) Identify educationally significant traits. ii) Clearly define the traits to be rated and the scale points to be used. iii) Avoid technical jargon. If slang will help convey the intent, use it by all means. iv) Express the traits to be rated as question rather then as declarative statements. v) If the line showing the continuum is used, it should follow immediately after the questions, vi) Determine how discrimination you want the ratings and divide the continuum accordingly. (Three to seven intervals).

CONCLUSION In order to minimize the problem semantics and to make Rating Scales more useful, it is necessary to observe certain established principles. Firstly, the trait must be clearly defined. Secondly, the degrees of the trait must be clearly defined. Thirdly, the rater may be asked to quote instances in support of his judgement. Fourthly, the rater should be instructed not to record anything on the scale. Fifthly, the rater should be instructed to avoid Halo-Effect and finally, it is better to obtain ratings of a particular person rather than from more than one judge.