Measurement and Scaling Chapter 6 Learning Objectives: Understand the role of concepts in business research. Explain the notion of measurement. Provide an overview of the types of measurement scales. Distinguish between reliability and validity. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
What is a concept? A concept is a mental abstraction or idea formed by the perception of some phenomena. Examples of concepts in business include job satisfaction, job commitment, brand awareness, brand loyalty, service quality, image, risk, channel conflict, empathy, and so on. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
12 Dimensions of a Great Workplace Go On-Line www.gallup.com Item 1. I know what is expected of me at work. Item 2. I have the materials and equipment I need to do my work right. Item 3. At work, I have the opportunity to do what I do best everyday. Item 4. In the last seven days, I have received recognition or praise for doing good work. Item 5. My supervisor, or someone at work, seems to care about me as a person. Item 6. There is someone at work who encourages my development. Item 7. At work, my opinions seem to count. Item 8. The mission or purpose of my company makes me feel my job is important. Item 9. My fellow employees are committed to doing quality work. Item 10. I have a best friend at work. Item 11. In the last six months, someone at work has talked to me about my progress. Item 12. This last year, I have had opportunities at work to learn and grow. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Measurement . . . involves assigning numbers to a variable according to certain rules that reflect the characteristics of the phenomenon being measured. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
What is the measurement process? The measurement process involves specifying the variables that serve as proxies for the concepts (constructs). A proxy is a variable that represents a single component of a larger concept and, taken together, several proxies (indicator variables) are said to measure a concept. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Scale . . . a scale is a measurement tool that can be discrete or continuous. Discrete scales measure only direction, but continuous scales measure both direction and intensity. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Four Levels of Measurement Ratio ? Interval Ordinal . Nominal Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Types of Scales Metric Scales Nonmetric Scales Summated Ratings Numerical Semantic Differential Graphic Ratings Nonmetric Scales Categorical Rank Order Sorting Constant Sum Paired Comparison Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Summated Ratings Scale Gino’s Italian Ristorante has a wide variety of menu choices. Strongly Disagree Neither Agree Agree Strongly Disagree nor Disagree Agree 1 2 3 4 5 Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Numerical Scale Using a 10-point scale, where 1 is “not at all important” and 10 is “very important” how important is ________ in your decision to do business with a particular vendor? Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Semantic Differential Scale “My supervisor is . . . . “ Courteous ___ ___ ___ ___ ___ Discourteous Friendly ___ ___ ___ ___ ___ Unfriendly Helpful ___ ___ ___ ___ ___ Unhelpful Supportive ___ ___ ___ ___ ___ Hostile Competent ___ ___ ___ ___ ___ Incompetent Honest ___ ___ ___ ___ ___ Dishonest Enthusiastic ___ ___ ___ ___ ___ Unenthusiastic Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Graphic Ratings On a scale from 0 to 10 how would you rate the atmosphere of Samouel’s Greek Cuisine restaurant? Indicate by placing an “X” at the appropriate place on the line. Poor OK Excellent |____________________|____________________| 0 5 10 Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Categorical How satisfied are you with your current job? [ ] Very Satisfied [ ] Somewhat Satisfied [ ] Neither Satisfied nor Dissatisfied [ ] Somewhat Dissatisfied [ ] Very Dissatisfied How interested are you in learning more about the benefits that are offered with this health plan? [ ] Very Interested [ ] Somewhat Interested [ ] Not Very Interested Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Rank Order “Please rank the five attributes listed below on a scale from ‘1’ (the most important) to ‘5’ (the least important) in searching for a job.” Job Attributes Ranking Pay Benefits Co-workers Flexible Scheduling of Work Hours Working Conditions Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Sorting This type of scaling approach asks respondents to indicate their beliefs or opinions by arranging objects (items) on the basis of perceived similarity, preference, or some other attribute. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Constant Sum “Please allocate 100 points across the following four attributes to indicate their relative importance.” Attributes Score On-Time Delivery Price Tracking Capability Invoice Accuracy Sum 100 Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Paired Comparison Below you will find ten pairs of attributes that have been identified a being important when choosing a restaurant. For each pair mark the attribute you feel is more important to you in choosing a restaurant to dine at. Pairs Attribute 1 Attribute 2 Pair 1 Food Quality Atmosphere Pair 2 Prices Pair 3 Service Pair 4 Cleanliness Pair 5 Pair 6 Pair 7 Pair 8 Pair 9 Pair 10 Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Criteria for Assessing Measurement Scales Go On-Line www.raosoft.com Reliability Validity Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Practical Decisions When Developing Scales Number of Scale Categories Number of Items to Measure a Concept Odd or Even Number of Categories Balanced of Unbalanced Scales Forced or Non-forced Choice Category Labels for Scales Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Balanced vs. Unbalanced Scales “To what extent do you consider TV shows with sex and violence to be acceptable for teenagers to view?” Balanced: __ Very Acceptable __ Somewhat Acceptable __ Neither Acceptable or Unacceptable __ Somewhat Unacceptable __ Very Unacceptable Unbalanced: __ Very Acceptable __ Unacceptable Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Forced or Non-Forced? “How likely are you to purchase a laptop PC in the next six months?” Very Very Unlikely Likely ___ No 1 2 3 4 5 6 Opinion Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Category Labels for Scales? Verbal Label: “How important is the size of the hard drive in selecting a laptop PC to purchase?” Very Somewhat Neither Important Somewhat Very Unimportant Unimportant or Unimportant Important Important 1 2 3 4 5 Numerical Label: “How likely are you to purchase a laptop PC in the next six months?” Very Very Unlikely Likely 1 2 3 4 5 Unlabeled: “How important is the weight of the laptop PC in deciding which brand to purchase?” Very Very Unimportant Important ___ ___ ___ ___ ___ Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Choosing a Measurement Scale Capabilities of Respondents Context of Scale Application Data Analysis Approach Validity and Reliability Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Assessing Measurement Scales: Validity Reliability Measurement Error = occurs when the values obtained in a survey (observed values) are not the same as the true values (population values). Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Reliability Test-retest Alternative Forms Internal Consistency Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Exhibit 6-5 Rules of Thumb about Cronbach’s Alpha Coefficient Size Coefficient Strength of Range Association < .6 Poor .6 to < .7 Moderate .7 to < .8 Good .8 to < .9 Very Good > = .9 Excellent Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Validity Content Construct Criterion Convergent Discriminant Concurrent Predictive Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Multi-Item Scales Go On-Line www.burke.com Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Scales – used to measure concepts (constructs). Two Options: Use published scales. Develop original scales. Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Steps in Developing a Scale: Definition of the concept(s) to be measured. Identification of the components of the concept. Specification of a sample of observable and measurable items to represent the components. Selection of the appropriate scales to measure the items. Combination of the items into a composite scale to measure the concept. Administer the scale to a sample and assess respondent understanding. Revise the scale as needed. . Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Measurement and Scaling Go On-Line www.sric-bi.com How does this website help you to better understand measurement and scaling? Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.
Measurement and Scaling Go On-Line www.icpsr.umich.edu/gss What kinds of scales are used on the General Social Survey on this Website? Hair, Babin, Money & Samouel, Essentials of Business Research, Wiley, 2003.