The Operationalization Process Making Your Concepts Measurable.

Slides:



Advertisements
Similar presentations
BHV 390 Surveys.
Advertisements

Week 3: Designing a questionnaire.  Decided on a subject area  Performed a literature search  Started to think about your research question and hypotheses.
Conceptualization, Operationalization, and Measurement
Conceptualization and Measurement
Designing Research Concepts, Hypotheses, and Measurement
TYPES OF DATA. Qualitative vs. Quantitative Data A qualitative variable is one in which the “true” or naturally occurring levels or categories taken by.
Variables Soodeh Arabnejad KMUPRESS, KMU. Review of Terms Sample / Individual: The objects described by a set of data, individuals may be people, animals.
Week 3: Questionnaire Design.  We went through the research process ◦ Original Article vs. Secondary source ◦ How to find and read a paper ◦ Scientific.
Indexes, Scales and Typologies. Content validity Achieved by including all the dimensions of a concept Most non-demographic variables require more than.
Introduction to SPSS Opening the program Type in data Open an existing data set For now, click “Cancel”
Measurement and Observation. Choices During Operationalization Researchers make a number of key decisions when deciding how to measure a concept Researchers.
CRIM 430 Lecture 7 Creating Measures for Data Collection.
1 Single Indicator & Composite Measures UAPP 702: Research Design for Urban & Public Policy Based on notes by Steven W. Peuquet. Ph.D.
Measurement in Survey Research Developing Questionnaire Items with Respect to Content and Analysis.
Definition. A SAMPLE is a subset of the population. We should now consider the first component of an experimental study, collecting data The textbook.
Research Methods in MIS
Business 205. Review of Previous Class Milestone #1 Groups Math Review Symbolic Manipulation Excel Review.
Methodology Tips for Constructing Instruments. Matching methods to research paradigm MethodQuantitativeQualitative Written Instrument Standardized Instrument.
Data Analysis Statistics. Levels of Measurement Nominal – Categorical; no implied rankings among the categories. Also includes written observations and.
Scientific Method.
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect3_1.
Measuring Social Life Ch. 5, pp
1 Major topics to be addressed  Types of research  Fundamental concepts.
The Practice of Social Research
Chapter 1: Introduction to Statistics
Chapter 1: Introduction to Statistics
Copyright © 2010 Pearson Education, Inc. Chapter 2 Data.
Hypothesis Testing for Ordinal & Categorical Data EPSY 5245 Michael C. Rodriguez.
Collecting, Presenting, and Analyzing Research Data By: Zainal A. Hasibuan Research methodology and Scientific Writing W# 9 Faculty.
Data collection compiled by Anna Bączkowska 2  Questionnaires  Interviews  Accounts  Observation  tests.
Instrumentation.
Biostatistics Ibrahim Altubasi, PT, PhD The University of Jordan.
BHV 390 Surveys. Operationalization of Concepts Operationalize means to make measurable You operationalize concepts by turning them into measurable variables.
COURSE: JUST 3900 INTRODUCTORY STATISTICS FOR CRIMINAL JUSTICE Instructor: Dr. John J. Kerbs, Associate Professor Joint Ph.D. in Social Work and Sociology.
Chapter 2 Data.
1 Concepts of Variables Greg C Elvers, Ph.D.. 2 Levels of Measurement When we observe and record a variable, it has characteristics that influence the.
Statistical analysis Prepared and gathered by Alireza Yousefy(Ph.D)
The What and the Why of Statistics The Research Process Asking a Research Question The Role of Theory Formulating the Hypotheses –Independent & Dependent.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Data.
SURVEY RESEARCH.  Purposes and general principles Survey research as a general approach for collecting descriptive data Surveys as data collection methods.
Research Methods: Final Year Project Toolkit – Level 6 Laura Lake.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Selecting a Sample. Sampling Select participants for study Select participants for study Must represent a larger group Must represent a larger group Picked.
Level of Measurement Data is generally represented as numbers, but the numbers do not always have the same meaning and cannot be used in the same way.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Martha Munoz Janet Soto Latoya Gallardo. Abstract  In this study, the correlation between social confidence and academic confidence in Latinos and Asian.
Bell Ringer Using female = 0 and male = 1, calculate the average maleness in this classroom.
Question Everything.  Questionnaire should be: ◦ Valid – Questions should measure what was meant to be measured ◦ Reliable – Should give you the same.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
1 1 Research Methods in AD/PR COMM 420 Section 8 Tuesday / Thursday 3:35 pm -5:30 pm 143 Stuckeman Nan Yu 2007 Fall_COMM 420_Week NY.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
The Operationalization Process Making Your Concepts Measurable.
Chapter 7 Measuring of data Reliability of measuring instruments The reliability* of instrument is the consistency with which it measures the target attribute.
Methods of Data Collection Survey Methods Self-Administered Questionnaires Interviews Methods of Observation Non-Participant Observation Participant Observation.
Chapter 2: Levels of Measurement. Researchers classify variables according to the extent to which the values of the variable measure the intended characteristics.
1. Is data always recorded as numbers? 2. What do you organize data into for it to be easily read? 3. What is a categorical variable? 4. What is a quantitative.
Outline of Today’s Discussion 1.The Chi-Square Test of Independence 2.The Chi-Square Test of Goodness of Fit.
Foundations of Research Survey Research This is a PowerPoint Show Open it as a show by going to “slide show”. Click through it by pressing any key.
Primary Research HSB 4UI ISU. Primary Research Quantitative Quantify (measure) Quantify (measure) Large number of test subjects Large number of test subjects.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Slide 2- 1.
Beginners statistics Assoc Prof Terry Haines. 5 simple steps 1.Understand the type of measurement you are dealing with 2.Understand the type of question.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Statistics 2 Data. What Are Data? Data can be numbers, record names, or other labels. Not all data represented by numbers are numerical data (e.g., 1.
Chapter 3 Designing Research Concepts, Hypotheses, and Measurement.
Chapter 2 Theoretical statement:
Associated with quantitative studies
NATURE OF Measurement.
Measuring Social Life: How Many? How Much? What Type?
BHV 390 Surveys.
Chapter 6 Indexes, Scales, and Typologies
Presentation transcript:

The Operationalization Process Making Your Concepts Measurable

Operationalizing Operationalization is defined as “to make measurable.” Each of your concepts must be turned into variables by specifying exactly how you will measure it.

Issues in Operationalization Validity Type of Variable Number of Items Used Amount of Detail Needed

Validity Validity means that you are measuring what you say you are measuring. For example, a valid measure of a child’s academic progress might be their grades or their scores on an achievement test. The shoe size of a child to would be an invalid measure of academic progress.

Types of Data There are two general types of data: Discrete Continuous

Discrete Data = information that is sorted into mutually exclusive categories. Subtypes of discrete data: Nominal data sorted into unranked categories Ordinal data sorted into ranked categories

Examples for Nominal Data 1.Gender __X__Male_____Female 2. Ethnicity ____African American ____Euro American _X__Latino ____Asian American ____Native American ____Mixed: Please specify ____________ ____Other: Please specify______________

Example for Ordinal Data 2.Socioeconomic status. ____Poverty level _X__Working class ____Middle class ____Upper class Upper class is higher than middle class, which is higher than working class, which is higher than poverty level.

Continuous Data = measured using a steady progression of values that are equally distant from one another Continuous data can be collected in a single item or in a multiple item index or scale

Examples of Continuous Data Example of single item 4.Age _23__ (Please fill in your age in years.) Example of a multiple item score For each of the four anger scale items below, please circle the number that corresponds to how you feel right now. Not at all 0 Somewhat 1 Moderately so 2 Very much so 3 5. I feel like banging on the table I feel like hitting someone I feel like breaking things I feel like yelling at someone Total Score = 3

How Much Detail Do You Need Do you want to know if something is present or not? Do you want to know to what degree something is present? Do you have a variable that has a number of different components or aspects to it and you need to be sure you have gotten information about all of them to give a complete picture of your variable?

Measuring Age 9.Age (Please check the category that applies to you.) ____Adolescent ____Young Adult ____Adult ____Senior Citizen (Very vague categories, relative age) 10. Age (Please check the category that applies to you.) _____ _____ _____ _____ _____ _____ (More detail with age by decade)

Measuring Age 11.Age in years _____ (Please fill in your age in years) (More detail by year) 12. Age in months _____(Please fill in the child’s age in months) (More detail by month)

How Much Detail Do You Need You can collapse age by year into age by decade after you collect your data, but you cannot reconstruct age by year if you only collect age by decade. Be sure you collect the level of detail you need to answer you research questions or test your hypotheses.

Collecting Data Data can be collected in many ways including: Experimental procedures Surveys Interviews Observations Participant-Observation Content Analyses

Collecting Data Data can be collected in quantitative formats or qualitative formats Sometimes qualitative data is used for description only. Other times it is coded and transformed into quantitative data.

Collecting Data Data can be collected using either open-ended questions/items or closed-ended questions/items. Open-ended questions/items allow the participant to give whatever information they want. Closed-ended questions/items require participants to answer by indicating one or more options pre-determined by the researcher.

Recording Data Sometimes data is recorded as it is collected. Other times it is collected in the form of taped interviews or fieldwork observation notes that must be coded and recorded after it is collected. Data for quantitative research must be recorded no matter how it is collected. Sometimes the recording is the same step as the collection (e.g.surveys), and sometimes it is not (e.g. interviews).

Data RecordingTemplates There are seven general ways to record data : 1. Single item, two option 2. Single item, multiple nominal options 3. Single item, multiple ordinal options 4. Single item, Likert options 5. Single item, fill in the blank 6. Multiple items, index format 7. Multiple items, scale format

Single Item Two Option Measure Sample item: Please check the option that best fits your experience. 14. I have been involved in a physically abusive relationship. _____ Yes_____ No (Closed Format)

Single-Item, Multiple Nominal Options Sample item: Please check the option that best reflects your ethnic background. 15. Ethnicity. _____African American _____Asian American _____Latino _____Euro American _____ Native American _____Other: Please specify___________________ (Closed Format)

Single-Item, Multiple Ordinal Options Sample item: Please check the option that best fits your experience. 16. How many times have you been involved in a physically abusive romantic relationship? _____ Never _____ 1 time _____ 2-5 times _____6-9 times _____10 or more times (Closed Format)

Single Item, Likert Options Sample item: Please circle the option that best fits your experience. 17. I usually eat when I am sad or depressed. Never TrueAlways True (Closed Format)

Single Item, Fill in the Blank Sample items: 18.What is your age in years? _______ 19.What is your ethnicity? ________________________ Age in years is continuous, and ethnicity is nominal and discrete. (Open Format)

Multiple Item, Scale Format Sample items from the Sexual Permissiveness Scale (Bauman and Wilson 1976): 20. Sexual intercourse is acceptable for the male before marriage when he is in love. __X__ Agree _____ Disagree 21. Sexual intercourse is acceptable for the male before marriage when he feels strong affection. _____ Agree __X__ Disagree 22. Sexual intercourse is acceptable for the male before marriage even if he does not feel strong affection. _____ Agree __X__ Disagree

Multiple Item, Scale Format (con’t) A scale is scored by differently weighting items in a multiple item measurement. For the Sexual Permissiveness Scale on the previous slide, Item 20 receives 1 point for “agree”. Item 21 receives 2 points for “agree”. Item 22 receives 3 points for “agree”. Item 21 gets twice the weight as item 20, and item 22 gets three times the weight of item 20. As marked, the scale has a total score of 1.

Multiple Item, Index Format Sample items: For each of the four anger scale items below, please circle the number that corresponds to how you feel right now. Not at all 0 Somewhat 1 Moderately so 2 Very much so I feel like banging on the table I feel like hitting someone I feel like breaking things I feel like yelling at someone Total Score = 2 Each item is equally weighted in the calculation of the score.

The Operationalization Process 1.Begin with your concept. 2.Decide whether you will collect quantitative or qualitative data. 3.Choose between experimental, survey, interview, fieldwork and content analysis to collect your data. 4.Decide what level of detail you need to answer your research questions and/or test your hypotheses. 5.Select a data recording format. OR Locate a preexisting scale or index that measures your concept. 6. Write your measurement item. 7. Check the validity of your measure. 8. Repeat this process for each concept you want to measure