The Operationalization Process Making Your Concepts Measurable.

Slides:



Advertisements
Similar presentations
BHV 390 Surveys.
Advertisements

Week 3: Designing a questionnaire.  Decided on a subject area  Performed a literature search  Started to think about your research question and hypotheses.
Survey Methodology Survey Instruments (2) EPID 626 Lecture 8.
1 SEDNET The Multiagency Network for Students with Emotional/Behavioral Disabilities Carl Coalson, Region 12 Project Manager Serving: Volusia, Flagler,
Surveys and Questionnaires. How Many People Should I Ask? Ask a lot of people many short questions: Yes/No Likert Scale Ask a smaller number.
Designing Research Concepts, Hypotheses, and Measurement
Basic Ideas of Statistics Unit 1.1 Basic Ideas of Statistics Corresponds to Chapter 1 in Triola.
Week 3: Questionnaire Design.  We went through the research process ◦ Original Article vs. Secondary source ◦ How to find and read a paper ◦ Scientific.
Indexes, Scales and Typologies. Content validity Achieved by including all the dimensions of a concept Most non-demographic variables require more than.
Introduction to SPSS Opening the program Type in data Open an existing data set For now, click “Cancel”
CRIM 430 Lecture 7 Creating Measures for Data Collection.
2013 Alaska Behavioral Risk Factor Surveillance System Adverse Childhood Experiences of Alaskan Adults.
1 Single Indicator & Composite Measures UAPP 702: Research Design for Urban & Public Policy Based on notes by Steven W. Peuquet. Ph.D.
Research Methods in MIS
Research Ethics Levels of Measurement. Ethical Issues Include: Anonymity – researcher does not know who participated or is not able to match the response.
Business 205. Review of Previous Class Milestone #1 Groups Math Review Symbolic Manipulation Excel Review.
Methodology Tips for Constructing Instruments. Matching methods to research paradigm MethodQuantitativeQualitative Written Instrument Standardized Instrument.
Data Analysis Statistics. Levels of Measurement Nominal – Categorical; no implied rankings among the categories. Also includes written observations and.
1 COMM 301: Empirical Research in Communication Kwan M Lee Lect3_1.
Measuring Social Life Ch. 5, pp
1 Major topics to be addressed  Types of research  Fundamental concepts.
Sex, Contraception and Abortion ……… in the executive boardroom????
The Practice of Social Research
The Operationalization Process Making Your Concepts Measurable.
Copyright © 2010 Pearson Education, Inc. Chapter 2 Data.
Collecting, Presenting, and Analyzing Research Data By: Zainal A. Hasibuan Research methodology and Scientific Writing W# 9 Faculty.
Data collection compiled by Anna Bączkowska 2  Questionnaires  Interviews  Accounts  Observation  tests.
Research Method Step 1 – Formulate research question Step 2 – Operationalize concepts ◦ Valid and reliable indicators Step 3 – Decide on sampling technique.
Biostatistics Ibrahim Altubasi, PT, PhD The University of Jordan.
BHV 390 Surveys. Operationalization of Concepts Operationalize means to make measurable You operationalize concepts by turning them into measurable variables.
2013 Alaska Behavioral Risk Factor Surveillance System Adverse Childhood Experiences of Alaskan Adults.
Chapter 2 Data.
1 Concepts of Variables Greg C Elvers, Ph.D.. 2 Levels of Measurement When we observe and record a variable, it has characteristics that influence the.
Statistical analysis Prepared and gathered by Alireza Yousefy(Ph.D)
The What and the Why of Statistics The Research Process Asking a Research Question The Role of Theory Formulating the Hypotheses –Independent & Dependent.
Chapter 1: The What and the Why of Statistics  The Research Process  Asking a Research Question  The Role of Theory  Formulating the Hypotheses  Independent.
The NYS Omnibus Survey NYS Council on Children & Families ACE questions, protective factors, service utilization representative sample of New Yorkers more.
Copyright © 2007 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Data.
SURVEY RESEARCH.  Purposes and general principles Survey research as a general approach for collecting descriptive data Surveys as data collection methods.
Research Methods: Final Year Project Toolkit – Level 6 Laura Lake.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Selecting a Sample. Sampling Select participants for study Select participants for study Must represent a larger group Must represent a larger group Picked.
Level of Measurement Data is generally represented as numbers, but the numbers do not always have the same meaning and cannot be used in the same way.
Research: Conceptualization and Measurement Conceptualization Steps in measuring a variable Operational definitions Confounding Criteria for measurement.
Bell Ringer Using female = 0 and male = 1, calculate the average maleness in this classroom.
Question Everything.  Questionnaire should be: ◦ Valid – Questions should measure what was meant to be measured ◦ Reliable – Should give you the same.
1 1 Research Methods in AD/PR COMM 420 Section 8 Tuesday / Thursday 3:35 pm -5:30 pm 143 Stuckeman Nan Yu 2007 Fall_COMM 420_Week NY.
© 2011 Cengage Learning. All Rights Reserved. May not be copied, scanned, or duplicated, in whole or in part, except for use as permitted in a license.
Introduction. The Role of Statistics in Science Research can be qualitative or quantitative Research can be qualitative or quantitative Where the research.
Chapter 2: Levels of Measurement. Researchers classify variables according to the extent to which the values of the variable measure the intended characteristics.
Primary Research HSB 4UI ISU. Primary Research Quantitative Quantify (measure) Quantify (measure) Large number of test subjects Large number of test subjects.
Beginners statistics Assoc Prof Terry Haines. 5 simple steps 1.Understand the type of measurement you are dealing with 2.Understand the type of question.
Measurement Chapter 6. Measuring Variables Measurement Classifying units of analysis by categories to represent variable concepts.
Statistics 2 Data. What Are Data? Data can be numbers, record names, or other labels. Not all data represented by numbers are numerical data (e.g., 1.
Schenk +, A.N., Vanasse +, R.L., Kaier*, E., Cromer, L.D., Davis, J.L., & Strunk, K.C. (2013, April). An examination of the test-retest reliability of.
The Benefits of Regulating Emotions: Predictions from Adolescent Emotional Repair to Multiple Domains of Young Adult Adjustment. Elenda T. Hessel, Megan.
Sociologists Doing Research Chapter 2. Research Methods Sociologists attempt to ask the “why” and “how” questions and gather evidence which will help.
Chapter 3 Designing Research Concepts, Hypotheses, and Measurement.
Chapter 2 Theoretical statement:
Strengthening Families Overview
NATURE OF Measurement.
Measuring Social Life: How Many? How Much? What Type?
ACE Study: Adverse Chilhood Events and their Effects on Health
Welcome to Hopeworks Trauma Training Session
Laura M. Sylke & David E. Szwedo James Madison University Introduction
PARENTING STYLES.
PARENTING STYLES.
BHV 390 Surveys.
Aashna A. Dhayagude & David E. Szwedo James Madison University
Chapter 6 Indexes, Scales, and Typologies
Presentation transcript:

The Operationalization Process Making Your Concepts Measurable

Operationalizing Operationalization is defined as “to make measurable.” Each of your concepts must be turned into variables by specifying exactly how you will measure it.

Issues in Operationalization Validity Type of Variable Number of Items Used Amount of Detail Needed

Validity Validity means that you are measuring what you say you are measuring. For example, a valid measure of a child’s academic progress might be their grades or their scores on an achievement test. The shoe size of a child to would be an invalid measure of academic progress.

Types of Data There are two general types of data: Discrete Continuous

Discrete Data = information that is sorted into mutually exclusive categories. Subtypes of discrete data: Nominal data sorted into unranked categories Ordinal data sorted into ranked categories

Examples for Nominal Data 1.Gender __X__Male_____Female 2. Ethnicity ____African American ____Euro American _X__Latino ____Asian American ____Native American ____Mixed: Please specify ____________ ____Other: Please specify______________

Example for Ordinal Data 2.Socioeconomic status. ____Poverty level _X__Working class ____Middle class ____Upper class Upper class is higher than middle class, which is higher than working class, which is higher than poverty level.

Continuous Data = measured using a steady progression of values that are equally distant from one another Continuous data can be collected in a single item or in a multiple item index or scale

Examples of Continuous Data Example of single item 4.Age _23__ (Please fill in your age in years.) Example of a multiple item score For each of the four anger scale items below, please circle the number that corresponds to how you feel right now. Not at all 0 Somewhat 1 Moderately so 2 Very much so 3 5. I feel like banging on the table I feel like hitting someone I feel like breaking things I feel like yelling at someone Total Score = 3

How Much Detail Do You Need Do you want to know if something is present or not? Do you want to know to what degree something is present? Do you have a variable that has a number of different components or aspects to it and you need to be sure you have gotten information about all of them to give a complete picture of your variable?

Measuring Age 9.Age (Please check the category that applies to you.) ____Adolescent ____Young Adult ____Adult ____Senior Citizen (Very vague categories, relative age) 10. Age (Please check the category that applies to you.) _____ _____ _____ _____ _____ _____ (More detail with age by decade)

Measuring Age 11.Age in years _____ (Please fill in your age in years) (More detail by year) 12. Age in months _____(Please fill in the child’s age in months) (More detail by month)

How Much Detail Do You Need You can collapse age by year into age by decade after you collect your data, but you cannot reconstruct age by year if you only collect age by decade. Be sure you collect the level of detail you need to answer you research questions or test your hypotheses.

Collecting Data Data can be collected in many ways including: Experimental procedures Surveys Interviews Observations Participant-Observation Content Analyses

Collecting Data Data can be collected in quantitative formats or qualitative formats Sometimes qualitative data is used for description only. Other times it is coded and transformed into quantitative data.

Collecting Data Data can be collected using either open-ended questions/items or closed-ended questions/items. Open-ended questions/items allow the participant to give whatever information they want. Closed-ended questions/items require participants to answer by indicating one or more options pre-determined by the researcher.

Recording Data Sometimes data is recorded as it is collected. Other times it is collected in the form of taped interviews or fieldwork observation notes that must be coded and recorded after it is collected. Data for quantitative research must be recorded no matter how it is collected. Sometimes the recording is the same step as the collection (e.g.surveys), and sometimes it is not (e.g. interviews).

Data RecordingTemplates There are seven general ways to record data : 1. Single item, two option 2. Single item, multiple nominal options 3. Single item, multiple ordinal options 4. Single item, Likert options 5. Single item, fill in the blank 6. Multiple items, index format 7. Multiple items, scale format

Single Item Two Option Measure Sample item: Please check the option that best fits your experience. 14. I have been involved in a physically abusive relationship. _____ Yes_____ No (Closed Format)

Single-Item, Multiple Nominal Options Sample item: Please check the option that best reflects your ethnic background. 15. Ethnicity. _____African American _____Asian American _____Latino _____Euro American _____ Native American _____Other: Please specify___________________ (Closed Format)

Single-Item, Multiple Ordinal Options Sample item: Please check the option that best fits your experience. 16. How many times have you been involved in a physically abusive romantic relationship? _____ Never _____ 1 time _____ 2-5 times _____6-9 times _____10 or more times (Closed Format)

Single Item, Likert Options Sample item: Please circle the option that best fits your experience. 17. I usually eat when I am sad or depressed. Never TrueAlways True (Closed Format)

Single Item, Fill in the Blank Sample items: 18.What is your age in years? _______ 19.What is your ethnicity? ________________________ Age in years is continuous, and ethnicity is nominal and discrete. (Open Format)

Multiple Item, Scale Format Sample items from the Sexual Permissiveness Scale (Bauman and Wilson 1976): 20. Sexual intercourse is acceptable for the male before marriage when he is in love. __X__ Agree _____ Disagree 21. Sexual intercourse is acceptable for the male before marriage when he feels strong affection. _____ Agree __X__ Disagree 22. Sexual intercourse is acceptable for the male before marriage even if he does not feel strong affection. _____ Agree __X__ Disagree

Multiple Item, Scale Format (con’t) A scale is scored by differently weighting items in a multiple item measurement. For the Sexual Permissiveness Scale on the previous slide, Item 20 receives 1 point for “agree”. Item 21 receives 2 points for “agree”. Item 22 receives 3 points for “agree”. Item 21 gets twice the weight as item 20, and item 22 gets three times the weight of item 20. Researcher differently weights each item through scoring. As marked, the scale has a total score of 1.

Multiple Item, Scale Format Sample items: For each of the four anger scale items below, please circle the number that corresponds to how you feel right now. Not at all 0 Somewhat 1 Moderately so 2 Very much so I feel like banging on the table I feel like hitting someone I feel like breaking things I feel like yelling at someone Total Score = 2 Each item is equally weighted in the calculation of the score. Participants weight each item

Multiple Item, Index Format Sample items: For each of the four anger scale items below, please circle the number that corresponds to how you feel right now. No0 Yes 1 Yes 23. I feel like banging on the table. Yes No Yes 24. I feel like hitting someone. Yes No 25. I feel like breaking things. Yes No 26. I feel like yelling at someone. Yes No Total Score 4 Each item is equally weighted in the calculation of the score.

Part of the Adverse Childhood Experiences (ACEs) Index Give yourself one point for each time you answer yes. Answers equally weighted. While you were growing up, during your first 18 years of life: 1. Did a parent or other adult in the household often or very often… Swear at you, insult you, put you down, or humiliate you? or Act in a way that made you afraid that you might be physically hurt? Yes No If yes enter 1 ________ 2. Did a parent or other adult in the household often or very often… Push, grab, slap, or throw something at you? or Ever hit you so hard that you had marks or were injured? Yes No If yes enter 1 ________ 3. Did an adult or person at least 5 years older than you ever… Touch or fondle you or have you touch their body in a sexual way? or Attempt or actually have oral, anal, or vaginal intercourse with you? Yes No If yes enter 1 ________ 4. Did you often or very often feel that … No one in your family loved you or thought you were important or special? or Your family didn’t look out for each other, feel close to each other, or support each other? Yes No If yes enter 1 ________ 5. Did you often or very often feel that … You didn’t have enough to eat, had to wear dirty clothes, and had no one to protect you? or Your parents were too drunk or high to take care of you or take you to the doctor if you needed it? Yes No If yes enter 1 ________

The Operationalization Process 1.Begin with your concept. 2.Decide whether you will collect quantitative or qualitative data. 3.Choose between experimental, survey, interview, fieldwork and content analysis to collect your data. 4.Decide what level of detail you need to answer your research questions and/or test your hypotheses. 5.Select a data recording format. OR Locate a preexisting scale or index that measures your concept. 6. Write your measurement item. 7. Check the validity of your measure. 8. Repeat this process for each concept you want to measure