Download presentation
Presentation is loading. Please wait.
Published byLorraine Jefferson Modified over 9 years ago
1
SLWK – 609 Research Methods- online- M. Secret
2
Problem Idea Theory What How Who (variables) (methods) (sample) Data Collection Data Processing Data Analysis Discussion and Application Backing- up.. Where are we in the research process
3
Problem >> Idea >> Theory What >> How >> Who (variables) (methods) (sample) WHAT ARE YOU GOING TO OBSERVE – or measure -- some characteristic, or some type of knowledge, attitude, or behavior.. conceptualization and operationalization of variables.. How will you measure them…
4
A. WHAT IS MEASURMENT ◦ assignment of numbers to indicators of concepts, or variables, according to rules (mathematical operations of numbers) ◦ the link or the -- bridge between the world of concepts and the empirical world Tells you -- quantifies -- how much the variable varies.. you are going from the very general or theoretical level to the fairly specific or operational level...science is deductive.... ◦ the number tells you, helps you to infer, how much or how little the concept is present
5
A variable is a concept that can be measured: i.e. Gender is a concept.. When you measure it, it becomes a variable Depression is a concept… when you measure it, it becomes a variable
6
The variable age can be measured by answer to the question -- How old are you?.. It can also be measured by collecting data from an existing form that gives you the date of birth By nature, age varies by numbers of year… so the number is assigned automatically
7
The variable gender can be measured by the answer to the question, Are you male or female? Because there is no automatic number associated with the variable gender, you the researcher assigns the number.. An example would be that the value of 1 is assigned to female and 0 is assigned to male A researcher might also be able to ‘observe’ whether someone is male or female, but we all know that this would not be a particularly valid way to measure gender
8
The variable stress can be measured by the summed score of the answers to 10 items on the Stress scale Stress can also be measured by some physiological measure, i.e. blood pressure, where the researcher states that a blood pressure number above a certain level is an indicator of stress
9
The level of social support can measured by the answer to the question ‘how much social support do you have’ 1 = very much; 2 = some; 3 = very little Or by asking several questions about social support and adding the answers to these questions together to get one score.. This produces a scaled score, or number, that tells you how much of or how little social support exists.
10
Some concepts are easier to measure than other concepts because they are, by nature, more concrete Age is fairly easy to measure by asking just one question --how old are you? Or What is your date of birth? Depression is more difficult to measure because it’s hard to know what to count, or what exactly to observe, to know whether or not it is present. Trauma is difficult to measure because you need to be clear about whether you’re going to measure the traumatic event or the trauma symptoms.
11
For abstract concepts, it is especially important that you define what you mean by a concept before you try to measure it. i.e. Depression is a feeling of malaise or emotional discomfort that interferes with day to day routine functioning. Trauma is an external event that causes injury or harm.. OR Trauma is the condition or response to an event that causes injury or harm.. OR Trauma is an emotional wound caused by…
12
conceptualization ◦ Uses words to define ◦ Dictionary definition ◦ More abstract Operationalization ◦ Uses numbers to define ◦ How measured ◦ More concrete – what you count
13
Measurement and operationalization can be thought of as almost the same thing When you operationalize a concept you are assigning numbers to a variable Operationalization = how you are going to measure a concept.
14
Variation is represented by the characteristics or categories or values of a particular variable Gender is the variable, the values are male (0) or female (1); Age is the variable, the values are 1, 2, 3, Stess is a variable, the values are very much (3), some (2), little (3) How a variable varies is known as the level of measurement.
15
Types = Nominal – variable varies by group or categories ◦ (Male, female); (married, never married, divorced); (republican, democrat) ◦ variable is either present or not.. Ordinal – varies by rank or order.. ◦ More or less, higher or lower..( Low, mid, high income level) Interval/ratio – varies by specific distance between values.. ◦ 1 is the same distance from 2 as 2 is from 3, etc etc ◦ 50 feet is higher than 30 feet -- ◦ Difference between values/categories is precise
17
May want to stop the recording and access a copy of this form which is posted on blackboard
18
◦ Develop conceptual/nominal definition(s) for what this form is measuring ◦ Identify the variable(s) and the indicator(s) that the form is measuring ◦ What is the level of measurement for the variables “Regular attendance at meetings” and for “Practical contribution to end product” ◦ What are the values for each of these variables ◦ How could you convert these variables to a nominal level of measurement. ◦ Does it make sense to consider the questions on this form as a scale. Provide a rationale for your answer. ◦ Create a scale using the items on this form ◦ Applying validity and reliability
19
In general conceptualization … Participation in group project Own/other contributions to group project More specific conceptualization… Regular attendance at meetings Contribution of ideas for the task Researching, analyzing and preparing material for the task Contribution to the cooperative group process Supporting and encouraging group members Practical contribution to end product
20
Regular attendance at meetings Attended all meetings, stayed to agreed end, working within timescale, active and attentive, Contribution of ideas for the task Thought about the topic in advance of the meeting, provided workable ideas which were taken up by the group, built on others' suggestions, and were prepared to test out ideas on the group rather than keep quiet Researching, analyzing and preparing material for the task Did what you said you would brought materials, did an equal share of the research and helped to analyze and evaluate the material Contribution to the cooperative group process Left personal differences outside the group, willing to review group progress and tackle conflict in the group, took on different roles as needed, kept group on track, willing and flexible but focused on the task Supporting and encouraging group members Keen to listen to others, encouraged participation, enabled a collaborative learning environment, sensitive to issues affecting group members, supported group members with special needs Practical contribution to end product Willing to try new things. Not hogging the tasks, made a high level of contribution, took own initiative, was reliable and produced a high standard work/presentation Thought for the day!! Definition of any one concept rests on shared understandings of other terms used in the definition Research is as much about communication as it about anything else
21
Variable indicator Variable indicator
22
5,4,3,2,1, = values How.. or the degree to which the variable varies
23
Ordinal 5 is more than 4… is more than 3 Values are ordered/ranked
24
◦H◦How would you create a scale using the items on this form AAdd together the values for all the items into ONE score.. The one score tells you how much self/others contributed to the group effort
25
In the area of measurement, researchers confront two major issues: validity and reliability. Differentiate between validity and reliability. Validity – does the variable measure what it is supposed to … is the operational definition the same as the conceptual definition Reliability – do you get the same answer every time you measure a variable
26
What does ‘(measurement) reliability’ mean in terms of this form? A person will answer the same way every time they answer the question -- under the same circumstances Stable and dynamic traits ◦ Gender = stable.. Doesn’t change much over time ◦ Happiness = dynamic… changes frequently
27
What does ‘(measurement) validity’ mean in terms of this form? The form is an accurate measure of what you want it to measure…. i.e. it is a good measure of participation in/ contribution to the group effort
28
Test-retest ◦ Will someone fill out the form on two different days (weeks) the same way – ◦ providing nothing has changed in the situation Inter-rater Internal Consistency reliability – applies mainly to scaled measurements (alpha or chronbach’s) ◦ Will someone answer the same way (i.e. all 5’s or all 1’s) on each item of the scale ◦ The stronger the association among individual items and the more items included, the higher the reliability of a measure
29
Content validity/face validity subjective judgment as to whether or not an instrument is valid based on whether or not the test items appear to be related. Content validity can be strengthened by having experts make the judgment as to whether or not a measurement measures what it is supposed to measure
30
Criterion validity ◦ How well does your measure compare to another measure.. Another standard -- or ruler that you trust to be accurate. hold up your test to see how well it compares to some predetermined, already existing standard. ◦ In concurrent validity, the standard, or ruler, is other tests which have already been determined to have validity... DEPRESSION SCALES...GCS SCALE WITH BECK OR ZUNG....or with DSMIII-R ◦ In predictive validity, the standard you are comparing your test to is what happens in the future. Do social workers who test high on the empowerment scale more likely to become involved in community activities SAT test as a measure to determine how well students do academically and thus compares it with how well the student actually does in school... scales to measure high or low risk adoptions placements would be compared with whether or not the adoption was disrupted. Construct validity ◦ related to a variety of other measures as specified in a theory, used when no clear criterion exists for validation purposes Do a cheat sheet on this.
31
CConceptualization and Operationalization ◦I◦In order to select which concepts to consider and which variables to measure, we must EExamine relevant theories RReview previous research CConsider the constraints and opportunities UUnderstand that the definition of any one concept rests on shared understandings of other terms used in the definition FROM LIT REVIEW
32
What is treatment fidelity? Why is it important? ◦ treatment is the independent variable in intervention studies. ◦ need to know the extent to which intervention was implemented in order to understand the outcome of the intervention What will you measure to assess treatment fidelity? How will you measure treatment fidelity? What is the connection between treatment fidelity and evidence based practice.
33
Stay tuned for the next Podcast which will be on sampling.
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.