Sampling (cont.) Instrumentation Measurement Plan Due 3/7.

Slides:



Advertisements
Similar presentations
Richard M. Jacobs, OSA, Ph.D.
Advertisements

Learning Objectives Copyright © 2004 John Wiley & Sons, Inc. Data Processing, Fundamental Data Analysis, and Statistical Testing of Differences CHAPTER.
© 2006 The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Instrumentation Chapter Seven.
Table of Contents Exit Appendix Behavioral Statistics.
Business Statistics: A Decision-Making Approach, 7e © 2008 Prentice-Hall, Inc. Chap 3-1 Business Statistics: A Decision-Making Approach 7 th Edition Chapter.
Calculating & Reporting Healthcare Statistics
STANDARDIZED TESTING MEASUREMENT AND EVALUATION  All teaching involves evaluation. We compare information to criteria and ten make judgments.  Measurement.
Part 2: Quantitative Methods
Appraisal in Counseling Session 2. Schedule Finish History Finish History Statistical Concepts Statistical Concepts Scales of measurement Scales of measurement.
Business Statistics: A Decision-Making Approach, 7e © 2008 Prentice-Hall, Inc. Chap 3-1 Business Statistics: A Decision-Making Approach 7 th Edition Chapter.
Data Analysis Statistics. OVERVIEW Getting Ready for Data Collection Getting Ready for Data Collection The Data Collection Process The Data Collection.
EdPsy 511 August 28, Common Research Designs Correlational –Do two qualities “go together”. Comparing intact groups –a.k.a. causal-comparative and.
Introduction to Educational Statistics
Survey Research & Understanding Statistics
Edpsy 511 Homework 1: Due 2/6.
Descriptive statistics (Part I)
Copyright 2001 by Allyn and Bacon Standardized Testing Chapter 14.
Data Analysis Statistics. OVERVIEW Getting Ready for Data Collection The Data Collection Process Getting Ready for Data Analysis Descriptive Statistics.
Measures of Central Tendency
Revision Sampling error
The Data Analysis Plan. The Overall Data Analysis Plan Purpose: To tell a story. To construct a coherent narrative that explains findings, argues against.
Describing Data: Numerical
EPE/EDP 557 Key Concepts / Terms –Empirical vs. Normative Questions Empirical Questions Normative Questions –Statistics Descriptive Statistics Inferential.
CHAPTER 1 Basic Statistics Statistics in Engineering
Quantitative Skills: Data Analysis
© Copyright McGraw-Hill CHAPTER 3 Data Description.
Modified by ARQ, from © 2002 Prentice-Hall.Chap 3-1 Numerical Descriptive Measures Chapter %20ppts/c3.ppt.
Statistics Recording the results from our studies.
© 2006 McGraw-Hill Higher Education. All rights reserved. Numbers Numbers mean different things in different situations. Consider three answers that appear.
Chapter 11 Descriptive Statistics Gay, Mills, and Airasian
Measures of Variability In addition to knowing where the center of the distribution is, it is often helpful to know the degree to which individual values.
Instrumentation (cont.) February 28 Note: Measurement Plan Due Next Week.
Chapter 3 Descriptive Statistics: Numerical Methods Copyright © 2014 by The McGraw-Hill Companies, Inc. All rights reserved.McGraw-Hill/Irwin.
Describing Behavior Chapter 4. Data Analysis Two basic types  Descriptive Summarizes and describes the nature and properties of the data  Inferential.
What is Business Statistics? What Is Statistics? Collection of DataCollection of Data –Survey –Interviews Summarization and Presentation of DataSummarization.
Measures of Dispersion & The Standard Normal Distribution 2/5/07.
STAT 280: Elementary Applied Statistics Describing Data Using Numerical Measures.
Business Statistics: A Decision-Making Approach, 6e © 2005 Prentice-Hall, Inc. Chap 3-1 Business Statistics: A Decision-Making Approach 6 th Edition Chapter.
Ex St 801 Statistical Methods Introduction. Basic Definitions STATISTICS : Area of science concerned with extraction of information from numerical data.
© 2006 McGraw-Hill Higher Education. All rights reserved. Numbers Numbers mean different things in different situations. Consider three answers that appear.
Descriptive Statistics
Chapter 21 Basic Statistics.
Lecture 3 Describing Data Using Numerical Measures.
QUANTITATIVE RESEARCH AND BASIC STATISTICS. TODAYS AGENDA Progress, challenges and support needed Response to TAP Check-in, Warm-up responses and TAP.
STATISTICS. Statistics * Statistics is the area of science that deals with collection, organization, analysis, and interpretation of data. * A collection.
An Introduction to Statistics. Two Branches of Statistical Methods Descriptive statistics Techniques for describing data in abbreviated, symbolic fashion.
EDPSY Chp. 2: Measurement and Statistical Notation.
Copyright © 2014 by Nelson Education Limited. 3-1 Chapter 3 Measures of Central Tendency and Dispersion.
Dr. Serhat Eren 1 CHAPTER 6 NUMERICAL DESCRIPTORS OF DATA.
Chap 3-1 A Course In Business Statistics, 4th © 2006 Prentice-Hall, Inc. A Course In Business Statistics 4 th Edition Chapter 3 Describing Data Using Numerical.
Appraisal and Its Application to Counseling COUN 550 Saint Joseph College For Class # 3 Copyright © 2005 by R. Halstead. All rights reserved.
Educational Research: Competencies for Analysis and Application, 9 th edition. Gay, Mills, & Airasian © 2009 Pearson Education, Inc. All rights reserved.
Measures of Central Tendency: The Mean, Median, and Mode
Basic Statistical Terms: Statistics: refers to the sample A means by which a set of data may be described and interpreted in a meaningful way. A method.
Describing Data Descriptive Statistics: Central Tendency and Variation.
BASIC STATISTICAL CONCEPTS Chapter Three. CHAPTER OBJECTIVES Scales of Measurement Measures of central tendency (mean, median, mode) Frequency distribution.
RESEARCH & DATA ANALYSIS
Edpsy 511 Exploratory Data Analysis Homework 1: Due 9/19.
INSTRUMENTATION QUESTIONNAIRE EDU 702 RESEARCH METHODOLOGY ZUBAIDAH ABDUL GHANI ( ) NORELA ELIAS ( ) ROSLINA AHMED TAJUDDIN ( )
Standardized Testing. Basic Terminology Evaluation: a judgment Measurement: a number Assessment: procedure to gather information.
Descriptive Statistics for one Variable. Variables and measurements A variable is a characteristic of an individual or object in which the researcher.
Educational Research: Data analysis and interpretation – 1 Descriptive statistics EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D.
Why do we analyze data?  To determine the extent to which the hypothesized relationship does or does not exist.  You need to find both the central tendency.
Educational Research Descriptive Statistics Chapter th edition Chapter th edition Gay and Airasian.
Applied Quantitative Analysis and Practices LECTURE#05 By Dr. Osman Sadiq Paracha.
Lecture 8 Data Analysis: Univariate Analysis and Data Description Research Methods and Statistics 1.
Chapter 3 Describing Data Using Numerical Measures
Numerical Measures: Centrality and Variability
Chapter 3 Describing Data Using Numerical Measures
Theme 4 Describing Variables Numerically
Presentation transcript:

Sampling (cont.) Instrumentation Measurement Plan Due 3/7

Sampling Demonstration

In Small Groups Check each others literature review and hypothesis of choice. –Do literature review, rationale, and hypothesis go together? –Offer constructive criticism-suggestions. Then, –Identify your Target population Accessible population –Sampling strategy Strengths Weaknesses

Instrumentation

Discuss Jared Diamond Soft Sciences are Often Harder than Hard Sciences

Instrumentation Instructions: Circle the choice that indicates your opinion. 1. Teachers’ unions should be abolished.Strongly agreeAgreeUndecidedDisagreedisagree (5)(4)(3)(2)(1) 2. School administrators should be required by law to teach at least one class in a public school classroom every year.Strongly agreeAgreeUndecidedDisagreedisagree (5)(4)(3)(2)(1) 3. Classroom teachers should be able to choose the administrators in their schools.Strongly agreeAgreeUndecidedDisagreedisagree (5)(4)(3)(2)(1)

What are Data? Data refers to the information researchers obtain on the subjects of their research. Demographic information or scores from a test are examples of data collected. The researcher has to determine what kind of data they need to collect. The device the researcher uses to collect data is called an instrument.

Key Questions The instruments and procedures used in collecting data is called instrumentation. Questions arise regarding the procedures and conditions under which the instruments will be administered: –Where will the data be collected? –When will the data be collected? –How often are the data to be collected? –Who is to collect the data? The most highly regarded types of instruments can provide useless data if administered incorrectly, by someone disliked by respondents, under noisy, inhospitable conditions, or when subjects are exhausted.

Validity, Reliability, and Objectivity Validity is an important consideration in the choice of an instrument to be used in a research investigation –It should measure what it is supposed to measure –Researchers want instruments that will allow them to make warranted conclusions about the characteristics of the subjects they study Reliability is another important consideration, since researchers want consistent results from instrumentation –Consistency gives researchers confidence that the results actually represent the achievement of the individuals involved Objectivity refers to the absence of subjective judgments

Usability An important consideration for any researcher in choosing or designing an instrument is how easy the instrument will actually be to use. Some of the questions asked which assess usability are: How long will it take to administer? Are the directions clear? How easy is it to score? Do equivalent forms exist? Have any problems been reported by others who used it? Getting satisfactory answers can save a researcher a lot of time and energy.

Ways to Classify Instruments Who Provides the Information? –Themselves: Self-report data –Directly or indirectly: from the subjects of the study –From informants (people who are knowledgeable about the subjects and provide this information)

Types of Researcher-completed Instruments Rating scales Interview schedules Tally sheets Flowcharts Performance checklists Observation forms

Types of Subject-completed Instruments Questionnaires Self-checklists Attitude scales Personality inventories Achievement/aptitude tests Performance tests Projective devices Sociometric devices

Scientific America Handwriting Analysis

Item Formats Questions used in a subject-completed instrument can take many forms but are classified as either selection or supply items. Examples of selection items are: True-false items Matching items Multiple choice items Interpretive exercises Examples of supply items are: Short answer items Essay questions

Unobtrusive Measures Many instruments require the cooperation of the respondent in one way or another. An intrusion into an ongoing activity could be involved which causes a form of negativity within the respondent. To eliminate this, researchers use unobtrusive measures, data collection procedure that involve no intrusion into the naturally occurring course of events. In most cases, no instrument is used, however, good record keeping is necessary. They are valuable as supplements to the use of interviews and questionnaires, often providing a useful way to corroborate what more traditional data sources reveal.

Types of Scores Quantitative data is reported in the form of scores Scores are reported as either raw or derived scores –Raw score is the initial score obtained Taken by itself, a raw score is difficult to interpret, since it has little meaning –Derived score are scores that have been taken from raw scores and standardized They enable researchers to say how well the individual performed compared to others taking the same test Examples include: –Age and Grade-level Equivalents –Percentile Ranks –Standard scores are mathematically derived scores having comparable meaning on different instruments

Examples of Raw Scores and Percentile Ranks N = 25 RawCumulativePercentile ScoreFrequencyFrequencyRank

Norm-Referenced vs. Criterion- Referenced Instruments All derived scores give meaning to individual scores by comparing them to the scores of a group. The group used to determine derived scores is called the norm group and the instruments that provide such scores are referred to as norm-referenced instruments. An alternative to the use of achievement or performance instruments is to use a criterion-referenced test. This is based on a specific goal or target (criterion) for each learner to achieve. The difference between the two tests is that the criterion referenced tests focus more directly on instruction.

Descriptive Statistics

Statistics vs. Parameters A parameter is a characteristic of a population. –It is a numerical or graphic way to summarize data obtained from the population A statistic is a characteristic of a sample. –It is a numerical or graphic way to summarize data obtained from a sample

Types of Numerical Data There are two fundamental types of numerical data: 1) Categorical data: obtained by determining the frequency of occurrences in each of several categories 2) Quantitative data: obtained by determining placement on a scale that indicates amount or degree

Techniques for Summarizing and Presenting Quantitative Data Visual –Frequency Distributions –Histograms –Stem and Leaf Plots –Distribution curves Numerical –Central Tendency –Variability

Summary Measures Central Tendency Arithmetic Mean Median Mode Summary Measures Variation Variance Standard Deviation Range

Measures of Central Tendency Central Tendency Average (Mean)MedianMode

Mean The most common measure of central tendency Affected by extreme values (outliers) Mean = 5Mean = 6

Median Robust measure of central tendency Not affected by extreme values In an Ordered array, median is the “middle” number –If n or N is odd, median is the middle number –If n or N is even, median is the average of the two middle numbers Median = 5

Mode A measure of central tendency Value that occurs most often Not affected by extreme values Used for either numerical or categorical data There may may be no mode There may be several modes Mode = No Mode

Variability Refers to the extent to which the scores on a quantitative variable in a distribution are spread out. The range represents the difference between the highest and lowest scores in a distribution. A five number summary reports the lowest, the first quartile, the median, the third quartile, and highest score. –Five number summaries are often portrayed graphically by the use of box plots.

Variance The Variance, s 2, represents the amount of variability of the data relative to their mean As shown below, the variance is the “average” of the squared deviations of the observations about their mean

Standard Deviation Considered the most useful index of variability. It is a single number that represents the spread of a distribution. If a distribution is normal, then the mean plus or minus 3 SD will encompass about 99% of all scores in the distribution.

Calculation of the Variance and Standard Deviation of a Distribution (Definitional formula) √ Raw ScoreMeanX – X(X – X) Variance (SD 2 ) = Σ(X – X) 2 N-1 = = Standard deviation (SD) = Σ(X – X) 2 N-1

Comparing Standard Deviations Mean = 15.5 S = Data B Data A Mean = 15.5 S = Mean = 15.5 S = 4.57 Data C

Facts about the Normal Distribution 50% of all the observations fall on each side of the mean. 68% of scores fall within 1 SD of the mean in a normal distribution. 27% of the observations fall between 1 and 2 SD from the mean. 99.7% of all scores fall within 3 SD of the mean. This is often referred to as the rule

The Normal Curve

Different Distributions Compared

Fifty Percent of All Scores in a Normal Curve Fall on Each Side of the Mean

Probabilities Under the Normal Curve

Standard Scores Standard scores use a common scale to indicate how an individual compares to other individuals in a group. The simplest form of a standard score is a Z score. A Z score expresses how far a raw score is from the mean in standard deviation units. Standard scores provide a better basis for comparing performance on different measures than do raw scores. A Probability is a percent stated in decimal form and refers to the likelihood of an event occurring. T scores are z scores expressed in a different form (z score x ).