Work Session 1 Locating Baseline Data Office of Research, Evaluation and Policy Studies Ximena D. Burgin, Ed.D. November 30 th, 2010
Databases Restricted Databases Public Databases Commercial Databases Your Own
Restricted Databases: Institute of Education Sciences (IES): Assessments Early Childhood Elementary / Secondary International Library Postsecondary
Public Databases: Illinois Interactive Report Card (IIRC):
Commercial Databases: Survey of Enacted Curriculum
Commercial Databases: California Critical Thinking Skills Survey
Your own: Alcohol, Tobacco, and Other Drug (ATOD)
Data Collection Techniques to collect data Observations Interviews Questionnaires (open- ended questions) Documents Audiovisual materials Qualitative Exploration of the unknown. Understanding of a central phenomena. Quantitative Trends or explanation of relationships among variables.
Data Analysis Textual analysis (Qualitative) Perform preliminary exploratory analysis Code the data Create themes Summarize findings (choose narrative discussion) Statistical analysis (Quantitative) Descriptive statistics Inferential statistics
Sample of ATOD Survey Questions
Validity “Whether an instrument measures what it is suppose to measure” Appropriateness, correctness, meaningfulness, and usefulness of the specific inferences made from data
Reliability Consistency of scores obtained from individuals Are results repeatable from one administration of instrument to another?
Validity and reliability
Assessing reliability Test-retest reliability Alternate (Parallel) forms reliability Alternate (Parallel) forms & test-retest reliability Internal consistency reliability Inter-Rater or Inter-Observer reliability
Internal consistency reliability
Inferential statistics Generalizing from samples to populations