Longitudinal Studies The ultimate Goal for many extension faculty is to implement programs that result in permanent, positive change in human social behavior.

Slides:



Advertisements
Similar presentations
What randomized trials have taught us about what works and doesn’t work in education Jon Baron Coalition for Evidence-Based Policy December 9, 2003.
Advertisements

Research Insights from the Family Home Program: An Adaptation of the Teaching-Family Model at Boys Town Daniel L. Daly and Ronald W. Thompson EUSARF 2014/
1 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt 10 pt 15 pt 20 pt 25 pt 5 pt Transition.
Strengthening Diversity in the Mental Health Workforce: A Driver for System Change 7 th International Conference on Social Work Los Angeles June 24, 2013.
What do we know about effective preschool programs? Steve Barnett, PhD.
How Northern Ireland Can Get Lasting Returns on Preschool Investment: A Tale of Two Studies Larry Schweinhart, Ph.D. President, HighScope Educational Research.
Teaming Up for Student Success in Today’s Middle Schools Teresa T. Bagwell University of Louisiana at Lafayette
Academic Excellence Indicator System (AEIS) Report Presented to ACISD Board of Trustees 12/15/2011 ARANSAS COUNTY ISD – A TEA RECOGNIZED SCHOOL.
Comprehensive Needs Assessment Phase II Gather and Analyze Data Gather and Analyze Data.
Women, Minorities, and Technology Jacquelynne Eccles (PI), Pamela Davis-Kean (co-PI), and Oksana Malanchuk University of Michigan.
Washington State Prevention Summit Analyzing and Preparing Data for Outcome-Based Evaluation Using the Assigned Measures and the PBPS Outcomes Report.
Experiments Types of Experiments Laboratory Experiments Experiments of short term duration and usually conducted in a lab under very controlled conditions.
Common Errors in Data Collection. Purpose of this Presentation  To point out the importance of accurate, consistent data collection  To illustrate trends.
Presented by Margaret Shandorf
Develop Systematic processes Mission Performance Criteria Feedback for Quality Assurance Assessment: Collection, Analysis of Evidence Evaluation: Interpretation.
Evaluation of Math-Science Partnership Projects (or how to find out if you’re really getting your money’s worth)
Inferential Statistics
1 Types and Sources of Data UAPP 702 Research Methods for Urban & Public Policy Based on notes by Steven W. Peuquet, Ph.D.
Ten Year Longitudinal Study of Adolescent Mothers and their Children Catholic Family Service of Calgary Louise Dean Centre Holly Charles & Brenda Simpson.
Assessment Surveys July 22, 2004 Chancellor’s Meeting.
Community Input Discussions: Measuring the Progress of Young Children in Massachusetts August 2009.
ABSTRACT Key Terms: Parent involvement, Common Core State Standards, Homework, K – 2 Mathematics In this study, the 2015 REU mathematics team from Elizabeth.
EVIDENCE BASED PROGRAMS Dr. Carol AlbrechtUtah State Extension Assessment
Dr. Albrecht Research Team EXAMPLE of EVALUATIO N RESEARCH SERVICE LEARNING
Vision To be the collaborative voice and catalyst for adolescent wellness in Santa Cruz County To promote adolescent wellness through advocacy, education.
Participant Observation Purpose  Observe Human Social Behavior. Often used to observe behavior over time.  This data collection technique is used when.
A Benefit Cost Analysis of Early Childhood Intervention By Jenny Yaillen And Nate Blair.
Economics of Investments in Early Childhood Development Paris, France June 22, 2010 Steve Barnett, PhD.
1 Evaluation of Harris County Systems of Hope: Climate and/or Environmental Influences on Youth- Baseline Educational Characteristics of Participants Systems.
6. Implications for Analysis: Data Content. 1 Prerequisites Recommended modules to complete before viewing this module  1. Introduction to the NLTS2.
Assisting Students with Disabilities
8.Implications for Analysis: School Survey, Student Assessment, and Transcript Data.
Civic and Citizenship Education in Times of Change: Curriculum and its Implementation Some Results of the IEA Studies Civic Education in Iraq: Study Tour.
Start at the Beginning How do we collect information to answer questions?
EVALUATION RESEARCH. Evaluation Research  How do we begin?  What are the different types of evaluation research?  How do these different types fit.
© 2009 The McGraw-Hill Companies, Inc. All Rights Reserved Chapter One Child Development: Themes, Theories, and Methods Page 3 (right)
NC LINKS Construction Tips National Governor’s Association Center for Best Practices October 27-28, 2005 Tampa, Florida.
1 Results for Students with Disabilities and School Year Data Report for the RSE-TASC Statewide Meeting May 2010.
EARLYCHILDHOOD PROGRAMS AN EFFECTIVE INVESTMENT FOR THE FUTURE.
 How do we begin?  What are the different types of evaluation research?  How do these different types fit together?  What purpose do they serve?
National Consortium On Deaf-Blindness Families Technical Assistance Information Services and Dissemination Personnel Training State Projects.
1 Economics of Early Education Benefits and Costs of Quality Early Education for All Presentation to the Pre-Kindergarten Education Study Committee Vermont.
Benefit-Cost Analysis of Preschool Education W. Steven Barnett, Ph.D. Director, National Institute for Early Education Research Rutgers—The State University.
Dr. Carol Albrecht Research Team EXAMPLE of EVALUATION RESEARCH.
We worry about what a child will be tomorrow, yet we forget that he is someone today. --Stacia Tauscher.
West Central Community School District Performance Document: Formative Evaluation Tool By John Johnson ortheast Iowa Charter School Northeast Charter School.
Midwest Evaluation of the Adult Functioning of Former Foster Youth: Outcomes at Age 19 Chapin Hall Center for Children University of Chicago.
Georgia Energy and Industrial Construction Consortium Membership Meeting October 13, Georgia’s workforce pipeline 2.What is the problem? 3.Where.
(c) 2007 McGraw-Hill Higher Education. All rights reserved. Accountability and Teacher Evaluation Chapter 14.
Steps to the Evaluation Research Process Step 1 – Identify Objectives Step 2 - Formulate Research Questions Based on Those Objectives Step 3 – Operationalize.
The Kirkpatrick Model organizational change Richard Lambert, Ph.D.
1-2 Training of Process Facilitators Training of Process Facilitators To learn how to explain the Communities That Care process and the research.
Considerations Related to Setting Targets for Child Outcomes.
SECONDARY DATA Census Data Historical Documents Old Newspapers Data Collected by State or National Government Data Collected by Colleagues.
Cumberland County Schools Transition. Indicator 1 Graduation Percent of youth with IEPs graduating from high school with a regular diploma is.
Behavioral and Emotional Rating Scale - 2 Parents, Caregivers and Youth Information on BERS-2 Parent Rating Scale April 13, 2012.
Chapter 2 The Assessment Process. Two Types of Decisions Legal Decisions The student is determined to have a disability. The disability has an adverse.
Sociocultural Influences Related to Language, Cognition, and Social Emotional Developmental Relationships Presenters: Kimberly Sharkins & Dr. James Ernest.
So You Think You’ve Made a Change? Developing Indicators and Selecting Measurement Tools Chad Higgins, Ph.D. Allison Nichols, Ed.D.
School Readiness Symposium W. Steven Barnett, Director National Institute for Early Education Research Presentation November 12, 2002.
Foster Care Alumni An overlooked student population in higher education Sheila Bustillos Reynolds & Amanda Clay.
NAEP What is it? What can I do with it? Kate Beattie MN NAEP State Coordinator MN Dept of Education This session will describe what the National Assessment.
School Counseling Program Freshman Academic Support Grroup (Results sample)
Educationally Based Psychological Services
Post-Secondary Transition
Measuring College and Career Readiness
Does Preschool Education Do More Harm Than Good?
Post-Secondary Transition
Inequality Starts Before Kindergarten
Practical Considerations in Using Data
Presentation transcript:

Longitudinal Studies The ultimate Goal for many extension faculty is to implement programs that result in permanent, positive change in human social behavior. There is one tool that must be utilized if you are to accomplish this goal. This is a longitudinal study. ONLY longitudinal studies can help you determine if changes are persistent across time, maturation and other environmental factors.

Longitudinal Studies Purpose To show trends across time (i.e., as children attend school, they become increasingly competent in their social skills.) To document change in individual behavior and/or attitudes across time (i.e., Fred gets smarter as he gets older.) To compare individuals across time. (i.e., Girls do relatively well to boys in school, and the academic gap increases across time.)

Secondary Longitudinal Data Sets There are a number of national longitudinal data sets that researchers may access. Some of the ones that may be of interest to 4-H and extension faculty include: National Longitudinal Survey of Youth Adolescent Health Data Set Panel Study of Income Dynamics

Surveys, Case Studies and Longitudinal Studies Texas Service Learning Study as an Example Texas Service Learning Study as an Example Case Studies Different Service Learning Schools were selected. Each year for several years, numerous aspects of their programs were studied. The sensitizing concept was “impact” of service learning on students across time. Service learning materials were collected from teachers. Teachers and students were surveys. Comparisons were made across schools and across times. Surveys A random sample was drawn, and surveys were constructed. Students were surveyed while in first, second, third, fourth and fifth grades. With minor modifications, the same survey was administered every year. Results were then compared across time to determine if participation in Service Learning may have a cumulative impact across time.

Example of a FAMOUS Longitudinal Field Trial  The Perry Preschool Field Experiment/Trial  In the 1960s, low income children in the US went to Head Start.  Studies were done to evaluate the program. First researchers compared the IQ scores of the Head Start group to a control group. See the following slide for the results.  Parents and researchers felt IQ was not a good and valid indicators of the impact of Head Start. A consortium of researchers selected small subgroup of Head Start students and compared them to a control group over 19 years. See slide 7.  Once they evaluated the program, they calculated the savings, to the government, of Head Start. See slide 8. Field Trials or Experiments

IQ The Head Start Program - A Famous Field Experiment

Experiments and Longitudinal Studies Field Trials or Experiments Field Trials or Experiments The following slide shows the results of this longitudinal study when students reach the age of 19. These same academic and social success indicators measured actual behavior and continued to be tracked over their lifetime. The indicators included: Arrest rates Pregnancy rates Various measures of school success and advancement (i.e., grade advancement, graduation rates etc.,) Employment rates Crime rates

Schooling Success High School Graduation or GED College or Vocation Functional Competence Classified as Mentally Retarded Years in Special Education School Responsibility Detained or Arrested Teen Pregnancy Socioeconomic Success Employed Received Welfare Slide 9

Experiments and Longitudinal Studies The Perry Preschool Program The Perry Preschool Program The Control and Experimental Groups were compared on these indicators across time (i.e., academic success was compared across these groups across time to see if the difference noted in the first years decreased, increased or remained the same across time). The indicators were compared across time for the Experimental Group (i.e., academic success was compared across time to see if the “impact” of going to preschool decreased with time).

Policy Implications This study had tremendous policy implications. The group (e.g., The Perry Preschool Program) was part of the Head Start Program. Partly, as a result of this research, Head Start continues to receive support and resources from the federal government to educate low- income preschool children.

Strengthens and Weaknesses of Longitudinal Data Strengths  Allows you to assess the persistence of impacts across time and place.  Allows you to assess how time, maturation and other environmental factors can influence impacts across time. Weaknesses  Time consuming  Expensive  Attrition rates over time can lead to same sample sizes

Power Point Created by: Dr. Carol Albrecht usu.edu For More Information Contact: Assessment Specialist USU Extension