1. OJJDP Performance Measurement Training 1 Presented by: Dr. Kimberly Kempf-Leonard School of Social Sciences University of Texas at Dallas kleonard@utdallas.edu Program monitoring & tracking: Research design issues

2. OJJDP Performance Measurement Training 2 Purposes Quality Control Tracking of Subjects Measuring Variables

3. OJJDP Performance Measurement Training 3 Why are we doing this? Monitoring & Assessment Improve our juvenile justice system Convince other systems they can benefit from what we’ve done Describe… Explain… Evaluate… Predict…

4. OJJDP Performance Measurement Training 4 Quality Control of Output & Outcome measures Add a time dimension to data collection longitudinal data (6-12 months follow-up) Precise measures Reliable measures Valid measures Generalizable measures

5. OJJDP Performance Measurement Training 5 What does tracking & Follow-Up mean?

6. OJJDP Performance Measurement Training 6 Time-related problems with Subjects “Creaming” Attrition or “Mortality” Solution: assure sample represents total –Know characteristics of those missing

7. OJJDP Performance Measurement Training 7 Do you work with this system?

8. OJJDP Performance Measurement Training 8 Clear, relevant variables Consistency in measurement both times Representative subjects –Same subjects –sample chosen same way both times –Explain any attrition Simple data collection instrument

9. OJJDP Performance Measurement Training 9 What types of data are collected in longitudinal designs? All types! –Surveys (trends: multiple “waves” of cross-sectional designs) –Participant observation –Archival records –Experiments –Content analysis –Secondary data & primary data from a “follow-up”

10. OJJDP Performance Measurement Training 10