TGYS Data Interpretation and Reporting Results. Objectives Gain Confidence Apply your Knowledge Make Connections.

Slides:



Advertisements
Similar presentations
Data Collection Strategies An Overview. How Do We Assess ?
Advertisements

Evaluation Capacity Building Identifying and Addressing the Fields Needs.
Evaluation for 1st Year Grantees Shelly Potts, Ph.D. Arizona State University
501: The Employee Performance Review Process. The Pennsylvania Child Welfare Resource Center Learning Objectives Learning Objectives: Participant will.
Howard R. Mzumara Ranjita D. Shinde Denise L. Czachura IUPUI Testing Center 1 Presentation given at the IMLS/IUPUI Steering Committee Meeting at IUPUI,
Strengthening Families through Early Care and Education Columbia, SC October 14, 2006.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Using Statistics in Research Psych 231: Research Methods in Psychology.
Experimental Research
Planning for Sustainability: Framework and Process LifeSkills Training Webinar Series October 27, 2010.
Between the Lions Preschool Literacy Project Evaluation Results
Dr. Albrecht Research Team EXAMPLE of EVALUATIO N RESEARCH SERVICE LEARNING
Two Sample Tests Ho Ho Ha Ha TEST FOR EQUAL VARIANCES
Research and Evaluation Center Jeffrey A. Butts John Jay College of Criminal Justice City University of New York August 7, 2012 How Researchers Generate.
Board of Advisors Roadmap. A few trends… TIMELINE Direct Your Internal CII Team 3 Years Basic Member Established Member Leading Member Upon Joining Establish.
Legal Perspectives May 19, 2014 Jay Fox Regional Counsel FTA Region III.
What Works in Multi-Site Evaluations of Nutrition Education Interventions? Andy Fourney, Andrew Bellow, Patrick Mitchell, Sharon Sugerman, Angie Keihner.
Experiment Basics: Variables Psych 231: Research Methods in Psychology.
T tests comparing two means t tests comparing two means.
Chapter 9 Hypothesis Testing and Estimation for Two Population Parameters.
Old.libqual.org What will ARL do for you? What will you do? January 2005 Shrivenham, UK.
Introduction to Evaluation Peter Chen, PhD Julie Gibbs, BSW Julie Maertens, MS Julie Sampson, MS Stefanie Putter, BA.
Exploring the SF-36, V2: Measuring the Quality of Life of AgrAbility Program Participants Ronald C. Jester Robert A. Wilson University of Delaware National.
TGYS Orientation Day Get ready for evaluation!. ROADMAP TGYS Goals Reasons for Evaluation Evaluation Plans Design Measurement Data Collection Timelines.
Planning for Success Module Eight. Reflecting on the Previous Session What was most useful from the previous session? What progress have you made since.
Statistics and Data Analysis Process Section 1.3.
Assisting GPRA Report for MSP Xiaodong Zhang, Westat MSP Regional Conference Miami, January 7-9, 2008.
Statistics Psych 231: Research Methods in Psychology.
Quality Activity Matrix Presented by Sandra Toalston President, SanSeek 1.
Logical Logic Models Youth Emphasis Wisline Web October 3, :00 am Rene Mehlberg and Ellen Taylor-Powell.
Statistics (cont.) Psych 231: Research Methods in Psychology.
LibQUAL+™ Process Management: Using the Web as a Management Tool Amy Hoseth Massachusetts LSTA Orientation Meeting Boston, MA October 21, 2005 old.libqual.org.
CHAPTER 11 SECTION 2 Inference for Relationships.
Copyright 2010, The World Bank Group. All Rights Reserved. Reducing Non-Response Section B 1.
Evaluation Designs Adrienne DiTommaso, MPA, CNCS Office of Research and Evaluation.
The Comprehensive School Counseling Program and Career Clusters/Pathways August 2008 Judith Kuse, School Counseling Consultant Barbara Bitters, Assistant.
Evaluating Impacts of MSP Grants Ellen Bobronnikov January 6, 2009 Common Issues and Potential Solutions.
Authentic Discovery Projects in Statistics GCTM Conference October 16, 2009 Dianna Spence NGCSU Math/CS Dept, Dahlonega, GA.
Storyboarding Water Properties Nora Egan Demers Joanna Salapska-Gelleri.
SENG Software Life Cycles1 Exercise 2 – Management Guide As a group fill in the Management Guide template provided First decide on your roles as.
Chapter Eight Questionnaire Design Chapter Eight.
You Can’t Afford to be Late!
E mployee Opinion S urvey Accessing and Understanding Your Results.
CSU Evaluation Team: How to prepare your evaluation plan.
Related Sample t-test A related sample t-test is used when participants in the two groups are not independent of participants in the other groups. – Repeated.
The Evaluation Matrix: When & Where & Who & How Thomas Shuster, Ph.D. Todd Braeger, M.S. Spectrum Consulting / Safe Food Institute 1770 North Research.
Action planning and evaluation How to apply workshop learning and action points to deepen that learning further Identify and plan next steps for post-
Lesson 12 - R Review of Chapter 12 Significance Tests in Practice.
Statistics (cont.) Psych 231: Research Methods in Psychology.
LibQUAL+ ® Survey Results Presented by: Martha Kyrillidou Senior Director, Statistics and Service Quality Programs Association of Research.
Smartxt Universal Learning Project Presented by Stacey Kayden Stacey has been a High Tech Learning Specialist at Laney College in Oakland California since.
TGYS Data Collection Overview. DATA COLLECTION It’s “FUN”damental! Electronic Surveys Paper Surveys Collecting Useful Data Data Management TGYS Data Deadlines.
Inferential Statistics Psych 231: Research Methods in Psychology.
I NTRODUCTION TO E VALUATION CSU Evaluation Team.
Planning a Customer Survey Part 1 of 3 Elaine Carlson, Westat Anne D’Agostino, Compass Evaluation & Research.
YOUTHBUILD USA MENTEE ORIENTATION & TRAINING Session 4: Mentoring strategies and supports 1 [Insert your program’s name, city/state, logo]
STANDARDIZED TESTING Understanding the Vocabulary.
Developing a Monitoring & Evaluation Plan MEASURE Evaluation.
Talent Match What is Talent Match? £100million Big Lottery Funded Young People’s employment initiative Aimed at finding creative ways to support.
You Can’t Afford to be Late!
Primary Prevention Institute
Community program evaluation school
Recruiting Youth to Your Mentoring Program
Recruiting Youth to Your Mentoring Program
Troubleshooting Logic Models
Proposal Development Support & Planning
Just around the corner are your GCSEs
CPD made clear.
Presentation transcript:

TGYS Data Interpretation and Reporting Results

Objectives Gain Confidence Apply your Knowledge Make Connections

Roadmap  Program evaluation review  Discussion of your data:  Desired evaluation results  Factors affecting your results  Comparison data  Next steps

Program Evaluation Cycle 1.Create logic model 2.Decide on a design 3.Pick measurement tool 4.Data analysis 5.Data reporting & reflection

Evaluation Terms Sample/Sample Size Scale/Measure Subscale Mean Comparison/Aggregate Data Norms

Statistical Terms T-test P-value p<.05 Effect Size

Effect Size Benchmarks <.20 = small = moderate = large

Example = Pre-Tests: 55 Post-Tests: 38Matched tests: 38

Sample Data Report

Potential Influences Tracking Data Management AttritionConfidentialityYour Sample

Participant Tracking

Data Management Fill in bubbles completely with pencil Fill in the entire administrative section Don’t use photocopies

Comparison Data  How does your agency compare to other TGYS grantees?  Are you surprised by these differences?  Would you expect these differences?

Results Justification Results People Effects Program Effects

Next Steps  Discuss results with key staff  Learn from other grantees  Contact your TGYS technical evaluator

CSU team contact information: Julie Maertens: Polly Todd: You can also check out our website!website