Iowa’s MCH Data Capacity Assessment Breana Lipscomb Lucia Dhooge Debbie Kane.

Slides:



Advertisements
Similar presentations
The 21st Century Context for
Advertisements

What is an M and E Plan?. Organizing the Work of M and E An M and E System -- the 12 components as a whole – Sets out broad vision at national level An.
Anita M. Baker, Ed.D. Jamie Bassell Evaluation Services Program Evaluation Essentials Evaluation Support 2.0 Session 2 Bruner Foundation Rochester, New.
More CMM Part Two : Details.
Selecting the Right Evaluation Method. Objectives Why should we evaluate? Which activities should we evaluate? When should we evaluate? How should we.
Empowering Staff Through Institute Planning (ESTIP) Executive Workshop Institute Name: XXXXXX Presenter: XXXXXX Date: XXXXXX.
Comprehensive M&E Systems
Evaluation. Practical Evaluation Michael Quinn Patton.
UNDERSTANDING, PLANNING AND PREPARING FOR THE SCHOOL-WIDE EVALUATION TOOL (SET)
Columbia-Greene Community College The following presentation is a chronology of the College strategic planning process, plan and committee progress The.
Kansas Tobacco-Related Data Resources and Performance Measures Harlen Hays, MPH Office of Health Promotion, KDHE.
Purpose Program The purpose of this presentation is to clarify the process for conducting Student Learning Outcomes Assessment at the Program Level. At.
Web Analytics and Social Media Monitoring CAM Diploma in Digital Marketing (Metrics and Analytics) Assignment Briefing December 2013 & March 2014 Papers.
TIMELESS LEARNING POLICY & PRACTICE. JD HOYE President National Academy Foundation.
FORMATIVE EVALUATION Intermediate Injury Prevention Course August 23-26, 2011, Billings, MT.
Assessing Organizational Communication Quality
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
Cross Border Animal Health Plan of Action – Kenya and Uganda Four Strategic areas 1. To improve prevention, management and control of cross border animal.
CHAPTER 5 Infrastructure Components PART I. 2 ESGD5125 SEM II 2009/2010 Dr. Samy Abu Naser 2 Learning Objectives: To discuss: The need for SQA procedures.
Organization Mission Organizations That Use Evaluative Thinking Will Develop mission statements specific enough to provide a basis for goals and.
9 Closing the Project Teaching Strategies
Tool for Assessing Statistical Capacity (TASC) The development of TASC was sponsored by United States Agency for International Development.
Cognitive Interviewing for Question Evaluation Kristen Miller, Ph.D. National Center for Health Statistics
1 WRS Feedback Overview. 2 Agenda Introduction to WRS Assessment Feedback Report Developmental Planning Best Practices Summary/Wrap Up.
Applying the Principles of Prior Learning Assessment Debra A. Dagavarian Diane Holtzman Dennis Fotia.
1 Birth to 3 Child Outcomes Maryland’s Approach to Converting Assessment Data to OSEP Outcome Categories August 28, 2007 Deborah Metzger
Slide 1 D2.TCS.CL5.04. Subject Elements This unit comprises five Elements: 1.Define the need for tourism product research 2.Develop the research to be.
DrugEpi 1-4 Counting HS Marijuana Use Module 1 Overview Context Content Area: Descriptive Epidemiology & Surveillance Essential Question (Generic): How.
Week 8: Research Methods: Qualitative Research 1.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 10, 2011.
1 What are Monitoring and Evaluation? How do we think about M&E in the context of the LAM Project?
© 2015 Cengage Learning. All Rights Reserved. May not be scanned, copied or duplicated, or posted to a publicly accessible website, in whole or in part.
Monica Ballay Data Triangulation: Measuring Implementation of SPDG Focus Areas.
EVALUATION RESEARCH. Evaluation Research  How do we begin?  What are the different types of evaluation research?  How do these different types fit.
Introducing QI Tools and Approaches Whole-Site Training Approach APPENDIX F Session C Facilitative Supervision for Quality Improvement Curriculum 2008.
INTERNATIONAL SOCIETY FOR TECHNOLOGY IN EDUCATION working together to improve education with technology Using Evidence for Educational Technology Success.
Copyright 2010, The World Bank Group. All Rights Reserved. Development of Training and Procedural Manuals Section A 1.
Report on the Evaluation Function Evaluation Office.
 How do we begin?  What are the different types of evaluation research?  How do these different types fit together?  What purpose do they serve?
Director of Evaluation and Accountability Manager, UW’s Grand Rapids, Michigan Robert McKown, CIRS Director of Evaluation and Accountability Sherri.
Usage MCH data for develop MCH System in the region Dr.Chollatit Urairoekkun.
© 2012 Cengage Learning. All Rights Reserved. This edition is intended for use outside of the U.S. only, with content that may be different from the U.S.
United Nations Statistics Division Registry of national Classifications.
1. Housekeeping Items June 8 th and 9 th put on calendar for 2 nd round of Iowa Core ***Shenandoah participants*** Module 6 training on March 24 th will.
Quality Assessment July 31, 2006 Informing Practice.
Building and Recognizing Quality School Systems DISTRICT ACCREDITATION © 2010 AdvancED.
Slide 1 Requirements Determination Chapter 5. Slide 2 Objectives ■ Understand how to create a requirements definition. ■ Become familiar with requirements.
Public Health Performance Standards District System Assessment Karen O’Rourke, MPH Joan Orr, CHES 2009.
United Nations Regional Seminar on Census Data Dissemination and Spatial Analysis for Arabic Speaking Countries, Amman, Jordan May 2011 Identification.
The Major Steps of a Public Health Evaluation 1. Engage Stakeholders 2. Describe the program 3. Focus on the evaluation design 4. Gather credible evidence.
Strategies for Managing the Online Workload CADE 2003 St. John’s Newfoundland June, 2003.
Behavioral and Emotional Rating Scale - 2 Understanding and Sharing BERS-2 Information and Scoring with Parents, Caregivers and Youth May 1, 2012.
1 The United Nations Demographic Yearbook and the Work Programme for Social Statistics Expert Group Meeting to Review the United Nations Demographic Yearbook.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 24, 2009.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Copyright 2010, The World Bank Group. All Rights Reserved. Recommended Tabulations and Dissemination Section B.
Program Evaluation Principles and Applications PAS 2010.
Prepared by: Forging a Comprehensive Initiative to Improve Birth Outcomes and Reduce Infant Mortality in [State] Adapted from AMCHP Birth Outcomes Compendium.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Technology Transfer: Guidelines UC Berkeley Global Health Research Orientation Spring 2011.
1. 2 Issues in the Design and Testing of Business Survey Questionnaires: Diane K. Willimack U.S. Census Bureau Economic Census The International.
Power Point Slides by Ronald J. Shope in collaboration with John W. Creswell Chapter 13 Survey Designs.
Week 2: Interviews. Definition and Types  What is an interview? Conversation with a purpose  Types of interviews 1. Unstructured 2. Structured 3. Focus.
Component D: Activity D.3: Surveys Department EU Twinning Project.
Improved socio-economic services for a more social microfinance.
MEASURE Evaluation Data Quality Assurance Workshop Session 3 Introduction to Routine Data Quality Assessment.
Monitoring and Evaluation Systems for NARS organizations in Papua New Guinea Day 4. Session 10. Evaluation.
Monitoring and Evaluation Systems for NARS Organisations in Papua New Guinea Day 3. Session 9. Periodic data collection methods.
Evaluating ESD in RCEs: The Start-up Tools
Krista Jackson AET/570 May 23, 2016 Professor Dlabach
Presentation transcript:

Iowa’s MCH Data Capacity Assessment Breana Lipscomb Lucia Dhooge Debbie Kane

Session Objectives To describe: –The history & context of the MCH Data Capacity Assessment –The survey development –How to conduct an assessment –The results and how to use the results

This Presentation We’ll be conversational You can ask questions at any time You’ll learn about our results and insights You’ll learn how to do the assessment in your state

Evolution of Iowa’s MCH Data Capacity Assessment How it beganHow it began How it evolvedHow it evolved urrent statusCurrent status

Key Question to be Answered What is “capacity” of data systems? Our Question: Do Iowa’s data systems furnish state and local MCH entities with needed data?

The Connection with Iowa SSDI SSDI Objectives Data Integration Steering Committee (DISC) MCH Data Integration Team

Iowa’s Results

Results 2005 Assessment –Sample size of 15 –Response rate 93% 2007 Assessment –Sample size of 14 –Response rate 100%

Assessment Results 2005 – 2007 Improvements to database access –Organization has access to data 70% to 80% –Defined parameter use 80% to 100%

Assessment Results 2005 – 2007 Improvements to data dissemination –Local presentations 40% to 50% –National or regional presentations 20% to 40%

Assessment Results ( ) Improvements to data use Billing –0% to 30% Surveillance –77.8% to 80% Program planning –87.5% to 100% Program evaluation –87.5% to 90%

Assessment Results (2005 – 2007) Learning need addressed GIS learning needs –Skill needed remained the same –Increased staff –Staff capability adequate SSDI –Link programs to trained staff –Training

Assessment Results ( ) Identified learning needs Survey design –Need doubled –Less staff –Staff at least adequate Surveillance –Need increased by 60% –Staff has limited availability –Yes, but…

Assessment Results ( ) Identified learning needs Linking data –Increased need –Staff has limited availability –Staff at least adequate

Results (2007) Data Linkage How many 8 of 14 data sets linked Link with 1-3 new data sets –What comprised the linkages? Medicaid claims data Vital records

Results (2007) Data Linkage Linkage trigger –Majority are routine Linkage frequency –Wide variation Method –Deterministic

Results (2007) Data Linkage Linkage process –Wide variation Elements gained by linkage –Demographics –Maternal behaviors during pregnancy –Infant outcomes

Here’s How You Can Do It!

Step One: Develop Survey Tool MCH EPI Team adapted the CSTE Assessment and Monitoring Tool for MCH Epidemiology and Data Capacity Iowa “personalized” MCH EPI tool 2007 – Iowa revised tool based on 2005 lessons learned

Survey development Expanded Data Linkage section –Frequency –Method –Data Gained –Overall Benefit

Survey development Removed Staff Retention section Removed Population section Added Potential Use section

Survey development Separated Program and Policy Use sections Clarified Key Terms and Concepts –Linkage –Deterministic/Probabilistic

Step Two: Select Databases Which databases are relevant to MCH? Which databases do you want information about? Which persons are most knowledgeable about the databases?

Step Three: Determine Data Collection Method Interview or Written Response Points to Consider –Number of databases –Time to collect data –Relationship building –Learning aspect

Step Four: Request Interviews Release preliminary announcement Schedule interview Prepare assessment tool

Step Five: Conduct Interviews Explain purpose of the assessment Allow adequate time Probe for more detail Permit interviewee to speak freely

Step Six: Review Responses Transcribed interview into electronic format –Each interview was saved as separate file Follow up on any discrepancies or missing information

Step Seven: Crunch the Numbers Determine best method for counting responses –Tallying –Using a statistical program –Using Excel

Crunch the Numbers Statistical Software: SPSS –Create code book Provides special abbreviated name for each question in the tool Enter codes/abbreviations into SPSS –Enter quantitative interview responses –Run frequency tests

Step Eight: So What? Strengthen areas of weakness Build capacity of all participants

Strengthen Areas of Weakness 1.Look at number crunches 2.Decide on area(s) of focus 3.Make a plan/timeline 4.Follow through

Building Participant Capacity They learn as they ask/answer questions They learn as they receive feedback They learn as they plan follow-through They learn!

You Can Do It!

Questions?

Questions Later? Lucia Dhooge

…and we are making a difference.