1 Interpretation and use. 2 The walls inside are plastered with laboriously made graphs…

Slides:



Advertisements
Similar presentations
Focusing an Evaluation Ben Silliman, Youth Development Specialist NC 4-H Youth Development.
Advertisements

Polio Communication Indicators Reflections from Polio Communication TAG/Review Process.
Introduction to Monitoring and Evaluation
Donald T. Simeon Caribbean Health Research Council
Follow-up after training and supportive supervision The IMAI District Coordinator Course.
Ensuring Informed and Voluntary Decision Making MODULE 4 Facilitative Supervision for Quality Improvement Curriculum 2008.
Neighbor to Neighbor Lessons learned from a community- based HIV testing partnership: The HIV Minority Community Health Partnership Presented at American.
Data Processing Topic 4 Health Management Information Systems João Carlos de Timóteo Mavimbe Oslo, April 2007.
Funded by HRSA HIV/AIDS Bureau Selecting an Indicator & Collecting Performance Data Barbara M Rosa, RN-C, MS.
Using Information for Health Management; Part I
IPDET Lunch Presentation Series Equity-focused evaluation: Opportunities and challenges Michael Bamberger June 27,
Monitoring and Evaluation Frameworks Kyiv, Ukraine May 23, 2006 MEASURE Evaluation.
Monitoring and Evaluation: Tuberculosis Control Programs
An Introduction to Monitoring and Evaluation for National TB Programs.
Introduction to Monitoring and Evaluation for National TB Programs 20 September 2005.
Indicators, Data Sources, and Data Quality for TB M&E
Monitoring and Evaluation Frameworks   What is an M&E Framework?   Why do we use M&E Frameworks?   How do we develop M&E Frameworks? MEASURE Evaluation.
What is H(M)IS?. Purpose of HIS “is to produce relevant information that health system stakeholders can use for making transparent and evidence-based.
Evaluation. Practical Evaluation Michael Quinn Patton.
Presenting information
Information Cycle Data Handling in Information Cycle: Collection and Collation University of Oslo Department of Informatics Oslo Facilitator: Gertrudes.
Module 3: Final Case Study # 3-CS-1. Case Study: Instructions v Try this case study individually. v We’ll discuss the answers in class. # 3-CS-2.
Module 10: Understanding Laboratory Data *Image courtesy of: World Lung Foundation.
Evaluation of family planning program
Creating a service Idea. Creating a service Networking / consultation Identify the need Find funding Create a project plan Business Plan.
HIV Patient ART Monitoring Meeting: International Conference Centre, Geneva March 2004 Defining the variables.
RESEARCH A systematic quest for undiscovered truth A way of thinking
1 Presenting information communicating meaning Health Management Information Systems João Carlos de Timóteo Mavimbe Oslo, April 2007.
Sina Keshavaarz M.D Public Health &Preventive Medicine Measuring level of performance & sustaining improvement.
District Health Information Systems
Action Plan Good Health Situation of Population in Capital of Myanmar Yangon Division By DR MYA THIDA AYE.
1 What are Monitoring and Evaluation? How do we think about M&E in the context of the LAM Project?
OPERATING ROOM DASHBOARD Virginia Chard, RN, BSN, CNOR
Unit 10. Monitoring and evaluation
PISA OECD Programme for International Student Assessment PISA for Development Andreas Schleicher Paris, 27 June 2013 Welcome PISA for Development Andreas.
1 Data analysis. 2 Turning data into information.
Using Information for Health Management; Part II - Health Information Systems Strengthening.
Primer on Monitoring and Evaluation. The 3 Pillars of Monitoring and Evaluation  Identifying the Performance Indicators  Collecting information using.
Unit 3: Universal Case Reporting and Sentinel Surveillance for STIs
W HAT IS M&E  Day-to-day follow up of activities during implementation to measure progress and identify deviations  Monitoring is the routine and systematic.
Indicators for ACSM.
H.M.I.S. HEALTH MANAGEMENT INFORMATION SYSTEM. HMIS A System that provides specific INFORMATION SUPPORT to the DECISION MAKING process at each Level of.
Using Information for Health Management; Part II - Health Information Systems Strengthening.
Assuring Safety for Clinical Techniques and Procedures MODULE 5 Facilitative Supervision for Quality Improvement Curriculum 2008.
DASHBOARD MONITORING: STATE SCORE CARD MSG STRATEGIC CONSULTING PVT. LTD.
World Health Organization Regional Office for the Eastern Mediterranean The use of gender sensitive indicators in health policy making, monitoring, and.
What is Research ? Research Methodology CHP400:
Using Information for Health Management; Part II - Health Information Systems Strengthening.
Data quality: adapted from a presentation given by Mr. B Sikhakhane, Gauteng.
Module 8: Monitoring and Evaluation Gap Analysis and Intervention Plans.
Consultant Advance Research Team. Outline UNDERSTANDING M&E DATA NEEDS PEOPLE, PARTNERSHIP AND PLANNING 1.Organizational structures with HIV M&E functions.
Monitoring and Evaluation in MCH Programs and Projects MCH in Developing Countries Feb 9, 2012.
Data Collection. Data and information Data –observations and measurements Processed data (information) –facts extracted from a set of data (interpreted.
A. Maternal Mortality Reduction in Honduras, B. Maternal Health Indicators Jerker Liljestrand The World Bank.
INTRODUCTION TO INFORMATION SYSTEMS FOR IMMUNIZATION SERVICES IPV Global Workshop March 2014.
Dr. Muhammad Razzaq Malik. Management Information system.
Session 2: Developing a Comprehensive M&E Work Plan.
STOCK MANAGEMENT, INVENTORY AND ACCOUNTABILITY STANDARDS: WHAT WE HAVE LEARNT, GOOD PRACTICE STANDARDS.
Session 5: Selecting and Operationalizing Indicators.
Endris Mohammed Seid 1,2, Arjanne Rietsema 1 1: CORDAID-Zimbabwe 2: Ministry of Health and Child Care- Zimbabwe Improving Maternal, Neonatal and Child.
بسم الله الرحمن الرحيم Community Medicine Lec -11-
Definition of indicators Facilitators’ Workshop on District Health Performance Improvement Lilongwe, 25 th – 27 th March 2015.
WIS DOT MCLARY MANAGEMENT PERFORMANCE MEASUREMENT.
Quality Improvement.
Gathering a credible evidence base
Monitoring and Evaluation Frameworks
Session: 4 Using the RDQA tool for Data Verification
monitoring & evaluation THD Unit, Stop TB department WHO Geneva
Monitoring and Evaluation in Communication Management
Integrating Gender into Rural Development M&E in Projects and Programs
Presentation transcript:

1 Interpretation and use

2 The walls inside are plastered with laboriously made graphs…

3 Outside, people have been queuing for hours…

Appropriate interpretations  facilitate knowledge sharing & feedback  are context sensitive (population, health, service status)  identify plausible linkages (logical, sensible)  depend on quality data  should be base on clear data definitions  result in action!

6 Preparing for interpretation  Accuracy checks – 3 C’s and 1 T, includes:  Routine validation and trends checked over time  Data checked per month, per facility, per district  Local / contextual knowledge on:  Population data: ethnicity, lifestyle, occupation  Health data: common diseases  Service data: types of facilities, proficiency of staff

Avoid gathering large number of data elements Avoid data elements without contexts and without denominators –eg. 4,32,345 children given Vitamin A. –34567 women had institutional delivery. –No idea whether this is 5% achievement or 105% achievement. Avoid data elements that cannot be used for indicators Avoid indicators for which there are no data elements

8 Practical questions in interpretation 1. Why have you produced this indicator? 2. What does the indicator measure? 3. Has the indicator been accurately measured? 4. What is the target value OR action trigger value?

9 Practical questions in interpretation 6. What is the normal range? In your country: - urban - rural In the world: - best in the world - worst in the world 7. How does it fit in with other information? 8. What is the local context? 9. What should you do about the situation? 10. How could you implement that? Temporal & Spatial comparisons

10 The manager of a clinic in a peri-urban area was surprised by the very low numbers of male patients attending the OPD with urethral discharge. She was sure that the facility reporting system worked well. What could be the cause? An Exercise

Low PHU Deliveries TBAs holding on clients Low community sensitization High fees for deliveries Staff attitude Can’t afford fees Men not involved No proper orientation Low educational level Staff shortage Staff not motivated Cultural beliefs Family trust in the TBAs Community norms Laws not instituted Patients refusal to go to PHU Long distance Irregular supervision Difficult terrain Root Cause Analysis

12 TB Exercise You are presented with a graph for a district in Uganda showing 3 indicators on the Overall TB Cure Rate, Overall TB Success Rate and DOTS (Directly Observed Treatment Shortcourse) for each quarter of How would you interpret the information contained in the graph?

14 To interpret this information you may need to ask the following questions What are the definitions of the indicators that are used? What does the graph show? What else do you need to know? Is it enough to make a decision? Is this the best way to present this information?

15 USE -> Assessing coverage and quality of health services WHO GETS SICK ? WHAT HEALTH SERVICES EXIST ?

16 Assessment of coverage who gets sick?  Description of people who attend health services: age and gender breakdown community distribution  Use of individual patient data to construct aggregated routine data  Definition of population catchment target for specific services at risk

17 Assessment of quality what services exist ? For whom?  Accessibility –Catchment population –Target population –Utilization What?  Appropriateness –Type and range – Continuity Why?  Political vs functional When?  Acceptability –Convenience to clients and staff Where?  Distribution  Integration How ?  Affordability  Resources –Staff –Materials –Money

18 From Data to Health Input ….Raw Data  quantity and quality of data elements ( Essential Data Sets! )  data collection tools (tally sheets, registers, client cards) Process …Analysis  turning raw data into useful information  planning tools (targets, indicators) Output …Information  used for effective decision-making  assessment tools (aggregation, graphs, reports) Outcome …Coverage and quality of health services + efficiency  management  planning (strategic & operational)  monitoring & evaluation Impact: Health status

Challenges to Information Use HMIS often used: –for reporting NOT analysis –as a form of control and reprimand NOT used for –planning and local action –cross checking data with other sources –strengthening supervision processes –improving quality of care

Multiple Perspectives on HMIS Organization Management HMIS Public Health Service Delivery Technological determinism Discussion of different interpretations and exploration of different views --> improved and mutual understanding