Understanding Medical Audit Professor. Riaz Qureshi Professor Hamza Abdulghani College of Medicine King Saud University, Riyadh

Objectives  Define Medical Audit (M-Audit).  Identify steps (framework) of M-Audit  Audit Cycle  Recognize important terminology used in M- Audit.  Plan for a M-Audit topic.  Identify the difference between M-Audit & research  Recognize the benefits of M-Audit

ThinkPair&Share

Students’ Task A huge number of our primary care clinics are diabetic patients who are followed in the clinic.A huge number of our primary care clinics are diabetic patients who are followed in the clinic. We would like to know that the diabetic care is appropriate in PCC.We would like to know that the diabetic care is appropriate in PCC. What are the areas to be evaluated?What are the areas to be evaluated? How we can plan for the evaluation of Diabetic care in our clinic?How we can plan for the evaluation of Diabetic care in our clinic?

What is Medical Audit? “…method used by health professionals to: –Assess –Evaluate & –Improve …. the care of patients in a systematic way to enhance their health and quality of life”.

Terminology used in M-Audit  Self, Peer & External M-Audit  Audit Cycle  Structure, Process & Outcomes  Criteria & Standards  Planning for M-Audit  Audit Questions  Data Sources, Collection & Presentation

Types of Audit Self AuditSelf Audit Peer AuditPeer Audit External AuditExternal Audit

Audit Cycle SET STANDARDS COMPARE WITH STANDARDS OBSERVE PRACTICE IMPLEMENT CHANGE

A framework for assessing care:  Audit requires a framework  Description, measurement, comparison and evaluation of the quality of health care can be made.  Three constituents of quality are: Structure ProcessOutcomes

Scope of Audit BuildingBuilding Practice equipmentsPractice equipments Working teamWorking team Prevention / Control of disease Improved level of functions Relief of symptoms Prevention of premature death Minimizing the cost Increase patient satisfaction STRUCTURE OUTCOME PROCESS Prescribing habitsPrescribing habits Hospital referralsHospital referrals Laboratory / X ray useLaboratory / X ray use

Structure  Sescribes the physical attributes of health care,  building, equipments,  Employees in the team: # and types,  Patient records.  Common sense suggests that health care is likely to be more effective if it is carried out in comfortable surroundings with the right equipments and by the most appropriate people.

Process Describes the care given by the health care team, i.e., what the practitioner does, the sum of actions and decisions that describes a person’s professional practice.Describes the care given by the health care team, i.e., what the practitioner does, the sum of actions and decisions that describes a person’s professional practice. Doctors and nurses tend to identify the process of care with quality because it describes what they do for their patientsDoctors and nurses tend to identify the process of care with quality because it describes what they do for their patients It reflects their attitudes, knowledge and skills.It reflects their attitudes, knowledge and skills.

Outcomes  Describe measures that lie between true process and the definitive outcome.  They are easier to measure yet they predict, or are assumed to predict, definitive outcome.  Example: The Hb A1C for diabetic patients

Scope of Audit STRUCTURE OUTCOME PROCESS

Outcome**  is the change in a patients’ current and future health status that can be attributed to antecedent health care  Therefore the definitive indicators of health  Describe the effectiveness of care.  For example, did the patient survive a potentially fatal condition ?

Criteria& Standards Standards

Criterion Describe a definable and measurable item of health care, which describes quality, and which can be used to assess it. –Example: Females of susceptible age should be immunized against rubella.Females of susceptible age should be immunized against rubella. All diabetic patient should receive pneumococcal vaccinationAll diabetic patient should receive pneumococcal vaccination All children requesting attention for acute problems will be seen on the same day.All children requesting attention for acute problems will be seen on the same day.

Standards Describes the level of care to be achieved for any particular criterion. –Example: Females of susceptible age should be immunized against rubella. The standard might specify that 98% of the female population at risk should receive protection.Females of susceptible age should be immunized against rubella. The standard might specify that 98% of the female population at risk should receive protection.

CriterionStandards Structure Patients records will include summary cards. Should apply to 50% of records. Process All patients attending out- patient clinics will have complete nursing assessments. This should apply to : 50% - year 1, 75% - year 2, 95% - year 3, Following the introduction of the standard. Outcome- Intermedi ate Patients with established HTN will have a diastolic level less than 120/80 mm Hg with in the first year of treatment. The target level will be achieved in 80% of cases.

Audit Questions - Examples Are the waiting times for hospital outpatient appointments acceptable?Are the waiting times for hospital outpatient appointments acceptable? What are the complication rates of a particular type of surgery?What are the complication rates of a particular type of surgery? Are the consultants to whom patients are referred kind and considerate?Are the consultants to whom patients are referred kind and considerate? Which groups of patients are attending follow-up clinics unnecessarily?Which groups of patients are attending follow-up clinics unnecessarily? How many of our Diabetic patients are controlled?How many of our Diabetic patients are controlled?

The use of resources It is important to decide on the maximum level of resources a team is prepared to commit to an audit.It is important to decide on the maximum level of resources a team is prepared to commit to an audit. In doing this it is also important to ensure that the subject examined is appropriate to the skills and resources available.In doing this it is also important to ensure that the subject examined is appropriate to the skills and resources available. Resources can be divided into several categories: time, money, people.Resources can be divided into several categories: time, money, people.

Ground rules for choosing an audit subject Is the subject chosen: –likely to benefit patients and the practice? –relevant to professional practice and development? –significant or serious in terms of the process and outcomes of patients care? –having potential for improvement? –capable of holding the interest and involvement of team members? –likely to repay the investment of time, money and effort involved?

Planning an audit: 10 guidelines 1.Define the nature of the perceived problem. 2.Produce a clear written statement of aims. 3.Construct clear audit question. 4.Define the criteria & standard 5.Select the most appropriate method. 6.Identify the main analysis to be made. 7.Start small. 8.Have a short time-scale. 9.Proceed step by step. 10.Indicate how the possible need for change is to be handled.

Data Sources Routine practice dataRoutine practice data External dataExternal data Medical recordsMedical records Practice activity analysisPractice activity analysis Prospective recordingProspective recording Surveys Interviews Direct observation Confidential enquiries

12345 → 20 AgeSexDrug Marital Status BP recorded Case 1 94MASY Case 2 90MBWY Case 3 87FCMN ↓ 40 Data collection grid

Data presentation card Age (years) MarriedSingleTotal BP recorded Antihypertensive prescribed 75 – – – – Total

Presentation of data The analysis of data produces results that need to be converted into information which the practice team can understand and to which they can relateThe analysis of data produces results that need to be converted into information which the practice team can understand and to which they can relate Trends or insights must be presented in a visual way that communicates the information effectively.Trends or insights must be presented in a visual way that communicates the information effectively.

Benefits of Medical Audit?

Benefits of Medical Audit Reducing errorsReducing errors Improve efficiency / effectivenessImprove efficiency / effectiveness Demonstrating good careDemonstrating good care Meeting patients’ needs / expectationsMeeting patients’ needs / expectations Stimulating educationStimulating education Bidding for resourcesBidding for resources Effective defenseEffective defense

Medical Audit &Research?

M-AuditResearch Based on the comparison of practice against standards Based on an idea (hypothesis), Qs Creates knowledge of current clinical practice and need for improvement Creates new knowledge regarding most beneficial practice Small scale over a short time periodLarge scale over a long time period Does not necessarily need a statistically valid sample size Needs a statistically valid sample size Basic statistical analysis usually suffices Extensive statistical analysis is required Creates knowledge of current clinical practice and need for improvement Creates new knowledge regarding most beneficial practice Clear responsibility to act on findingsNo mechanism to act on findings Does not usually require ethical approval Always requires ethics committee approval

Students’ Task A huge number of our primary care clinics are diabetic patients who are followed in the clinic.A huge number of our primary care clinics are diabetic patients who are followed in the clinic. We would like to know that the diabetic care is appropriate in PCC.We would like to know that the diabetic care is appropriate in PCC. What are the areas to be evaluated?What are the areas to be evaluated? How we can plan for the evaluation of Diabetic care in our clinic?How we can plan for the evaluation of Diabetic care in our clinic?

References Making sense of Audit: Donald and Sally IrvineMaking sense of Audit: Donald and Sally Irvine Conducting a clinical practice audit: Canadian Family Physician 2001Conducting a clinical practice audit: Canadian Family Physician 2001 Problem based medical audit program: Family Medicine 1998Problem based medical audit program: Family Medicine 1998 Audit in Health Care. The purpose of reviewing quality: Irish Medical Journal 1999Audit in Health Care. The purpose of reviewing quality: Irish Medical Journal 1999

THANK YOU Have a nice day Have a nice day