Dr Namita Shanbhag Associate Professor

Slides:



Advertisements
Similar presentations
Engaging Patients and Other Stakeholders in Clinical Research
Advertisements

Examining the Relationship Between Confrontational Naming Tasks & Discourse Production in Aphasia Leila D. Luna & Gerasimos Fergadiotis Portland State.
Abstract Background Results Olivia Augustin, Lyddia Petrofsky, Kathryn Lyman, & Brittany Weiler Faculty Advisor: Dr. Don Bredle Department of Kinesiology,
Health-related quality of life in diabetic patients and controls without diabetes in refugee camps in Gaza strip: a cross-sectional study By: Ashraf Eljedi:
Effect of Staff Attitudes on Quality in Clinical Microbiology Services Ms. Julie Sims Laboratory Technical specialist Strengthening of Medical Laboratories.
Authors: Sujai M. Parker, Gunjan N. Jodi, Jalak Jani
Quantitative Research
Internal Auditing and Outsourcing
Luljeta Ferizi Shabani1
© 2003 East Collaborative e ast COLLABORATIVE ® eC SoftwareProducts TrackeCHealth.
UNIT 5 SEMINAR.  According to your text, in an acute care setting, an electronic health record integrates electronic data from multiple clinical systems.
Evaluating a Research Report
Performance of dental faculty members and undergraduates in caries detection after ICDAS training Parolia A, Bhatia S, Smales F, Toh CG, Pau A Presenter:
Results From The 2000 Tri-Service Recruit Oral Health Survey CAPT Andrew K. York, DC, USN CDR Thomas M. Leiendecker, DC,USN Lt Col Gary “Chad” Martin,
Results From The 2000 Tri-Service Recruit Oral Health Survey Lt Col Gary “Chad” Martin, USAF, DC LTC Bruce B Brehm, USA, DC CDR Thomas M Leiendecker, DC,USN.
EXPERIMENTAL EPIDEMIOLOGY
1 COMMUNITY DENTAL HEALTH Algonquin College Janet Ladas.
1 Impact of Implementing Designed Nursing Intervention Protocol on Clinical Outcome of Patient with Peptic Ulcer By Amal Mohamed Ahmad Assistant Professor,
Reliability and Validity of the Intensive Care Delirium Screening Checklist in Turkish Gulsah Kose, Abdullah Bolu, Leyla Ozdemir, Cengizhan Acikel, Sevgi.
PHDSC Privacy, Security, and Data Sharing Committee Letter to Governors.
By Dr Hidayathulla Shaikh. Objectives  At the end of the lecture student should be able to –  Define survey  Mention uses of survey  Discuss types.
DEVELOPING AND TESTING THE STANDARD OF PRACTICE AND EVALUATION OF CRITICAL-CARE-NURSING TOOL (SPECT) FOR GRADUATES OF CRITICAL CARE NURSE EDUCATION PROGRAMS.
GCP (GOOD CLINICAL PRACTISE)
Southern Illinois University Edwardsville,
T Relationships do matter: Understanding how nurse-physician relationships can impact patient care outcomes Sandra L. Siedlecki PhD RN CNS.
HCS 465 OUTLET Experience Tradition /hcs465outlet.com FOR MORE CLASSES VISIT
Statistics & Evidence-Based Practice
Oral Health Training & Calibration Programme
FLUORIDATED COMMUNITY WATER KNOWLEDGE AND OPINION AMONG PARENTS IN SOUTHWEST FLORIDA Courtney Uselton, DDS ; Maria E. Davila, DDS, MPH, DrPH; Scott L.
An Alternative Certification Examination “ACE”, to assess the domains of professional practice.  Morris M1*, Gillis AE2, Smoothey CO3, Hennessy M1, Conlon.
Integrating eHealth into the Undergraduate Nursing Curriculum
Electronic Medical and Dental Record Integration Options
Chapter 4 Research Methods in Clinical Psychology
Nursing Journal Clubs Enhance Evidence-Based Practice
MRCGP The Clinical Skills Assessment January 2013.
John Weeks1, MD Candidate 2017, Justin Hickman1, MD Candidate 2017
Patient Involvement in the HTA Decision Making Process
Patient Registries and Health Outcomes in Diabetes: A Retrospective Study Nipa Shah, MD1; Fern Webb, PhD1; Liane Hannah, BSH1; Carmen Smotherman, MS2;
Emma Kientz, MS, APRN-CNS, CNE
Empathy in Medical Care Jessica Ogle (D
The Many Careers of Pharmacy
MUHC Innovation Model.
Ghulam Muhammad Ashrafi SHAFFAQ YOUSAF
Family Paradigm Assessment Scale (F-PAS) Test-Retest Reliability
Elayne Colón and Tom Dana
South Texas Psychiatric PBRN
–Anonymous Participant
Comparison of Hindi version of MMSE with its English version:
Unit 6 Research Project in HSC Unit 6 Research Project in Health and Social Care Aim This unit aims to develop learners’ skills of independent enquiry.
Clinical Engineering Lecture (3).
Jane Sinson Educational Psychologist
Polypharmacy In Adults: Small Test of Change
FDI World Dental Congress
Peer-To-Peer Public Health Data Acquisition Via Dental E-Charting
PICO Power Point Presentation
FDI World Dental Congress
Quantitative vs. Qualitative Research Method Issues
Mapping the ACRL Framework and Nursing Professional
The impact of small-group EBP education programme: barriers and facilitators for EBP allied health champions to share learning with peers.
What the Editors want to see!
15.1 The Role of Statistics in the Research Process
Decreasing Compassion Fatigue In Cardiovascular Intensive Care Nurses Through Self-Care and Mindfulness Staci Abernathy, MSN, CPNP-AC, DNP Student, Rebecca.
Component 11 Unit 7: Building Order Sets
Ways to link the course learning outcomes to the program learning outcome and to the Institutional learning outcomes.
An e-Chart for each child FDI World Dental Congress
Regulatory Perspective of the Use of EHRs in RCTs
Tools and Techniques for the Auditor: Fieldwork
{Project Name} Organizational Chart, Roles and Responsibilities
The Efficacy of the Teach-Back Method of Education on Readmission Rates in Heart Failure Patients Catherine Lynch Abstract Teach-Back Method The teach-back.
Patient-reported Outcome Measures
Presentation transcript:

Dr Namita Shanbhag Associate Professor Government Dental College and Research Institute Bangalore, Karnataka, India

Inter-Intra Rater Reliability Using “E Charting EDR” In Dental Education Setting Dr Namita Shanbhag Dr Manjunath Puranik. Dr Santhiya Associate Professor Professor and Head Post graduate student

CONTENTS Background Aim and objectives Methodology Results Discussion Summary and Conclusion Acknowledgement

Records are the most important tools for verifying the delivery of predictable wellness-centered care, based on up- to-date evidence-based decision-making that patients want and expect. As patients become savvier about their healthcare and more frugal with their money, it is of utmost importance that dentists have the latest, greatest, and most innovative technology

The introduction of operatory computers has been a popular trend lead by applications such as digital X-ray systems and cosmetic-imaging software. The information technology revolution coupled with every- day use of computers in clinical dentistry has created new demand for electronic patient records.

The Electronic Patient Record (EPR) or “computer-based medical record” is defined by the Patient Record Institute as “a repository for patient information with one health-care enterprise that is supported by digital computer input and integrated with other information sources.1 Digital patient records can improve organization, treatment-tracking, and information retrieval – enhancing communication and optimum patient care The electronic health record with respect to clinical charting is, by default, a more comprehensive application of software technology in the operatories

Dental Charting is a Cloud-based e-charting and statistics generating software produced and compiled by Mr Wouter Put ,Netherlands and has the potential to provide health information management and analysis approach on a large scale, and across populations. 2 This specific software tool automatically generates instantaneous dental health statistics of the charted patients that would be essentially needed to be used to plan or execute any health program or any kind evaluation processes as needed by the health authorities.

In order to fully integrate and realize all of the potential of electronic records, many of the roadblocks must be resolved efficiently. This includes full resolution of issues related to terminology, system interfaces, and agreement on standardized clinical measures.3 The purpose of this study was to assess the inter and intra rater examiner reliability of electronic dental record system using this online e- charting software tool in recording common oral findings.

Aim and Objectives To quantify intra- and inter-examiner reliability of measuring periodontal as well as dental parameters using the e-charting software program. To suggest any modifications with regard to data cells if any

Methodology Three clinical examiners (SE + 1 ) were assigned to the study. All examiners attended a review seminar and training session , during which the objectives, measurement parameters, techniques and schedule was discussed. They would be recording the detailed case history of the calibration subjects on to the online charting tool into a computer independently Before beginning the study, the three examiners were trained in a calibration process.

In a calibration group (not part of the experimental group), 10 study subjects were examined by the two examiners, using a plane mouth mirror and a WHO Probe (Hu-Friedy Co., Chicago, USA), once a week over a period of 2 weeks. The standard examiner (SE) discussed each criteria being used for each aspect of the dental and periodontal examination and discussed how to enter the data into the software The examination process was repeated until each examiner had substantial correlation Kappa agreement of 5 kappa values in the range 0.81–0.92, and the all items gave a kappa value of 0.88. Once the examiners were trained, the study was initiated.

ETHICAL CONSIDERATIONS The Institutional Ethics Committee of Government Dental College approved the study The calibration subjects were recruited based on their willingness for participation and after signing the informed consent following guidelines of the Helsinki Declaration.

Intra rater calibration session A total of 50 adult calibration subjects (18 years of age or older) with a range of periodontal health and dental caries were recruited for the study by the standard examiner over a period of 2 weeks Only 5 subjects were evaluated by the SE each day A total of only 31 subjects volunteered for repeat examination that were conducted by the SE after one week

Inter-rater calibration Recruitment of 50 subjects (6 subjects per day were examined and the oral findings were recorded independently by the standard examiner on to the computer using the dental charting clinic management charting software. A total of only 36 subjects volunteered for repeat examination. They were assessed again after one week consecutively by the other two examiners. Dental caries was scored using DMFT, ICDAS and CAST indices Gingivitis was assessed by the presence of bleeding on probing Periodontitis was assessed by measuring probing depths , loss attachment and presence of gingival recession 50 subjects

Statistical Analysis The prevalence of dental caries and periodontal disease was instantly generated through the inbuilt statistical software in the dental charting software program. The baseline record of each patient was analyzed further with regard to the following variables namely the Age, Gender ,Gingivitis(BOP), Periodontitis(Pocket depth, LOA, Gingival Recesion), Dental caries(DMFT, ICDAS, CAST). This data was manually entered into excel spreadsheet and subjected to statistical analysis using SPSS for Windows software ver 22.0.(IBM Corporation, Chicago, USA).

The results were analyzed statistically by t-test for independent samples and an analysis of variance (ANOVA) to derive significance.(p<0.05) The intra-class correlation coefficient, , was used to determine both the intra- and inter-investigator reliabilities. Normalcy-

Results The study was conducted among 100 subjects over a period of 2 months The mean age of the study subjects was 39.3 years (18-50 years ).

INTRA RATER CALIBRATION Variables Prevalence (%) Mean Score (SD) p-Value Dental caries Exam-1 Exam--2 Exam-2 DMFT 81 84 3.26 (1.788) (1.751) 0.811 ICDAS 71 74 1.74 (1.154) 1.77 (1.175) 0.884 CAST ( 1.788) Periodontal Diseases Gingivitis 9.35 (8.716) 9.32 (8.719) 0.975 Periodontitis 48 1.94 (2.205) 2.00 (2.221) 0.963 For the intrarater reliability 31 (16 Males, 15 Females) were included. The prevalence of DMFT was 81% at the first examination and 84% after one week, while DMFT mean was at 3.26(1.78) during first and second 3.26(1.751) examination. Mean ICDAS score was 1.74(1.154) and 1.77(1.17%) respectively for 1st and 2nd examiner. Mean CAST (1-8) score 3.26(1.78) and 3.26(1.75) Gingival disease scores 9.35(8.71) and 9.32(8.71) Periodontal Disessase scores1.94(2.20) 2.0(2.221) t-test for independent samples (intra-examiner reproducibility) to test significance between observations There was no significant difference found in the values between the two examiners with respect to these variables.

INTRA RATER CALIBRATION INTRA CLASS CORRELATION COEFFICIENT Variables Intra class correlation Confidence interval (95% CI) Significance Dental caries DMFT 0.984 0.966 - 0.992 0.000 ICDAS 0.969 0.935 – 0.985 CAST Periodontal Diseases Gingivitis 0.999 0.998-1.000 Periodontitis 0.993 0.986 – 0.997 F test denotes the difference between groups since the differences between the observations during the two examinations were not signifiant ,it implies that the observations were similar. And there was high intra examiner agreement with regards to the observations The intraclass correlation for all the variables was 0.9 denoting that there was a highly strong and positive correlation between the two examinations.

INTER RATER CALIBRATION Variables Prevalence (%) Mean Score (SD) p-Value Dental caries Examiner1 Examiner 2 Examiner3 Examiner 1 Examiner 2 Examiner 3 DMFT 89 86 2.833 ( 1.3416) 2.972 (1.4439) 2.778 (1.4165 ) 0.225 ICDAS 58 59 1.611 (0.3581) 1.667 ( 1.3732) 1.639 ( 1.3970) 0.823 CAST Periodontal Diseases Gingivitis 69 9.78 (8.712 ) 9.64 ( 8.679) 9.53 (8.507 ) 0.185 Periodontitis 36 39 2.11 ( 3.003) 2.06 (3.070 ) (3.022 ) 0.722

INTER RATER CALIBRATION Inter – item correlation matrix Intra class correlation Confidence interval(95% CI) F score Variables Standard examiner(SE) Examiner 2 3 Dental caries DMFT 1 0.868 0.897 0.956 0.924 – 0.976 0.000 ICDAS 0.924 0.933 0.974 0.954 –0.986 CAST Periodontal Diseases Gingivitis 0.995 0.994 0.999 0.997 –0.999 Periodontitis 0.991 0.996 0.993 –0.998 Against the observations of the SE, how did the other examiners performed. Against SE, and examiner 2,and 3 did show a high and positive correlation The intraclass correlation for all the variables was 0.9 denoting that there is a strong agreement between the two examinations. The inter-rater reliability between the two reviewers was 0.998 when using Cronbach’s alpha and 0.996 (95% CI) when using Intra-class Correlation Coefficient.

DISCUSSION This study evaluated intra- and inter-examiner reliability among three trained and calibrated examiners while using a e charting tool for data entry of clinical recording of dental and periodontal health among the individuals Rigorous operator calibration were demonstrated as necessary for obtaining reliable records, which can be used for appropriate decision-making. Experience is the most important factor in measurement reproducibility.

In our opinion, the high intra-examiner reproducibility observed was the result of the calibration and training program, and was not related to the operators’ experience, as have stated other authors 4-9 There are other variables that could affect periodontal clinical probing and this was avoided by providing sufficient time between the initial and repeated measures and preserving tissue health, thus controlling the likelihood that an operator’s memory induced bias.

The EPR can be used to assess the quality of care in a large clinic in numerous ways.1 Researchers have suggested that oral health professionals should develop a common record with standard codes, including clinical outcome measures, to make the EHR more useful for recording clinical treatments, facilitating research and improving quality of care.

Any electronic dental record should be flexible enough to allow the comparative analysis of patients and by individual or groups of providers. Data from the EPR must be exportable to other software packages for further analyses to support many quality assurance functions. Though the software has an ability to generate statistics instantaneously, further analysis needed an manual approach.

CONCLUSION According to the Office of National Coordinator, the purpose of “meaningful use” is to use an EHR “Improve quality, safety, efficiency, and reduce health disparities, engage patients and family, improve care coordination and population and public health & maintain privacy and security of patient health information”

While the research by Poul Eric Petersen implies that Electronic health information improves patient care by facilitating higher patient safety and quality of care, eliminates bulky folders of patients’ records, and storage space freed up to make way for consultation rooms, with quick and timely access to a patient’s updated dental history and any pre-existing medical condition allows more thorough assessments in less time by cutting down on waiting time as patient records retrieval goes electronic Hence EDR -It turns a promise into reality as to formulating fact- based dental health policies quickly and easily as well as planning and executing health service delivery.

Cloud-based e-charting and statistics processing promises to be the way forward for reliably maintaining patient dental health records. It has the potential to provide the global dentistry community with a health information management and analysis approach on a large scale, and across populations. It turns a promise into reality as to formulating fact-based dental health policies as well as planning and executing health service delivery Improved quality of oral health information systems worldwide may help to strengthen health systems and operational research may assist in translating sound knowledge about prevention programmes and health promotion for the benefit of the poor and disadvantaged population groups.5

Jane C. Atkinson,,Gregory G. Zeller,, Chhaya Shah, B. A Jane C. Atkinson,,Gregory G. Zeller,, Chhaya Shah, B.A. Electronic Patient Records for Dental School Clinics: More Than Paperless Systems Journal of Dental Education ■ Volume 66, No. 5 634-642 John Cutter, Wouter Put. e‐Charting – Public Health Data Acquisition Efficacy Via Undergraduate Dental Students. Int Dent J; Special Issue: Abstracts of the 105th, FDI World Dental Congress. 2017;(67)Issue 1:73 Ira Lamster ,Fiona Collins. Are Oral Health Providers Using Electronic Dental Records? https:/www.colgateoralhealthnetwork.com/article/are-oral-health-providers-using- electronic-dental-records accessed on 12/06/2018 Poul Erik Petersen, Denis Bourgeois, Douglas Bratthall,& Hiroshi Ogawa .Oral health information system-towards measuring progress in oral health promotion and disease prevention Bulletin of the World Health Organization ;September 2005, 83 (9) Reliability study of clinical electronic records with paper records in the NSW Public Oral Health Service Angela V Masoe, Anthony S Blinkhorn, Kim Colyvas, Jane Taylor, Fiona A Blinkhorn Accessed www.phrp.com.au march 2015 vol25 issue 2

So many thanks to: Argentina Brazil Cambodia Colombia India Indonesia Netherlands Philippines Turkey USA