Initial validation of the Schedule of Growing Skills (SGS) Margiad Elen Williams, Judy Hutchings, Tracey Bywater, David Daley, & Chris Whitaker Background.

Slides:



Advertisements
Similar presentations
Developmental Screening and Surveillance DENVER II
Advertisements

February 2010 Researching the Incredible Years Toddler Parenting Programme in Wales Nia Griffith Bangor University Supervised by Professor Judy Hutchings.
Initial validation of the Schedule of Growing Skills (SGS) Margiad Elen Williams Bangor University.
Evaluation of the Incredible Years TODDLER Parent Training Programme for nursery staff working with 2-3 year old children living in ‘high risk’ disadvantaged.
PRACTICE MANAGER MEETING Friday July 18 th 2014 Noon – 1:00PM Instructions to join the meeting remotely: 1.Open a web browser and enter URL:
Researching The Incredible Years Therapeutic Dinosaur School Programme Funded by the Big Lottery.
Dr. Tracey Bywater, Prof Judy Hutchings, Dr. Dave Daley, Dr. Rhiannon Tudor Edwards, Ms Pat Linck, Prof Ian Russell The IY BASIC Parenting Programme: Focuses.
PDD Behavior Inventory™ Screening Version (PDDBI™-SV)
Interpreting Translational Research Findings Incredible Years Conference, Cardiff March 9 th, 2011 Christopher Whitaker, Senior Statistician, NWORTH Tracey.
General Information --- What is the purpose of the test? For what population is the designed? Is this population relevant to the people who will take your.
PARCC Assessment Administration Guidance 1. PARCC Assessment Design Summative Assessments 2 Performance- Based Assessment End-of-Year Assessment  After.
Ages & Stages Questionnaires® is a registered trademark of Paul H
Developmental Screening Tools Michelle M. Macias, MD D-PIP Training Workshop June 16, 2006 I have no relevant financial relationships with the manufacturer(s)
Developmental and Autism Screening Tools: What are they ? Donald R. Burgess, MD, FAAP SMMC Developmental Pediatrics First Steps Conference Improving Developmental.
Presented by: Nicole Gridley Supervisors: Judy Hutchings
Association Between Socioeconomic Risk and Parenting Behaviours Association Between Socioeconomic Risk and Parenting Behaviours Nicole Gridley, Judy Hutchings.
Lessons from the IY Toddler trial in Flying Start services across Wales Nia Griffith March 2012.
Visit our websites: PhD Study: Evaluation of the Efficacy of the Incredible.
Parent Perspectives on Screening Young Children for Autism Within the Medical Home Paul Carbone, M.D., Tracy Golden, Ph.D., Jeff Hall, Ph.D., Elizabeth.
1 Incredible Years in Wales: Research update Professor Judy Hutchings Centre for Evidence Based Early Intervention, Bangor University March 2011.
Developmental Screening: What it Means for Early Learning Hubs November 21, 2013 Dana Hargunani, MD, MPH Child Health Director Oregon Health Authority.
Evaluating the Cost-Effectiveness of the Incredible Years Toddler Programme Joanna Charles Bangor University, Wales Dr. Rhiannon Tudor-Edwards, Prof. Judy.
Sensitivity and Specificity Analysis of the Brain Check Survey: Screening Students for TBI Melissa A. Rieger, OTS Advisors: Pat L. Sample, PhD. & David.
REAL-START : Risk Evaluation of Autism in Latinos (Screening Tools and Referral Training) Assuring No Child Enters Kindergarten With an Undetected Developmental.
Barbara A. Wilson, Eve Greenfield, Linda Clare, Alan Baddeley, Janet Cockburn, Peter Watson, Robyn Tate, Sara Sopena, Rory Nannery & John Crawford (2008)
Developmental Surveillance and Screening - Implementation Cathy Huang, MD FAAP Dept of Pediatrics, BHC/CCRMC Epic Physician Builder July 2013.
Child and Adolescent Intellectual Disability Screening Questionnaire (CAIDS-Q) McKenzie & Paxton Dr Karen McKenzie.
RESULTS INTRODUCTION Laurentian_University.svgLaurentian_University.svg‎ (SVG file, nominally 500 × 87 pixels, file size: 57 KB) Screening for Developmental.
Independent Evaluation of the Families First Programme in Gwynedd. Karen Wyn Jones, Judy Hutchings The Families First Programme  The Families First Programme.
Can Bright Futures Be Implemented in a Busy Clinical Setting? Lessons Learned from the Preventive Services Improvement Project: A National Collaborative.
Evaluating the Enhancing Parenting Skills (EPaS) 2014 programme Margiad Elen Williams CEBEI, Bangor University Supervisors: Professor Judy Hutchings Dr.
Big Strides for Small Patients: Developmental Screening in Pediatric Primary Care Department of Pediatrics Jerold Stirling, MD Rebecca Turk, MD Melanie.
RESULTSINTRODUCTION Accuracy of Screening Tests for Autism Spectrum Disorder in Primary Care Settings Marjolaine M. Limbos 1, PhD & David P. Joyce 2, MD,
Dr. Tracey Bywater Dr. Judy Hutchings The Incredible Years (IY) Programmes: Programmes for children, teachers & parents were developed by Professor Webster-Stratton,
Acknowledgments: Data for this study were collected as part of the CIHR Team: GO4KIDDS: Great Outcomes for Kids Impacted by Severe Developmental Disabilities.
Journal Club/September 24, Swing et al. Television and video game exposure and the development of attention problems. Pediatrics 2010;126:
Parental Depression and Child Behaviour Problems Prof Judy Hutchings, Dr Tracey Bywater, Margiad Elen Williams, B.Sc, & Chris Whitaker, M.Sc, C. Stat Background:
Ages & Stages Questionnaires® (ASQ-3) A Parent-Completed, Child-Monitoring System Ages & Stages Questionnaires® is a registered trademark of Paul H. Brookes.
AVETRA Conference April Canberra Joe Pagnoccolo Generic skills assessment: Development and validation of an instrument for apprentices in the.
Researching the Incredible Years Infant & Toddler Programmes Nia Griffith Bangor University Nia Griffith Bangor University.
About ASQ-3™ Ages & Stages Questionnaires® is a registered trademark and ASQ-3™ and related logos are trademarks of Paul H. Brookes Publishing Co., Inc.
RESULTS INTRODUCTION Laurentian_University.svgLaurentian_University.svg‎ (SVG file, nominally 500 × 87 pixels, file size: 57 KB) Comparison of the ASQ.
Assessing Intelligence Chapter 10, Lecture 3 “As heirs to Plato’s individualism, people in Western societies have pondered how and why individuals differ.
Figure 1. Mean scores for Child Deviance controlled Figure 2. Mean scores for Child Affect controlled by pre-intervention scores. by pre-intervention scores.
“The Effect of Patient Complexity on Treatment Outcomes for Patients Enrolled in an Integrated Depression Treatment Program- a Pilot Study” Ryan Miller,
Pathfinders Early Intervention Project (PEIP) Results from the Incredible Years Parenting Programme Prof. Judy Hutchings, Dr Tracey Bywater, Margiad Elen.
11 10 years on: developing and researching the Incredible Years programmes in Wales: Wednesday 17 th March 2010 Village Hotel, Cardiff Professor Judy Hutchings.
Introduction Gathering Information Observation Interviewing Norm Referenced Tools Authentic Assessment Characteristics of Authentic Assessment – 7M’s Validity.
Lessons from the IY Toddler trial in Flying Start services across Wales Nia Griffith January 2012.
KidSIM Journal Club Presenter: Amani Azizalrahman June 19 th, 2014.
Evaluating the EPaS 2014 programme and an e-version of the Little Parent Handbook Margiad Elen Williams CEBEI, Bangor University.
MethodIntroductionResults Discussion Factors Affecting Psychosocial Functioning in Serious Mental Illness and Implications for Treatment Jason E. Vogler,
Piloting the Incredible Years (IY) Therapeutic Social and Emotional skills programme alongside the IY classroom curriculum with young high-risk children.
Evaluation of the Incredible Years Teacher Classroom Management (TCM) Programme In North Wales Primary Schools Pam Martin, Judy Hutchings, David Daley,
Reliability and Validity of the Intensive Care Delirium Screening Checklist in Turkish Gulsah Kose, Abdullah Bolu, Leyla Ozdemir, Cengizhan Acikel, Sevgi.
Centre for Economics & Policy in Health Canolfan Economeg a Pholisi Iechyd (CEPhI) A Parenting Programme for Children at Risk of Developing Conduct Disorder:
Parent-Child Language in Wales Presented by: Nicole Gridley Supervisors: Judy Hutchings and Helen Baker- Henningham.
Pediatric Screening Stacey Cobb, MD Developmental-Behavioral Pediatrics Assistant Professor of Pediatrics University of South Carolina School of Medicine.
Copyright © The REACH Institute. All rights reserved. Tools to Know and Love.
Depression in children and young people referred to Specialist CAMHS: An audit of screening procedures. Dr. Michelle Rydon-Grange Clinical Psychologist,
ASQ-3 HMG Home Visiting July Discussion points What is developmental screening What are the basic features of the ASQ-3 When should you adjust for.
Sensitivity and specificity of depression screening tools among adults with intellectual and developmental disabilities (I/DD) Sarah H Ailey PhD RNC Rush.
Participants Observational data collected from participants who took part in the large scale randomised controlled evaluation of the Incredible Years Toddler.
by Holcomb Hathaway Publishers
Evaluating the Incredible Years Baby Programme Catrin Hedd Jones Supervised by Dr David Daley, Dr Tracey Bywater School of Psychology Bangor University,
An evaluation of the online universal COPING parent programme:
SKILLS (Support for Kids in Learning and Language Strategies) Online Programme for School Support Staff Anwen Rhys Jones: School of Psychology, Bangor.
The Incredible Years Autistic Spectrum and Language Delay programme
YScreen By detecting developmental delays early, you as an educator have the power to change lives and educational outcomes for children! If delays are.
Pediatric HITSS (PedHITSS)
Presentation transcript:

Initial validation of the Schedule of Growing Skills (SGS) Margiad Elen Williams, Judy Hutchings, Tracey Bywater, David Daley, & Chris Whitaker Background  Screening tools are used to identify children with possible developmental delay to enable subsequent more rigorous assessment.  Quick, inexpensive, and easy to use.  Should be as accurate as possible (sensitivity/specificity > 70% recommended by American Academy for Pediatrics (AAP, 2006)). The SGS in Wales  Welsh Assembly Government introduced their Flying Start (FS) Initiative across Wales.  The SGS was chosen as the developmental screening tool to evaluate the FS Initiative.  Problems with scoring the SGS identified during the Incredible Years (IY) Toddler trial (Hutchings et al., 2011). Problems with SGS scoring  Windows of assessment vary from one month to 12 months causing sensitivity problems.  Score highest item within skill set regardless of performance on other items.  Cannot compare between groups or across time. Aims  Scoring problems could be solved by developing a way of scoring SGS to yield a Developmental Quotient (DQ) score.  This study aimed to validate both the original and new DQ scoring methods of the SGS against a standardised assessment (Griffiths Mental Development Scales; GMDS) and a screening tool (Ages and Stages Questionnaire; ASQ).  Used a two step validation process. Hypothesis: The new SGS scoring method will show increased concurrent validity than the original SGS scoring method when compared to both a standardised assessment (GMDS) and a screening tool (ASQ). Step one Aim1: To estimate appropriate cut-off point for the new SGS scoring method using Receiver Operating Characteristic (ROC) curves. Aim2: To determine the concurrent validity of both SGS scoring methods against the GMDS. Participants Data from recent MRes project (Williams, 2010). 39 children (mean age 31 months). 61:39 male:female ratio. Measures Griffiths Mental Development Scales (GMDS) Schedule of Growing Skills (SGS) Step two Aim1: To determine the concurrent validity of both SGS scoring methods against the Ages and Stages Questionnaire (ASQ). Participants Data from recent IY Toddler trial (Hutchings et al., 2011). 94 children (mean age 22 months). 61:39 male:female ratio. Measures Ages and Stages Questionnaire (ASQ) Schedule of Growing Skills (SGS) SGS cut-offAUCSensitivitySpecificity DQ < DQ < DQ < Table 1. Results from ROC curves analysis Development area SGS scoringSensitivity (%) Specificity (%) Over- referrals (%) Under- referrals (%) LocomotorOriginal New (DQ<85) LanguageOriginal New (DQ<85) Fine motorOriginal New (DQ<85) OverallOriginal New (DQ<85) Table 3. Concurrent validity of both SGS scoring methods against ASQ Development area SGS scoringSensitivity (%) Specificity (%) Over- referrals (%) Under- referrals (%) LocomotorOriginal New (DQ<85) Personal- Social Original New (DQ<85) LanguageOriginal New (DQ<85) Fine motorOriginal New (DQ<85) OverallOriginal New (DQ<85) Table 2. Concurrent validity of both SGS scoring methods against GMDS Results Step one Aim1: Most appropriate cut-off for the new SGS scoring method is DQ<85 (Table 1). Aim2: New SGS scoring method shows increased concurrent validity than the original scoring method when compared to GMDS (Table 2). Step two Aim1: New SGS scoring method shows increased concurrent validity than the original scoring method when compared to ASQ (Table 3). Conclusions Findings  New SGS scoring method shows increased sensitivity, comparable specificity, higher over-referrals, and lower under-referrals.  Overall, the new SGS scoring methods reaches the AAP recommended psychometric criteria of sensitivity and specificity levels of 70% or more. Limitations  Both data sets used had relatively small sample sizes.  Both researchers who collected data for each of the studies had undergone GMDS training which may have affected the way they administered the SGS. Implications  Using the new scoring method could lead to increased detection rates.  The new scoring method would be of better use in clinical practice and research compared to the original scoring method. For more information, contact Prof Judy Hutchings, Nantlle Building, Normal Site, Bangor University, LL57 2PZ or