Download presentation
Presentation is loading. Please wait.
Published byLeo Wade Modified over 9 years ago
1
Initial validation of the Schedule of Growing Skills (SGS) Margiad Elen Williams, Judy Hutchings, Tracey Bywater, David Daley, & Chris Whitaker Background Screening tools are used to identify children with possible developmental delay to enable subsequent more rigorous assessment. Quick, inexpensive, and easy to use. Should be as accurate as possible (sensitivity/specificity > 70% recommended by American Academy for Pediatrics (AAP, 2006)). The SGS in Wales Welsh Assembly Government introduced their Flying Start (FS) Initiative across Wales. The SGS was chosen as the developmental screening tool to evaluate the FS Initiative. Problems with scoring the SGS identified during the Incredible Years (IY) Toddler trial (Hutchings et al., 2011). Problems with SGS scoring Windows of assessment vary from one month to 12 months causing sensitivity problems. Score highest item within skill set regardless of performance on other items. Cannot compare between groups or across time. Aims Scoring problems could be solved by developing a way of scoring SGS to yield a Developmental Quotient (DQ) score. This study aimed to validate both the original and new DQ scoring methods of the SGS against a standardised assessment (Griffiths Mental Development Scales; GMDS) and a screening tool (Ages and Stages Questionnaire; ASQ). Used a two step validation process. Hypothesis: The new SGS scoring method will show increased concurrent validity than the original SGS scoring method when compared to both a standardised assessment (GMDS) and a screening tool (ASQ). Step one Aim1: To estimate appropriate cut-off point for the new SGS scoring method using Receiver Operating Characteristic (ROC) curves. Aim2: To determine the concurrent validity of both SGS scoring methods against the GMDS. Participants Data from recent MRes project (Williams, 2010). 39 children (mean age 31 months). 61:39 male:female ratio. Measures Griffiths Mental Development Scales (GMDS) Schedule of Growing Skills (SGS) Step two Aim1: To determine the concurrent validity of both SGS scoring methods against the Ages and Stages Questionnaire (ASQ). Participants Data from recent IY Toddler trial (Hutchings et al., 2011). 94 children (mean age 22 months). 61:39 male:female ratio. Measures Ages and Stages Questionnaire (ASQ) Schedule of Growing Skills (SGS) SGS cut-offAUCSensitivitySpecificity DQ < 90.79490.8367.88 DQ < 85.77974.1881.55 DQ < 80.78965.8391.90 Table 1. Results from ROC curves analysis Development area SGS scoringSensitivity (%) Specificity (%) Over- referrals (%) Under- referrals (%) LocomotorOriginal1098.811.069.57 New (DQ<85)7092.866.383.19 LanguageOriginal5093.026.384.26 New (DQ<85)7583.7214.892.13 Fine motorOriginal26.6792.416.3811.70 New (DQ<85)66.6777.2219.155.32 OverallOriginal28.8994.754.618.51 New (DQ<85)70.5684.6013.473.55 Table 3. Concurrent validity of both SGS scoring methods against ASQ Development area SGS scoringSensitivity (%) Specificity (%) Over- referrals (%) Under- referrals (%) LocomotorOriginal16.67100012.80 New (DQ<85)83.3351.5241.022.56 Personal- Social Original010007.69 New (DQ<85)66.6710002.56 LanguageOriginal20100010.26 New (DQ<85)8094.125.132.56 Fine motorOriginal010007.69 New (DQ<85)66.6780.5617.952.56 OverallOriginal9.1710009.61 New (DQ<85)74.1781.5516.032.56 Table 2. Concurrent validity of both SGS scoring methods against GMDS Results Step one Aim1: Most appropriate cut-off for the new SGS scoring method is DQ<85 (Table 1). Aim2: New SGS scoring method shows increased concurrent validity than the original scoring method when compared to GMDS (Table 2). Step two Aim1: New SGS scoring method shows increased concurrent validity than the original scoring method when compared to ASQ (Table 3). Conclusions Findings New SGS scoring method shows increased sensitivity, comparable specificity, higher over-referrals, and lower under-referrals. Overall, the new SGS scoring methods reaches the AAP recommended psychometric criteria of sensitivity and specificity levels of 70% or more. Limitations Both data sets used had relatively small sample sizes. Both researchers who collected data for each of the studies had undergone GMDS training which may have affected the way they administered the SGS. Implications Using the new scoring method could lead to increased detection rates. The new scoring method would be of better use in clinical practice and research compared to the original scoring method. For more information, contact Prof Judy Hutchings, Nantlle Building, Normal Site, Bangor University, LL57 2PZ or email: j.hutchings@bangor.ac.uk
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.