CEC’s Evidence Based Practice Effort Rachelle Bruno Northern Kentucky University

Professional Standards and Practice Committee Standing Committee Knowledge and Skill Subcommittee Evidence Based Practice Workteam

CEC Member Involvement CEC Staff Richard Mainzer, Associate Executive Director, Professional Services Discussions with RA , 2006 Discussions with IDC Discussions with Division Boards , 2005, 2006 Presentations at TED Open Forum - CEC Convention 2006

Member Involvement (con’t). Selected Conference Call Participants- David Bateman, Ellen Brantlinger, Bryan Cook, Diane Browder, Lynn Ahlgrim-Delzell, Marilyn Friend, Russell Gersten; Diane Haager, Janie Hodge, Janette Klingner, Tim Landrum,Robin McWilliam, Sam Odom, Diane Paul, Hugh Reid, Kathlene Shank, Gary Siperstein, Melody Tankersley Pilot Team Members Bryan Cook; Diane Browder/Lynn Algrim-Delzell; David Test; Tim Landrum; Robin McWilliam; Sam Odom; Janette Klingner

CEC Special Education Evidence-Base Practice Professional Wisdom Evidence-Based Practices Family Values

Current Timeline & Activities Jan 2006 Board asks PSPC to engage in further discussion of EBP Spring 2006 PSPC engages CEC in discussion - convention, conference calls Oct 2006PSPC requests Pilot January 2007Board approves Pilot January 2008Report to Board

Tasks of the Pilot Project Determine decision criteria and coding rubrics Determine review guidelines Develop guidelines for practice reports Review extant studies Evaluate process

What is a practice? Specific strategy or intervention designed for use by special educators intended to support the education of individuals with exceptional learning needs Could include programs that are a combination of interventions

Pilot Criteria/Classification Based largely on the work by the CEC Division for Research task force’s articles in the winter 2005 issue of EC Examines:  Number, type, and quality of studies  Direction and significance of the effects

How does this fit with the What Works Clearinghouse? Coordinating efforts in this area as much as possible.

Describing the Evidence Base Positive Evidence-Base Negative Evidence-Base Insufficient Evidence-Base Mixed Effects Evidence Base No Discernible Effects Evidence Base Potentially Positive Evidence Base

Potential Study Rubric Dimensions Design Dependent and Independent Variables Design Quality Implementation Quality Effects

Proposed Process

Proposed Evidence-Based Practice Study Reports A clear and complete description of the practice with its essential components, A description of each research study that the team included in the synthesis study, A scored rubric for each included study along with a completed rubric across the studies to determine the category of the practice. A brief description of the results of each included study, including the direction, magnitude, and statistical significance of the empirical effect estimate. This could be characterized as a statistically significant positive, substantively important positive, indeterminate, or negative effect. The study team’s recommendation along with the basis of the recommendation.

Technical Review Panels Supporting the PSPC, a new CEC Scientific Advisory Sub- committee (SASC) in collaboration with CEC affiliates will establish a pool of expert reviewers from which the SASC can select TR panels to conduct the reviews of the EBP Studies. Each TR panel will analyze an EBP Study to ensure the criteria were appropriately applied to the body of literature and the recommendation(s) are appropriate. TR panels selected from the pool based on their backgrounds Division input

Who will do the Studies? Workteams sponsored by CEC Divisions and research teams Small number of expert colleagues (3 to 5) Who can harvest relevant studies And efficiently synthesize the results

What Studies will come first? CEC together with its affiliate Divisions will identify practice areas for study and schedules as time and resources permit.

Dissemination The Bridge Between Knowledge and Effective Practice Utilize existing methods that CEC with its affiliates have for dissemination in ways that ensure professionals have the information to select and implement practices with fidelity. CEC must also ensure that practices are disseminated to those who influence the context in which professional practice occurs.

CEC Special Education Evidence-Base Practice Professional Wisdom Evidence-Based Practices Family Values

Information Richard Mainzer Associate Executive Director Professional Services Rachelle Bruno Pilot Workteam Chair