Dial-in: Pass code: SPDG Directors’ Webinar Implementation Driver Series: Organizational – Data Decision Support Systems Facilitators Jennifer Coffey, PhD, OSEP Project Officer Audrey Desjarlais, Knowledge Mobilization Coordinator, Signetwork John Lind, Interim Facilitator, Signetwork; TA Provider, Western Regional Resource Center 1 "Not everything that can be counted counts, and not everything that counts can be counted." - Albert Einstein

charts/?goback=%2Egde_ _member_ #%21 Developed by Nathan Yau, FlowingData. FlowingData explores how designers, statisticians, and computer scientists are using data to understand ourselves better — mainly through data visualization. as charts

Roll Call

Mute:*6 Unmute: #6

Event Materials, Recording: calendar/events/1028 5

Directors’ Webinars Schedule: 6 Feb 6 Measuring Collaboration Mar 6 Organization Driver: Use of Data Apr 3 Organization Driver: Use of Data May 1 Collaboration with Partners Jun 1 Organizational Driver: Facilitated Administration & Systems Jul 21 OSEP Project Directors’ Conference: Continuing with Drivers Sep 4 Leadership Driver

PLC Events: Feb-June events to be hosted -Today and tomorrow look for meeting RSVPs announcing topics/presenters for 75% of the events.

2014 Continuation Package, Grant Performance Reporting: 8 Anticipated Release is early February A Guidance Session to be scheduled and announced via the listservs.

2014 Continuation Package, Grant Performance Reporting: 9 Anticipated Release is early February A Guidance Session to be scheduled and announced via the listservs.

2014 National Meeting Planning 10 Original Poll dates Oct – difficulty finding a meeting site New Poll Dates: October 14 – 15 Please respond yes/no to these dates Planning Committee to meet Mar, Apr, May & June (dates to be sent in Feb)

Nov. 2013: SPDG National Meeting Follow-up Resources and Materials Found at:  Website: annual-spdg-national-meeting annual-spdg-national-meeting  Dropbox Folder: 0Meeting_Nov Meeting_Nov2013 Archived Presentation Recordings  Allison’s Metz: Use of Data presentation  Jennifer’s Program Measure presentation 11

12 Signetwork Coordinator Transition Process Next Steps Search for full time position Interim Webinar Facilitator(s): John Lind, and others as needed Other responsibilities: shared All Signetwork Related Correspondence to :

Starting with Questions

Where to start 1. Determine what questions you want to answer (implementation team) 2. Determine what data will help to answer questions 3. Determine the simplest way to get the data 4. Put systems in place to collect data 5. Analyze data to answer questions (Lewis, 2009) Data-Based Decision Making

Questions to Answer Consider questions related to: Data-Based Decision Making Intervention Implementation Outcomes

Questions to Answer Are practitioners implementing intervention with fidelity? Are practitioners “bought in” to the new way of work? Are teachers, families, partners satisfied? Are stakeholders collaborating? Are coaching and supervision being delivered as intended? Are outcomes being achieved? Are appropriate referrals being made? Data-Based Decision Making

What questions are you asking?

Asking questions to improve fidelity of the “what”…

Use of Data Life Cycle

Missouri SPDG Working Example: Focus on Fidelity of Implementing Regional Training and Coaching Working Questions:  How can we monitor the fidelity of how training and coaching is delivered?  How is the measure of training fidelity aligned with the measure of coaching fidelity?  In what ways does the expected elements of fidelity of both training and coaching differ based on (a) who the provider is, (b) who the receiver is, and/or (c) setting/context?  Is the measure of fidelity usable and informative?  Based on training and coaching fidelity data, what are the implementation gaps?  Do the professional development providers need additional support to improve fidelity of delivery of training and coaching?  In what ways does fidelity of training and coaching explain differences in educator implementation of learned knowledge and skills, and ultimately student outcomes? 20

Rhonda’s Document 21

Program Review Process Process and Outcome Data Detection Systems for Barriers Communication protocols Questions to Ask What formal and informal data have we reviewed? What is the data telling us? What barriers have we encountered? Would improving the functioning of any Implementation Driver help address barrier? 22

The SPDG Program Story

What the SPDG Program overcame: 1.How do we ensure evidence based professional development is implemented by grantees? 2.How do we more effectively deliver training on implementation science principles? 3.How do we meet the needs of grantees implementing different initiatives?

What we have to celebrate: 1.Launch and implementation of SPDG Technology Initiative 2.Increase of knowledge and application of implementation science 3.A stronger collaborative network of professional learners 4.Strong leadership at national and state Levels

What we can do differently or the same… Measure collaboration across grantees and/or the professional learning or sharing occurring as a result of attending PLC webinars and face- to-face events Continue to raise the bar to achieve high quality

Let’s celebrate