1. 2018 Improving Data, Improving Outcomes Conference
Arlington, VA August 2018

2. Your Data Story: Using Critical Questions to Jumpstart the Data Exploration Process
Missy Coffey, DaSy Center
Gary Harmon, DaSy Center
Jessica deMonsabert, AEM Corporation
Kate Grannemann, AEM Corporation

3. Welcome & Introductions

4. Agenda Welcome & Introductions
A Look Across Fields: Asking Questions & Using Data
Activity: Prioritizing Critical Question Topics
Exploring Solutions: Using CEDS Align & Connect
Wrap-Up

5. Joining PollEverywhere
By phone: Open a new text message to 22333, type DASY, send the message.
Online: Enter this URL into your browser: PollEv.com/dasy

6. PollEverywhere Prompt

7. Poll Prompt

8. A Look Across Fields: Asking Questions and Using Data
Speaker: Gary

9. Poll Prompt

10. Overview of DaSy Critical Questions

11. What are Critical Questions?
Questions that, when answered, provide information in areas deemed most important.
Questions a quality state data system should provide the data to answer.
Provide information, which when answered, help to improve results for children and families.

12. About the DaSy Critical Questions
Created in 2015
Collaboration
Serve as a starting point for further discussions

13. DaSy Critical Questions: 3 Sections
Child- and family-level
Practitioner-level
Local Early Intervention Services (EIS) program/Local education agency (LEA) level

14. DaSy Critical Questions: Question Types
Essential (Bread and Butter) Questions
Aspirational (Mountain Climber) Questions
Speaker: Gary

15. Critical Questions You May Have…
What are the characteristics of the practitioners working with children with IFSP/IEPs in general early care and education? 2.A.1
What are the levels of education and years of experience of the general early care and education practitioners working with children with IFSP/IEPs?
What is the cost of providing early intervention/early childhood special education services to children and families? 3.C.1
What is the average cost per child for EI/ECSE services statewide? For each EIS program/LEA?

16. Asking MORE Questions: An Example from the Maternal and Child Health Field

17. Title V Health Data: Key Topics
The Association of Maternal and Child Health Programs (AMCHP) wanted to identify and answer key questions related to Title V health data.
Topics of interest:
Developmental Screening
Autism
Community-Based Services

18. Title V Health Data: Key Questions
Developmental Screening
How many children birth through age 5 are receiving a developmental screening using a parent-completed screening tool?
How many children birth through age 5 are achieving five-domain developmental health as demonstrated by a parent-completed developmental screening results?
Source: AMCHP Title V Data Integration Toolkit

19. Title V Health Data: Key Questions
Autism
How many children birth through age 5 have a documented autism diagnosis?
What percentage of children birth through age 5 were diagnosed with autism based on a referral as a result of a screening or assessment?
Of the children diagnosed with autism, what percentage are receiving IDEA Part C services? What percentage are receiving IDEA Part B services?
Source: AMCHP Title V Data Integration Toolkit

20. Title V Health Data: Key Questions
Community-Based Services
Which programs and services are children birth through age 5 receiving?
What percentage of children birth through age 5 received a referral to any community service or program?
Source: AMCHP Title V Data Integration Toolkit

21. Answering Key Questions: ECIDS
Collects, integrates, maintains, stores, and reports information from early childhood programs
Crosses multiple agencies within a state that serve children and families from birth to age 8
Includes data on the individual child, the child’s family, the classroom, the program/providers, and other services that provide comprehensive care and education for young children
(What is an ECIDS, NCES 2014)

22. Poll Prompt

23. Why are states creating ECIDS?
Articulate access and availability
Distinct count of children
Sequence of programs and services for children
Investments in Early Childhood programs
Demonstrate cross-program decision-making
Transitions
School readiness
Child and family outcomes
State and federal reporting requirements (Shift from compliance)
Updated Head Start Program Performance Standards
IDEA Part C and Part B State Systemic Improvement Plans

24. Integrating Health Data
States are looking to integrate health data into integrated data systems
Operational or key instructional program data systems are NOT replaced
Organizational data can be leveraged to improve insights, policymaking, program management, and resource investments

25. The Toolkit Overview of ECIDS
Value of integrating and sharing Title V data
Tip Sheets
Use Cases
State examples
Available here.

26. The Use Cases
Essential Title V questions needing integrated data to answer
Suggested data elements that align to CEDS
Example analysis and data visualization
Possible actions based on data
Topics
Developmental Screening
Autism
Community-Based Services

27. Walk-Through of DaSy Critical Questions Analysis Plans

28. DaSy CQ Analysis Plans
In development for Question 1.B (expected release Summer 2018)
Step-by-step process
Preparing the data set
Data elements needed
Setting up and conducting analysis
Data Tables and Visualizations

29. DaSy CQ Analysis Plans

30. DaSy CQ Analysis Plans

31. DaSy CQ Analysis Plans

32. DaSy CQ Analysis Plans

33. Activity: Prioritizing Critical Question Topics

34. Critical Questions Activity
At each table, review the subset of critical questions.
Identify the top 2-3 broad questions (those in the green boxes) that are a priority for your role/program. Write the question “code” (e.g., 1.A.1) on the provided sticky notes.
Designate one table representative who will share back your top 2 -3 questions.

35. Table Share-Back
In 2 – 3 minutes, have your designated table representative:
Share with the large group the top 2-3 broad questions that are priorities for the folks at your table.
Provide your sticky note for the wall charts

36. Exploring Solutions: Using CEDS Align & Connect

37. Poll Prompt

38. What is CEDS?
What is CEDS?
Education Data Management Initiative

39. What is CEDS? (continued)
Education Data Management Initiative
Data Standard
Element
Definition
Option set
Domain
Entity

40. What is CEDS? (continued)
Education Data Management Initiative
Data Standard
Data Management Tool Set | Align

41. What is CEDS? (continued)
Education Data Management Initiative
Data Standard
Data Management Tool Set | Connect

42. Using CEDS Using CEDS to Develop Answers Import Data Dictionaries
Align to CEDS
Compare with Others
Analyze data

43. Using CEDS (continued)
Using CEDS to Develop Answers
Answer policy questions
Calculate metrics and indicators
Address reporting requirements

44. CEDS myConnect

45. CEDS myConnect

46. Activity: Finding CEDS Connections
Go to ceds.ed.gov
Under “Tools” in the toolbar, click “Connect”
Click “Find Existing Connection”
Select a category, use the search engine, or check out featured connections to identify a question of interest to you

47. Next Steps
When you return to your agency identify or gather the list of critical questions. Feel free to build from the examples provided by DaSy.
Once available, use the analysis plans to guide you through analyzing, reviewing, and presenting your data. Use the similar examples in the AMCHP Data Integration Toolkit to inform your work.
Check out other examples in CEDS Connect.

48. Wrap-Up

49. Key Resources
DaSy Critical Questions:
AMCHP Title V Data Integration Toolkit:
Common Education Data Standards:

50. Acknowledgment
The contents of this presentation were developed under a grant from the U.S. Department of Education, # H373Z However, those contents do not necessarily represent the policy of the U.S. Department of Education, and you should not assume endorsement by the Federal Government. Project Officers, Meredith Miceli and Richelle Davis.
Instructions to presenters: This slide is to be included as the last slide in your deck but you are not expected to show it to the audience. Please be sure to delete these instructions from this slide’s notes page in your presentation.