1. … what did Delaware do? Ensuring representative sample for Family Survey….

2. 2 The Basics Already had existing Family Survey in place OPEC (Ongoing Program Evaluation Committee) provided guidance on survey creation and modifications Updated questions now include those that align with Federal Outcomes

3. 3 The Basics Letters mailed to explain Family Survey Postcard reminder sent Up to four attempts made to survey families via phone For those families with no phone– surveys are hand-delivered by Service Coordinators

4. 4 The Basics Initially conducted through telephone survey. Starting this year, survey can be accessed by families through Survey Monkey (in English and Spanish), or may respond through telephone survey (surveyors made up to four attempts), or hand delivered by Service Coordinators University of Delaware conducts survey and analyzes results

5. 5 The Basics Unique Identifier  Allows for identification of primary household language to ensure appropriate survey version  Ensures no duplication of responses  Allows oversampling for demographic indicators  Allows for further data analysis

6. 6 The Basics Survey includes families with:  children who are currently enrolled in Part C and have been enrolled for at least 6 months and  children who were enrolled in Part C for at least 6 months and who have transitioned from Part C within the past 6 months

7. 7 The Basics To achieve representative sample, matrix is used and we oversample the population  How do we know when we have a representative sample? As we fill the cells, we know if we have any areas where we need to concentrate our efforts….  Goal for each cell is 30% of eligible population Cells are defined by  geographic region (North/South)  Ethnicity (African American/Caucasian/Other)  Eliminated in 2008 Survey: length of time in program (less than 18 months/more than 18 months)

8. 8 The Basics Even though Sampling Matrix does not include gender, data is analyzed to ensure results are representative of the population we serve Delaware did not report out gender as part of Indicator 4/Family Outcomes in FFY06 APR

9. 9 The Basics Response rates for 2007:  Initial sample size of 433  158 surveys completed  36.5% response rate Response rate for 2008  Initial sample size of 556  189 surveys completed  34% response rate

10. 10 Sampling Matrix from 2008 Family Survey Cell Number In Cell (a) “Contact- able” Families (b) Goal for Cell (c) Number of Completed Surveys in Cell (d) % of Completed Surveys (d/a) North, Caucasian 176152536235.23% North, African American 10768332624.30% North, Latino 342112926.47% North, Other 3531131645.71% South, Caucasian 118101364134.75% South, African American 4632141532.61% South, Latino 3923142051.28% South, Other 11--00.00% Total 556429175189

11. 11 Ensuring Statewide Race/Ethnicity Representation for 2008 Family Survey + as reported 08-08-08CDW Program Rate = 618 data

12. 12 Ensuring Regional Race/Ethnicity Representation for 2008 Family Survey Ethnic Background 2008 Results North Surveys Completed CDW North Program Rate South Surveys Completed CDW South Program Rate Caucasian54.87%50.70%53.95%58.10% African American23.01%30.40%19.74%23.10% Latino7.96%9.50%26.31%16.90% Other14.16%9.40%0.00%1.90% CDW Program Rate = 618 data

13. 13 Representation by Region for 2008 Family Survey FrequencyPercent CDW Program Rate North11560.8%62.8% South6836.0%37.2% Missing63.2%--- CDW Program Rate = 618 data

14. 14 Above and Beyond APR Reporting Delaware also analyzes data by: Gender Length of time in program for questions regarding transition planning (State focus)  removed in 2008 as variable in sampling because cell sampling size became too small and analysis by length of time in program showed no difference except in questions on transition planning

15. 15 So Delaware asks: What are the minimum requirements in ensuring representativeness?

16. 16 2007 Family Survey Report can be viewed on Delaware’s Birth to Three website: http://www.dhss.delaware.gov/dhss/dms/epqc/birth3/directry.html 2008 Family Survey Report will become available in the fall Delaware’s Contacts: Rosanne Griff-Cabelli, Part C Coordinator rosanne.griff-cabelli@state.de.us rosanne.griff-cabelli@state.de.us Susan Campbell, Asst Part C Coordinator susan.campbell@state.de.us susan.campbell@state.de.us