1. MassCUE Evaluators Data Collection Creating Questions Mapped to Indicators

2. Evidence/Data Collection zQuantitative and qualitative data zClassroom observation, interviews, and work- product review zFocus groups and surveys zStudent assessment data zData sources for secondary analysis zTriangulation among data sources

3. Writing Good Questions z“Yes/No” questions zLeading questions zOpen-ended questions zMultiple choice/controlled vocabulary questions zLikert scale issues

4. Surveys zCreating good surveys yLength yDifferentiation (teachers, staff, parents, community, etc..) yQuantitative data yAttitudinal data yTiming/response rates (getting returns!) zwww.sun-associates.com/masscue/othertools.htmlwww.sun-associates.com/masscue/othertools.html

5. Focus Groups/Interviews zFocus Groups/Interviews yTeachers yParents yStudents yAdministrators yOther stakeholders ywww.sun- associates.com/masscue/samplequestion s.htmlwww.sun- associates.com/masscue/samplequestion s.html

6. Classroom Observations zUsing an observation template ywww.sun- associates.com/masscue/sampletmplt.pdfwww.sun- associates.com/masscue/sampletmplt.pdf zSetting up the observation zProviding opportunity for short interviews

7. Data Collection Issues zSampling zConfidentiality zObjectivity

8. Secondary Analysis zUtilizing existing assessments yCross-year comparisons yMCAS item analysis zRemember, any data you use needs to be mapped to your indicators!

9. Other Data? zArtifact analysis yA rubric for analyzing teacher and student work? ywww.sun-associates.com/masscue/samplelprubric.docwww.sun-associates.com/masscue/samplelprubric.doc yOther types of rubrics ywww.sun-associates.com/masscue/EssenCondRubric.pdfwww.sun-associates.com/masscue/EssenCondRubric.pdf zSolicitation of teacher/parent/student stories yThis is a way to gather truly qualitative data yWhat does the community say about the use and impact of technology? yStudent Drawings

10. Student Drawing Example 1

11. Student Drawing Example 2

12. Student Drawing Example 3

13. Writing Good Questions z“Yes/No” questions zLeading questions zOpen-ended questions zMultiple choice/controlled vocabulary questions zLikert scale issues

15. Next Steps,Your Work zWork on the matrix today zThere will be sharing later this afternoon zComplete the matrix and send it to us before Day 3 (we’ll set that date by the end of this month) zJeff and Jeanne will provide feedback to each team