Evaluating 1:1 Initiatives and Other Technology Initiatives The MassCUE Evaluators Program

zSun Associates yProgram evaluators yState and local initiatives ywww.sun-associates.com/masscuewww.sun-associates.com/masscue zOur take on evaluation yEvaluation is a part of a strategic approach to project planning and implementation yLinks vision to goals to actions to measures

MassCUE Evaluators zA professional development project that helps districts integrate evaluation within projects: yClearly articulate goals yPlan and coordinate activities strategically yDevelop performance measures zThe majority of the districts currently in the program are focusing on designing evaluations for iPad and 1:1 initiatives.

zBedford zBurlington zConcord zNeedham zReading zWayland zDanvers zDuxbury zHopkinton zHudson zWinchester

zIn our experience, most projects need to answer the “What’s the value?” question. zParticularly, the educational – teaching and learning – value. zPreparing for this in advance can insure a smooth progression for your project.

A Strategic Approach zIt starts with a central claim yHow will this initiative positively impact teaching and learning? yWhat issues does this initiative address, and what solutions does it propose? yYour claim should connect to core values of teaching and learning…not just the need for technology.

zThe claim will be supported by data on how your project goals are addressed, and ultimately through evaluation, how well your project is meeting the claim. yCurrent status – documenting the situation before your implementation yFormative assessment – documenting the impact your project is having

Indicators and Outcomes

zIndicators are developed by a committee of stakeholders to your project … the MassCUE Evaluators team! yTeachers, administrators, technology staff, and others yThis also generates broad buy-in to the project and its perceived value…which is helpful in terms of sustainability

Gathering Data zThe next task is to develop data collection tools and to collect data based on the indicators yTeachers yStudents yParents/Community yTechnical

zObservations zSurveys zFocus Groups zRelevant Technical and Cost Information MassCUE Evaluators learn how to create and use these data collection tools

Analysis zWith data in-hand, the task is to analyze the collected data against the indicators yThe indicators serve as performance benchmarks zFindings provide the answer to the basic question of yIs the project accomplishing what it set out to do? yIn sum, this is what the evaluation addresses.

zReporting yThe whole point of the evaluation is to communicate the progress – formative and summative – of your project yReporting should be to your school or district community yRemember, you can report on your current status…and this establishes the baseline for the gains and benefits that your project will bring.

Other Benefits of the Process zThe evaluation provides data that can guide the scaling up of initiatives yWhat’s working in the pilot? yWhat needs to be tweaked in the next round of the project implementation?

Summary Points zCentral Claim – what are you aiming for? zIndicators – what domains does your project address? zBaseline Data Collection – establishes “readiness” and identifies strategic priorities for your project to address zOn-Going Data Collection – Observations, surveys, focus groups, etc. zFormative/Summative Reporting – communicating success and engaging your community in the project’s implementation

How to Join zThe next cohort starts in January zwww.masscue.org zwww.sun-associates.com/masscuewww.sun-associates.com/masscue