MassCUE Evaluators – Maximizing Your Technology Investment Documenting the Impact of Instructional Technology Initiatives

Who We Are zSun Associates yJeff Sun yJeanne Clark ywww.sun-associates.com/masscue yMassCUE and Boston College

Why Evaluate? zDetermine if your investment in instructional technology is “paying off” zMeasure progress toward meeting your project goals zSupport action planning with data

An Evaluation Plan… zIs organized around the goals of your project zDefines success through the creation of indicators keyed to your project goals zProduces data specifically targeted at measuring success relative to your project goals zProvides feedback and recommendations for improvement

An Example Project ziPad implementation in an elementary school (grades 3 – 5) zGoals… yIncrease the ability to support project-based, small group learning yDecrease cost of materials such as texts, reference materials, etc.

Schematic View of the Evaluation Process

Indicators zPedagogy yStudents involved in the iPad project are engaged in student-centered, project-based, activities that make use of 1:1 access to info, resources and collaborative online environments. Teachers have been provided with the training necessary to support the pedagogy involved in the project. zMaterials/Infrastructure

yImplementation of iPads (1:1) in grades 3 – 5 results in an initial first year savings of 10% compared to the cost of texts, paper resource materials, photocopying, and teacher time involved in moving students to and from the computer lab. 10% additional savings are anticipated for each of the next 3 years.

Data Collection Students involved in the iPad project are engaged in student-centered, project-based, activities that make use of 1:1 access to information, resources and collaborative online environments. Teachers have been provided with the training necessary to support the pedagogy involved in the project. zStudent-centered, project-based, learning yClassroom observations yTeacher focus groups/interviews yReview of lessons plans yRubrics z1:1 access yClassroom observations zInformation resources, collaborative environments, tools yClassroom observations yReview of lessons and student work product (against rubrics) zTeacher professional development yTeacher learning plans yProfessional development observation yTeacher focus groups/interviews yProfessional development participant surveys

Analysis and Findings zData analysis – comparing data to indicators -- will show the degree to which actions (PD, pedagogy, student work, infrastructure implementation) come together to produce the intended result. zFindings are the results of this analysis.

For Example… zIf you discover that teachers are not actually using the iPads for project-based learning – what are reasons for this? zOne reason might be related to the PD zDid the PD support the development of new pedagogies? zHow could the PD – content, structure, follow-up, participation – be modified to better support the initiative?

Recommendations zFindings (analysis) lead to recommendations and reporting. zRecommendations lead to action items. yWhat are you going to do to implement the recommendations?

What Does This Mean to You? zThe MassCUE Evaluators’ project will yWork with a team from your district to develop an evaluation plan with indicators and data collection tools yOffer training and support in data collection and reporting yPosition your district to logically reflect upon its progress toward meeting programmatic goals and substantiating your investment in instructional technology

Participation zEach district should register a 4 to 6 person team ySuperintendent or Assistant Superintendent yTechnology specialist or coordinator yCurriculum and Instruction specialist yProfessional development specialist yClassroom teacher or instructional specialist who works with students zMassCUE members fee = $2400 for a 4-person team ($3400 for a 6-person team) z4 full-day sessions starting in January, 2012 (2 in January, 1 in February, and 1 in March) zFee covers lunch and follow-up support by Sun Associates and Boston College

zIngrid Eppelsheimer at