1. Evaluating with Multimedia Tools Harouna Ba EDC Center for Children & Technology www.edc.org/CCT

2. Evaluation Goals Impact of a Complex Multimedia Science Project on Students’ Experiences and Learning –Diverse population of students

3. Methods Print: interviews, surveys, and questionnaires, classroom observations, and inquiry tools Video-assessment Online databases: journals, message boards, and chat.

4. Multimedia Tool Affordances Print: –Contextual information –Students’ learning Video-assessment and online databases: –Reliability issues –Complexity of students’ learning –Technology use

5. Major Findings JASON IMPACT ON TEACHERS JASON changes teaching practice in terms of collaboration, project-based learning and alternative assessment. JASON increases teachers’ use of technology.

6. Major Findings (Cont.) JASON IMPACT ON STUDENT LEARNING –JASON hands-on and environmental exploration activities are engaging and appealing to the students. –JASON curriculum makes science real and relevant. –Most JASON students acquired scientific inquiry and analytical skills, and outperformed non- JASON students.

7. Major Findings (Cont.) COMMON CONTEXTUAL ISSUES AND CHALLENGES –Curriculum –Teachers –School and district requirements

8. Major Findings (Cont.) –The success of JASON depends on the teacher. The project attracts teachers who take a hands- on approach to science and enjoy learning new subjects. The project gives teachers ideas for labs and activities. The project requires dedication and innovation on the part of teachers.

9. Major Findings (Cont.) –The JASON curriculum is adaptable. Teachers pick and choose activities from the curriculum. Teachers select activities that support state and district standards. Teacher reuse activities.

10. Major Findings (Cont.) –District and School constraints impeded the process. Even inexpensive materials add up in cost when used with many students. Schools/districts do not always pay for training for all JASON teachers. Teachers have no time to coordinate interdisciplinary projects with other teachers. Lack of access to technology prevents teachers from taking advantage of online resources. Stressed teachers cannot integrate new material into existing curriculum.