1. Innovative Pedagogical Practices Using Technology: IEA SITES Module 2 Design Presentation to the CMEC–OECD–Canada Seminar Robert Kozma SRI International

2. Second Information Technology in Education Study: SITES M2  Sponsored by the International Association for the Evaluation of Educational Achievement (IEA)  Funded by: participating countries with special funding from Denmark, Japan, Netherlands, Norway, US (NSF & Ed), Ford Foundation, private donor  Directed by an International Coordinating Committee (ICC)—US, Netherlands, Canada  International Steering Committee (ISC) of researchers in US, Netherlands, Japan, Norway, Hong Kong  28 participating countries—Europe, North America, South America, Asia, Africa  Coordinated with a study conducted by OECD

3. Participation  Australia  Canada  Chile  China Hong Kong  Chinese Taipei  Czech Republic  Denmark  England  Finland  France  Germany  Italy  Israel  Japan  Korea  Latvia  Lithuania  The Netherlands  Norway  Philippines  Portugal  Russian Federation  Singapore  Slovak Republic  Spain Catalonia  South Africa  Thailand  United States

4. Rationale  Rapid innovation in Information Communication Technologies have prompted increased interest for education  Growing investments in educational ITC at the national level to support educational reform and life-long learning  Need for models of how ITC can support innovative classroom practices  Need to address the digital divide

5. Builds on SITES M1  Survey of principals and technology coordinators in a random sample of schools in 23 countries.  Findings  Increase in computer—student ratio  Increase in classroom access to the internet  Emerging paradigm of innovative pedagogical practices  Supported by ICT

6. SITES M2 Goals  To identify and describe innovative pedagogical practices that use technology (IPPUTs)  To inform policies related to educational ICT  To provide teachers with information that they can use to improve classroom practices.  To add to the knowledge about the factors that contribute to the successful use of innovative technology-based practices.

7. Feeds into SITES M3  Survey of principals, technology coordinators, teachers, and students related to ICT resources and use  ICT-based performance assessment of students  ICT skills  Use of these skills to solve problems in science and math  Examine the role of ICT in changing what it is that students are learning. What new skills and knowledge is enabled by ICT?  Schedule 2002-2006

8. Goals of Coordinating the SITES & OECD Studies  Create complementary purposes for the studies  Maximize the number of countries that might participate in both studies  Minimize the conflict and redundancy between the studies

9. Example SITES M2 Research Questions  What are the innovative pedagogical practices in which teachers use ICT?  Which national and school policies related to staff development, Internet access, etc. are potentially effective in supporting these innovations?  How do these practices change what teachers and students do in the classroom?  What impact do these practices have on student outcomes? How have they changed the way outcomes are assessed?

10. Conceptual Framework  Innovative pedagogical practices; changes in:  Curricular content  Teacher & student practices  Ways of using ICT  Outcomes and assessment  Context  Micro level  Meso level  Macro level

11. Study Design  Each country formed a national panel  The panel reviewed international criteria and proposed modifications, if appropriate  They applied the criteria and select up to 12 cases—a total of 174 cases.  NRCs used standard protocols and instruments to collect data and write case reports  ICC is conducting cross-case analysis and write international report

12. Criteria for Selecting Cases  Significant changes in teacher and student roles or activities; curriculum goals, content or assessment  Technology plays an essential role  Measurable student outcomes  Sustainable & transferable  Innovative, as locally defined

13. Quality Monitoring  Coordinate conceptual framework, research questions, & instruments  ICC pre-pilot test instruments  Qualitative technical consultant who reviewed instruments and analytic approach  NRC pilot test revised instruments  ICC monitored panel formation, criteria modification, case selection, pilot studies, and case studies  NRCs exchanged 1 case report with other NRC critical friend & ICC  ICT-based coordination

14. Data Analysis Plan Mixed Qualitative and Quantitative Approach  Level 1:  High level coding of cases based on conceptual framework  Analysis of trends among cases  Level 2:  Identification of cases that typify trends  Detailed coding within selected cases  Analysis of details of trends and relationships

15. Schedule October 2001: Countries completed data collection & case write up Oct 2001-January 2002: ICC Level 1 analysis Feb- June 2002: Level 2 analysis & report writing July-December 2002: Dissemination

16. Reporting and Dissemination International:  brochure  project report  press release & conference  website  conference presentations National dissemination plans  national reports  national websites  Other material (video)s and events?

17. SITES M2 Website  URL: sitesm2.org