1. Enhancing quality in K-12 online learning: Course reviewing through a project-based partnership Jason Huett, Kim Huett, Steve Thompson, Aaryn Schmuhl, Justin Castile, and Sharon Synan Virtual School Symposium 2010

2. Who We Are University of West Georgia  Jason Huett  Kim Huett Henry County Schools  Steve Thompson  Aaryn Schmuhl  Justin Castile Georgia Department of Education  Sharon Synan Jason

3. 1. Need for Project 2. Project Design 3. Outcomes from “Round 1” 4. Future Iterations 5. Questions & Discussion Presentation Structure Wiki Overlay vss2010.wikispaces.com Kim

4.  Preparing Teachers for the Future  Authentic Learning Experiences  Course Feedback to LEA Teacher Designers & Administrators  Improving Courses Along with Student Experiences and Student Outcomes 1. Need for Project Jason, Steve, Aaryn, Justin

5. A.Management B.Courses Reviewed C.Participants D.Phases 1, 2, 3, and 4 E.Wiki as Collaboration Space 2. Project Design Kim 33 graduate students reviewed 9 online courses.

6. 2.A Management  1 professor (university)  1 project manager (university)  1 blended middle school principal (LEA)  1 online academy director (LEA)  1 technology support specialist (LEA) Kim

7. 2.B C ourses Reviewed Luella Middle SchoolHenry County Online Academy 6th Science (3) 6th Math (3) 6th Agriculture Science (3) 7th Language Arts (3) 8th Social Studies (3) English 4 (4) US History (3) English 1, Team A* (3) English 1, Team B* (3) World History, Team A* (4) World History, Team B* (4) Reviewed 1 semester of each course. Number in parentheses = number of graduate student reviewers on team. Kim

8. 2.C Participants  12 teachers ( teaching 9 courses)  33 graduate student reviewers Aaryn, Steve, Jason

9. 2.D.1 Project Phases Phase 1 – individual reviewing  Graduate student reviewers review course using 2 instruments:  Content Alignment Document to determine to what extent course addressed Georgia Performance Standards (GPS)  National Standards of Quality for Online Courses (modified)  They post reviews to group wiki page. Kim Sample instruments posted to VSS Wiki Overlay.

10. 2.D.1.a GPS Content Alignment Instrument MSAGED6-2: Students will express an understanding of the history of American agriculture. a) Specify and explain the role of agriculture in the formation of the US. Kim For each standard and element (criterion)… …reviewers would indicate whether the course covered the standard, and if at the appropriate level of Bloom’s Revised Taxonomy. “Understand” Level

11. 2.D.1.b National Standards of Quality for Online Learning Kim Standard (# criteria)Example Criterion from Standard Content (12) A4. The course content and assignments are of sufficient rigor, depth, and breadth to teach the standards being addressed. Instructional Design (16) B2. The course is organized into units and lessons. Student Assessment (7) C3. Ongoing and frequent assessments are conducted to verify each student’s readiness for the next lesson. Technology (7) D7. The course utilizes appropriate content-specific tools and software. 21 st Century Skills (1) F1. The course intentionally emphasizes 21st century skills in the course…. Instrument uses a scale from 0 (absent) to 4 (no improvement needed).

12. 2.D.2 Project Phases Phase 2 – social processing  Reviewers study groupmates’ Phase 1 feedback on same course.  Reviewers discuss findings with group.  Reviewers adjust individual Phase 1 documents on wiki, as needed. Kim

13. 2.D.3 Project Phases Phase 3 – synthesizing & presenting  Reviewers analyze their Phase 2 discussions and identify themes related to these four areas:  Content  Instructional Design  Student Assessment  Technology & 21 st Century Skills  Reviewers create an online audiovisual presentation to share synthesis with client (using VoiceThread). Kim

14. 2.D.4 Project Phases Phase 4 – reflection  Reviewers view final presentations of all other groups (in same semester);  Reviewers identify themes across all course reviews and reflect on value of project as well as recommend adjustments. Kim

15. 2.E Wiki as Collaboration Space  Rationale for Using Wiki  Online Review Project Wiki Online Review Project Wiki Jason, Kim

16.  Preparing Teachers for the Future  Authentic Learning Experiences  Course Feedback to LEA Teacher Designers & Administrators  Improving Courses Along with Student Experiences and Student Outcomes 3.A Outcomes, “Round 1” Jason, Steve, Aaryn, Justin

17. 3.B Ongoing Research Research & Data Analysis  Descriptive Analysis of National Standards Instrument  Qualitative Coding of VoiceThread Audio and Textual Data  Qualitative Coding of Post-surveys Jason

18. 4. Future Iterations  Course review to continue  Less emphasis on state standards, more on design  Reviewer video walk-throughs  Bite-sized professional development  Stronger ties between graduate student reviewers and teacher designers Jason et al.

19. 5. Questions & Discussion All

20. Thank you! Jason Huett – jhuett@westga.edu Kim Huett – khuett@westga.edu Steve Thompson – sthompson@henry.k12.ga.us Aaryn Schmuhl – aschmuhl@henry.k12.ga.us Justin Castile – justin.castile@henry.k12.ga.us Sharon Synan – ssynan@doe.k12.ga.us