Enhancing quality in K-12 online learning: Course reviewing through a project-based partnership Jason Huett, Kim Huett, Steve Thompson, Aaryn Schmuhl, Justin Castile, and Sharon Synan Virtual School Symposium 2010

Who We Are University of West Georgia  Jason Huett  Kim Huett Henry County Schools  Steve Thompson  Aaryn Schmuhl  Justin Castile Georgia Department of Education  Sharon Synan Jason

1. Need for Project 2. Project Design 3. Outcomes from “Round 1” 4. Future Iterations 5. Questions & Discussion Presentation Structure Wiki Overlay vss2010.wikispaces.com Kim

 Preparing Teachers for the Future  Authentic Learning Experiences  Course Feedback to LEA Teacher Designers & Administrators  Improving Courses Along with Student Experiences and Student Outcomes 1. Need for Project Jason, Steve, Aaryn, Justin

A.Management B.Courses Reviewed C.Participants D.Phases 1, 2, 3, and 4 E.Wiki as Collaboration Space 2. Project Design Kim 33 graduate students reviewed 9 online courses.

2.A Management  1 professor (university)  1 project manager (university)  1 blended middle school principal (LEA)  1 online academy director (LEA)  1 technology support specialist (LEA) Kim

2.B C ourses Reviewed Luella Middle SchoolHenry County Online Academy 6th Science (3) 6th Math (3) 6th Agriculture Science (3) 7th Language Arts (3) 8th Social Studies (3) English 4 (4) US History (3) English 1, Team A* (3) English 1, Team B* (3) World History, Team A* (4) World History, Team B* (4) Reviewed 1 semester of each course. Number in parentheses = number of graduate student reviewers on team. Kim

2.C Participants  12 teachers ( teaching 9 courses)  33 graduate student reviewers Aaryn, Steve, Jason

2.D.1 Project Phases Phase 1 – individual reviewing  Graduate student reviewers review course using 2 instruments:  Content Alignment Document to determine to what extent course addressed Georgia Performance Standards (GPS)  National Standards of Quality for Online Courses (modified)  They post reviews to group wiki page. Kim Sample instruments posted to VSS Wiki Overlay.

2.D.1.a GPS Content Alignment Instrument MSAGED6-2: Students will express an understanding of the history of American agriculture. a) Specify and explain the role of agriculture in the formation of the US. Kim For each standard and element (criterion)… …reviewers would indicate whether the course covered the standard, and if at the appropriate level of Bloom’s Revised Taxonomy. “Understand” Level

2.D.1.b National Standards of Quality for Online Learning Kim Standard (# criteria)Example Criterion from Standard Content (12) A4. The course content and assignments are of sufficient rigor, depth, and breadth to teach the standards being addressed. Instructional Design (16) B2. The course is organized into units and lessons. Student Assessment (7) C3. Ongoing and frequent assessments are conducted to verify each student’s readiness for the next lesson. Technology (7) D7. The course utilizes appropriate content-specific tools and software. 21 st Century Skills (1) F1. The course intentionally emphasizes 21st century skills in the course…. Instrument uses a scale from 0 (absent) to 4 (no improvement needed).

2.D.2 Project Phases Phase 2 – social processing  Reviewers study groupmates’ Phase 1 feedback on same course.  Reviewers discuss findings with group.  Reviewers adjust individual Phase 1 documents on wiki, as needed. Kim

2.D.3 Project Phases Phase 3 – synthesizing & presenting  Reviewers analyze their Phase 2 discussions and identify themes related to these four areas:  Content  Instructional Design  Student Assessment  Technology & 21 st Century Skills  Reviewers create an online audiovisual presentation to share synthesis with client (using VoiceThread). Kim

2.D.4 Project Phases Phase 4 – reflection  Reviewers view final presentations of all other groups (in same semester);  Reviewers identify themes across all course reviews and reflect on value of project as well as recommend adjustments. Kim

2.E Wiki as Collaboration Space  Rationale for Using Wiki  Online Review Project Wiki Online Review Project Wiki Jason, Kim

 Preparing Teachers for the Future  Authentic Learning Experiences  Course Feedback to LEA Teacher Designers & Administrators  Improving Courses Along with Student Experiences and Student Outcomes 3.A.1 Outcomes, Round 1 Jason, Steve, Aaryn, Justin

 This course may be the most important course I take at W. GA…  This class is the best one I have taken in this program. I got real life experience that I can put on a resume…  I hope to teach online classes in the future, and this course has well prepared me for that.  This course has given me a stronger focus to be a change agent in my school system and to support distance education… 3.A.2 Grad Student Feedback Jason, Steve, Aaryn, Justin

 The course content was designed with a clear purpose to teach the skills necessary to perform the authentic ending project.  I feel like I am better prepared and more knowledgeable in the field of distance education after taking this course.  This course was fantastic. I was able to garner real world experience working with Henry County…I have a clearer understanding of what it takes to build and teach online.  This course has been nothing less than fantastic… reviewing the Henry County online courses gives excellent hands-on approaches to distance learning.  The Henry County project was the best learning experience out of everything I have done during my graduate work.  It was invaluable going through the process and then being allowed to put that knowledge and understanding to real world tasks. Jason

 This course has challenged me, prepared me, and… I feel equipped to go back in my individual community and make a difference.  Reviewing the Henry County classes also gave me real world experience…I am very excited about the future of online learning and am looking forward to more opportunities to explore this.  I cannot say enough good things about the course work! I have learned A TON this semester about distance education and participated in the most thought-provoking project - a true review of online courses. All I can say is WOW!  My confidence has risen dramatically. If I applied for a job, I would feel confident in what I know about online teaching….  I feel empowered.  Excellent! Superb! Exciting! Challenging! Thought provoking! Jason

3.B Ongoing Research Research & Data Analysis  Descriptive Analysis of National Standards Instrument  Qualitative Coding of VoiceThread Audio and Textual Data  Qualitative Coding of Post-surveys Jason

4. Future Iterations  Course review to continue  Less emphasis on state standards, more on design  Reviewer video walk-throughs  Bite-sized professional development  Stronger ties between graduate student reviewers and teacher designers Jason et al.

5. Questions & Discussion All

Thank you! Jason Huett – Kim Huett – Steve Thompson – Aaryn Schmuhl – Justin Castile – Sharon Synan –