Self-Paced But Not Alone! Research on Feedback and Computer-Assisted Instruction Rebecca Hoey, Ed.D. Northwestern College, Iowa What’s in the literature.

Slides:



Advertisements
Similar presentations
Online Course Design Online Course Design EVALUATION AND REVISION
Advertisements

Mt. Diablo Unified School District
Grading and Reporting Grades K-3. Purpose of Grading and Reporting Our primary purposes of grading and reporting include: Report student progress toward.
Assessing Student Learning TSS Participants: Dana Bradley Cheryl Hitchcock Arlecia Sewell.
Grading and Reporting Grade PLUS 4 th and 5 th Grade.
Comparison of School and KSU Assessment of Teachers
Grading and Reporting Grade PLUS 4 th and 5 th Grade.
An Introduction to Instructional Design Online Learning Institute Mary Ellen Bornak Instructional Designer Bucks County Community College.
Using the IDEA Student Ratings System: An Introduction University of Saint Thomas Fall
Systematic Assessment of Student Achievement February 5, 2007.
Session 3 Assessement of, for, & as Learning. Phases of Assessment Diagnostic Formative Summative Assessment.
Course (Re)design and the Chico Rubric Andrea Saltzman Martin Jim Julius SDSU Course Design Institute May 27, 2009.
Quality Matters TM : Introduction to QM and to the Rubric The Quality Matters™ Rubric 2008 – 2010 Edition Updated July 08.
An Orientation for Parents Fall What is MAP? Measures of Academic Progress Measures of Academic Progress Tests in reading, language, and math Tests.
MDTP and Formative Assessment Bruce Arnold MDTP Director mdtp.ucsd.edu.
Effective Grading Practices and Strategies Lynn Kelting-Gibson Ed.D. Department of Education.
© Arizona State University Data Based Decision Making November 2013.
WELCOME ACS Beirut Elementary School Progress Reports.
BY CONNER LANGREHR BENEFITS OF TECHNOLOGY USE. USE OF TECH IN THE CLASSROOM The usage of powerful new technologies in the classroom is the direction that.
Program Overview The College Community School District's Mentoring and Induction Program is designed to increase retention of promising beginning educators.
 offers free access to a world-class education  empowers people with common interests an education that would improve their lives or communities in.
Portfolios.
Portfolios: A Useful Resource For All Cynthia Cuellar Astrid Fossum Beth Schefelker The Milwaukee Mathematics Partnership (MMP), an initiative of the Milwaukee.
J. Martin EDIT 6900 A “PresentationQuest” Designing a Collaborative Learning Lesson Plan.
Share analysis with admin. Select team for Moby Max pilot
Using Assessment to Improve Student Learning: Where Assessment and Teaching Collide Kirk J. Armstrong, EdD, ATC Georgia College & State University Program.
Grade PLUS 4 th and 5 th Grade Grade PLUS Beginning with the school year, all 4 th and 5 th grade classrooms across Forsyth County.
Welcome Back. Celebrations  OGT Blitz  Academic coaching initiatives  Schedules for teacher support  OGT prep classes  Mastery Manager use  Exemplary.
INTERACTION, ENGAGEMENT AND MOTIVATION. WELCOME o Facilitator name Position at university Contact info.
Intel ® Teach Program Thinking with Technology Course Pn. Idawati Che Mat Jabatan Teknologi Pendidikan
Educator Growth and Professional Development. Objectives for this session The SLT will…  Have a thorough understanding of High Quality Standard 5: Educator.
Best Practices & What Works in Online Learning Assessments Renee Welch & Karin Riggs External Education September 28, 2006.
Principal’s Mid-Year Report Shelley Jusick Napoleon Middle School Math Goal.
English Now! Level D ELL Services Scoring The Writing Workshop Pretest and Posttest.
Professional Certification Professional Certification October 11, 2007 Standard: Effective Teaching Criteria 1(b) Using a variety of assessment strategies.
APRIL 16, 2013 A review of Chapters CHAPTER FOURTEEN The Role of Assessment VOCABULARY.
Jackson Elementary School Title I Information
Overview of the Texas Teacher and Principal Evaluation Systems.
TRSD ELEMENTARY SCHOOLS’ ACTION PLANS October 2, 2014.
Record Keeping and Using Data to Determine Report Card Markings.
Grading and Reporting Grades K-3. Purpose of Grading and Reporting Our primary purposes of grading and reporting include:  Report student progress toward.
Where Do We Go from Here? Next Generation Assessment Systems for Achievement and Accountability Presentation at the National Conference on Large Scale.
EPoster: Co-teaching in a collaborative environment The Orchestrators Kelly Taylor & Russ Simpson Summer 2005.
Guidelines For successful Portfolio Implementation by Melissa Wood.
An Integral Part of Professional Learning Communities.
An Assessment For Learning. A rubric is a scoring tool that lists the criteria for a piece of work, or “what counts” and clearly defines gradations of.
ANNOOR ISLAMIC SCHOOL AdvancEd Survey PURPOSE AND DIRECTION.
Identifying Assessments
More Than Multiple Choice Tests: Constructing Balanced Assessments Albemarle County Public Schools - October 2015.
Redesigning ENG 245 British Literature Chronology Truman State University Presented by Christine Harker and Patricia Gately, Associate Professors of English.
The combination of traditional Learning and e-learning.
Gathering Evidence to Achieve Results. A Culture of Collaboration - PLC Norms - Systems Support A Focus on Results -Pre-assessments -Common Formative.
Dr. Amy Barnhill. Implementing effective, responsive instruction and assessment Competency 7: The teacher understands and applies principles and strategies.
Exploring the Effects of Motivated Learning Support in a Problem-based Learning Environment Ming-Puu Chen National Taiwan Normal University Taipei, Taiwan.
ACS WASC/CDE Visiting Committee Final Presentation South East High School March 11, 2015.
21 st Century Learning and Instruction Session 2: Balanced Assessment.
Participation in Math Class: The Effect on Student Achievement By: Nicolas Millet.
Assessment and the Quality of Learning  Summative assessment: Gives a numerical mark or grade at the conclusion of a term of study.  Formative assessment:
Portfolios EDUC 307. Portfolio  a limited collection of student’s work used either to present the student’s best work(s) or to demonstrate the student’s.
Types of evaluation Categorized into four headings based on: Categorized into four headings based on: The nature of measurement The nature of measurement.
Overview of the Texas Teacher and Principal Evaluation Systems.
 Teaching: Chapter 14. Assessments provide feedback about students’ learning as it is occurring and evaluates students’ learning after instruction has.
Checklists EDUC 307. What is an Observation Checklist?  The observation checklist is a strategy to monitor specific skills, behaviors, or dispositions.
The pre- post assessment 3 points1 point Introduction Purpose Learning targets Instruments Eliminate bias & distortion Writing conventions.
ASSESSMENT METHODS – Chapter 10 –.
By Ray Lum, MPhil, MS Shannon Marquez, PhD, MEng S. DeVose, MA
NORTH CAROLINA TEACHER EVALUATION INSTRUMENT and PROCESS
Teacher Name Teacher Name Teacher Name Teacher Name Teacher Name
Discussion and Future directions
Presentation transcript:

Self-Paced But Not Alone! Research on Feedback and Computer-Assisted Instruction Rebecca Hoey, Ed.D. Northwestern College, Iowa What’s in the literature What was the research What were the results

Literature $4.9 billion was spent on self-paced computer-assisted instruction software by the K-12 sector in 2011 (Nagel, 2011) CAI is cost effective, promotes mastery learning, increases student achievement, and reduces teachers’ workload Student-teacher interaction is critical in online courses, particularly with K-12 students. CAI does not replace the need for teacher interaction; teachers must closely monitor students’ progress and communicate with students. Teacher feedback on students’ progress is imperative to student achievement, retention and satisfaction.

Research Experimental study with 52 secondary students in an online self-paced math course that relied exclusively on CAI for instruction and assessment. Four teachers participated in training to write standards- based, instructional, positive and timely feedback on all formative and summative assessment of treatment group students. Teachers self-evaluated their feedback, and external raters evaluated the feedback using the Feedback Quality Rubric Student achievement analyzed from pre- and posttest scores for each unit using a 2-factor mixed mode factorial design Student retention analyzed using a chi square

Teachers’ Overestimated Quality of Feedback

Teachers’ Failed to Provide Sufficient Feedback Percentage of Unit 2 Assessments that Received Feedback Teacher Total number of Pieces of Feedback Provided to Treatment Students on Assessments from Unit 2 Number of Pieces of Feedback Needed For All Treatment Students in Unit 2 Percentage of Assessments in Unit 2 That Received Feedback Teacher 15727% Teacher % Teacher % Teacher %

Student Achievement

Retention

Results