Damian Bebell James Burraston Center for the Study of Testing, Evaluation, & Educational Policy Lynch School of Education Boston CollegeDec 15, 2014 Natick.

Slides:



Advertisements
Similar presentations
Second Information Technology in Education Study (SITES) A Project of the International Association for the Evaluation of Educational Achievement (IEA)
Advertisements

WV High Quality Standards for Schools
Report to the KSD Board June 9, Provide Kent School District the necessary guidance and assistance to create an equitable, academically enriching,
PRESENTED BY: LINDSAY UNIFIED SCHOOL DISTRICT THOMAS L. ROONEY, SUPERINTENDENT LANA BROWN, DIRECTOR OF CURRICULUM & INSTRUCTION High School Transition.
TOSS-BFK Administrators’ Evaluation Crosswalk to School-wide Changes
1 Getting to the Core of the Common Core State Standards What they are! & How they came to be! Implications for Policy and Practice Advanced Literacy Panel.
April 6, 2011 DRAFT Educator Evaluation Project. Teacher Education and Licensure DRAFT The ultimate goal of all educator evaluation should be… TO IMPROVE.
On The Road to College and Career Readiness Hamilton County ESC Instructional Services Center Christina Sherman, Consultant.
Round Table Discussion- Evaluating Arts Teachers William Kohut, Principal- Denver School of the Arts Dr. Mark Hudson- Director of Arts- Denver Public Schools.
Karen L. Mapp, Ed.D. Deputy Superintendent, Boston Public Schools
Student Growth Developing Quality Growth Goals II
Blended Learning Rubric BMS Faculty Meeting – September 10.
Unit Assessment Plan Weber State University’s Teacher Preparation Program.
What is program success? Wendy Tackett, Ph.D., Evaluator Valerie L. Mills, Project Director Adele Sobania, STEM Oakland Schools MSP, Michigan.
Bluebonnet Elementary School Celebrations and Recommendations for Continuous School Improvement Round Rock Independent School District Module 7 Assignment.
The Impact of Project Based Learning on High School Biology SOL Scores Rhiannon Brownell April 1, 2008 ECI 637 ECI 637 Instructor: Martha Maurno, M.S.
Session Materials  Wiki
Silas Deane Middle School Steven J. Cook, Principal Cynthia Fries, Assistant Principal October 22, 2013 Wethersfield Board of Education.
Collaboration I nstruction Assessment 1st AnalysisReflection Intervention Assessment 2nd COMING FULL CIRCLE Mallard Creek and UNCC PDS Work Plan Outcomes.
Family, School, and Community Partnerships: A Model for Pre-service Teacher Education Presentation at Center for Research, Evaluation & Advancement of.
Horizon Middle School June 2013 Balanced Scorecard In a safe, collaborative environment we provide educational opportunities that empower all students.
Goals of This Session Provide background for program review development Describe document make-up.
1 Curriculum and Instruction Report Pocantico Hills School February 28, 2005.
One Voice – One Plan Office of Education Improvement and Innovation MI-CSI: Do Stage Implement Plan and Monitor Plan.
Southern Regional Education Board HSTW An Integrated and Embedded Approach to Professional Development and School Improvement Using the Six-Step Process.
ALP and ICAP Say What?.
Cindy M. Walker & Kevin McLeod University of Wisconsin - Milwaukee Based upon work supported by the National Science Foundation Grant No
Universal Design for Learning in the College Classroom Abstract This Faculty Learning Community (FLC) integrated components of Universal Design for Learning.
Striving to Link Teacher and Student Outcomes: Results from an Analysis of Whole-school Interventions Kelly Feighan, Elena Kirtcheva, and Eric Kucharik.
Elementary & Middle School 2014 Mathematics MCAS Evaluation & Strategy.
Elementary & Middle School 2014 ELA MCAS Evaluation & Strategy.
PROPONENTS: Isabelita R. Hizon, Ed. D. Susan O. Habacon INQUIRY-BASED COLLABORATIVE LEARNING PROGRAM (ICLP) FOR MANAGING LARGE CLASSES AND ITS EFFECT ON.
TIMBERLANE REGIONAL SCHOOL DISTRICT ACTION PLANS Timberlane Regional Middle School Timberlane Regional High School Timberlane Regional Music Department.
English Language Arts Single Plan for Student Achievement.
NCATE Standard 3: Field Experiences & Clinical Practice Monica Y. Minor, NCATE Jeri A. Carroll, BOE Chair Professor, Wichita State University.
1 Milwaukee Mathematics Partnership Program Evaluation Year 6 Results Carl Hanssen Hanssen Consulting, LLC Cindy Walker University of Wisconsin-Milwaukee.
Assessment of an Arts-Based Education Program: Strategies and Considerations Noelle C. Griffin Loyola Marymount University and CRESST CRESST Annual Conference.
CRESST’s Evaluation of the Artful Learning Program: “Findings,” Contexts, and Future Explorations Noelle Griffin,Ph.D UCLA Graduate School of Education.
+ Voorheesville CSD Strategic Plan Community Forum September 30, 2015.
Classroom Technology Plan By Saundra Tyson-Dawson E7801 Instructional Technology Planning and Management Dr. Regina Merrwether.
By: Jaqueline Lundie & Darren West EDIT 6900 Spring 2011.
After lunch - Mix it up! Arrange your tables so that everyone else seated at your table represents another district. 1.
1 Milwaukee Mathematics Partnership Program Evaluation Year 5 Results Carl Hanssen Hanssen Consulting, LLC Cindy Walker University of Wisconsin-Milwaukee.
MEAP / MME New Cut Scores Gill Elementary February 2012.
The New York State School Improvement Grant Initiative Five Years On Office of Professional Research & Development, Syracuse University, NY.
TPEP Teacher & Principal Evaluation System Prepared from resources from WEA & AWSP & ESD 112.
ENGAGING FACULTY IN REFORM / MARCH 4, COMMUNITY COLLEGE RESEARCH CENTER MARCH 4, 2014 Building Buy-in, Supporting Instructional Improvement Susan.
SITE 2015 Conference March 04, 2015 Jeffrey A. Stone, Ph.D. Penn State University.
1. Administrators will gain a deeper understanding of the connection between arts, engagement, student success, and college and career readiness. 2. Administrators.
STEM EDUCATION TRANSFORMATION Barbara McAllister May 2013 INTEL’S MODEL FOR.
Mathematics Program Improvement Review. KWL Complete the following sections of the KWL Chart K – What you know? W – What you want to know? We will complete.
Mathematics Program Improvement Review. KWL Complete the following sections of the KWL Chart K – What you know? W – What you want to know? We will complete.
MacArthur Elementary School Curriculum Night September 17, 2015 September 21, 2015.
Changes in Professional licensure Teacher evaluation system Training at Coastal Carolina University.
Hudson Area Schools - Lincoln Elementary School Improvement Professional Development Friday, February 26, 2010.
Office of Service Quality
Dr. Derrica Davis Prospective Principal Candidate: Fairington Elementary School.
What does it mean to be a RETA Instructor this project? Consortium for 21 st Century Learning C21CL
Evaluation Results MRI’s Evaluation Activities: Surveys Teacher Beliefs and Practices (pre/post) Annual Participant Questionnaire Data Collection.
East Longmeadow Public Schools SMART Goals Presented by ELPS Leadership Team.
APR 2014 Report: Data, Analysis and Action Plan for Full Accreditation.
Indicator 5.4 Create and implement a documented continuous improvement process that describes the gathering, analysis, and use of student achievement.
Welcome to the (ENTER YOUR SYSTEM/SCHOOL NAME) Data Dig 1.
1 Perspectives on the Achievements of Irish 15-Year-Olds in the OECD PISA Assessment
STEM and Expanded Learning in Providence N ATIONAL A CADEMY OF E NGINEERING N ATIONAL R ESEARCH C OUNCIL — B OARD ON S CIENCE E DUCATION Committee on Integrated.
Outcomes By the end of our sessions, participants will have…  an understanding of how VAL-ED is used as a data point in developing professional development.
Middle School Training: Ensuring a Strong Foundation of Supports
Board on science education
Gary Carlin, CFN 603 September, 2012
Presentation transcript:

Damian Bebell James Burraston Center for the Study of Testing, Evaluation, & Educational Policy Lynch School of Education Boston CollegeDec 15, 2014 Natick Public Schools 21 st Century Teaching and Learning Study: Evaluation Results

Background and perspective Empirical educational research, measurement, and evaluation Background in psychometrics, measurement, and evaluation Leveraging technology to advance the state of the art in educational research and measurement… Data for the sake of data vs Ownership of “success” and ongoing formative use of information

Quantifying computer access US Average Student : Computer Ratios 1983 = 125 : = 6 : = 4 : =3 : 1 Source: Market Data Retrieval, Public School Technology Survey ; Education Week, 2007; Gray, Thomas, & Lewis, 2010

Shared access Sporadic use Limited impact 1:1 Computing The rise of 1:1 Computing 1:1 computing programs continuously evolving Widespread proliferation across world Few programs have more than 5 years experience Fewer still have invested in empirical research and evaluation efforts So, lots of interest but limited research and evidence

1:1 student computing research 1:1 defines critical technology access…pedagogical inferences Emphasis on selection and mechanics of program, more limited understanding of how teaching and learning change Building level leadership Pedagogical and content support for teachers Systematic reflection, asking questions, and willingness to adapt/evolve Many different definitions of success

Natick/Boston College Research Partnership September June 2014 Design and conduct external study to document impacts and changes as students and teachers transition to new technology rich computing environments. Document through a series of reports and presentations potentially evolving teaching and learning practices afforded by the rich learning settings. Document how Natick teachers and students accessing, using, and relating to technology in support of teaching and learning. Provide NPS with a rich empirical model (and data) for all future inquiries and investigations concerning the relationship between technology practices and a variety of outcomes.

Natick/Boston College Research Partnership Acknowledgments School Leadership Teachers Students District Leadership Natick Community

Long Term Goals/Outcomes Student Outcomes/Program Goals Decrease behavioral and attendance issues Decrease special education/ACT referrals Increase in students’ computer use time in all subject areas Increase in student use of computers for doing homework in all subject areas Increase in homework completion Staff/Teacher Outcomes/Program Goals Increase in teachers use of technology-based resources to enhance instruction Increase in teachers allowing students to use multiple technology-based resources to address assessment demands Increase in the frequency that teachers structure learning opportunities that: are inquiry-based, include a writing component, allow students to engage with and utilize technology-based resources, and allow students to demonstrate mastery In Year 1 (2012/2013), revision of at least one unit per trimester where technology is used to transform learning from a traditional teacher-directed curriculum-based activity to a blended learning experience with an inquiry-based mode of facilitating learning Decrease the number of teacher complaints concerning the lack of technology resources available for instruction

NHS Research/Evaluation Design 7 th -12 th Student Survey (*Fall 2010, Fall 2012, Spring 2013) *92% of the NPS seventh grade student population participated in a pilot survey in Fall th -12 th Teacher Survey (Fall 2012, Spring 2013) Classroom Observations Focus Groups Staff Interviews Secondary analyses of school records (achievement, attendance, Special Ed status, course patterns) Student Video Competition

NHS Student Video Competition “How have computers and technology changed the way you learn new things and/or how your teachers teach.”

Survey Response Rates/Parent Consent

So, what did we learn?

Selected Results Intro to Results Dramatic increase in student tech use/shift in teacher practices Exploring trends within the student results Student and Teacher Beliefs Exploring Quantitative Impacts and Outcomes

Results: Students’ increased use of technology across grades and subject areas

Major increase in students’ frequency of technology use across core classes ( ):

Major shifts in students’ classroom practices ( )

Major shift in teacher’s frequency of technology use in the classroom ( ):

Shifts in teachers’ classroom computer use according to students ( )

Where (and how often were) NHS students using technology in 2014?

Digging deeper in the Results: Exploring trends within student practices ( )

Exploring gender differences in frequency of NHS boys and girls technology use across their classes

Exploring differences in student and teacher technology use across NHS students enrolled in one or more honors courses

Exploring differences in student practices comparing NHS students enrolled in one or more honors courses

Exploring differences in student practices across socio-economic status for NHS students

Results: Natick Student and Teacher Attitudes and Beliefs

Natick students report using a computer in school improves their education:

Natick teachers report using a computer in school improves their teaching:

Results: Empirically examining student outcomes associated with 1:1 Computing and new facilities

Impacts on NHS student homework completion Average number of minutes completing home per night and the percent of homework completed using a computer

Impacts on NHS student homework completion Average homework completion rates self-reported by students

Impacts on NHS Student Attendance Average student absences before and during first year 1:1 implementation

Impacts on NHS Student Attendance Distribution of student absences before and during the first year of 1:1 computing There appears to no relationship between students reported frequency of technology use in school and their absences

Impacts on NHS Student Discipline Paired-sample t-tests examining change in frequency of detentions from the school year to

Impacts on NHS Student Discipline Independent-samples t-tests comparing students technology-related disciplinary problems from 2012/2013 to 2013/2014 across grade levels

Impacts on NHS Student Discipline Average teacher and student perceptions of students' ability to get around the school Internet filter

Impacts on NHS Special Education Percentage of students who received various levels of special education services during the last year in the old high school building and the first year in the new building.

Impacts on NHS student achievement Average ELA and Math MCAS scaled scores over time for the NHS class of 2015 and 2016

Impacts on NHS student achievement Percentage of students who scored "proficient" or better on the MCAS from 6th to 10th grade for classes of 2015 and 2016

Impacts on NHS student achievement Percentage of students who scored as “proficient” or higher on the 10th grade MCAS from 2009 to 2014.

Revisiting Long Term Goals/Outcomes Student Outcomes/Program Goals Decreasing behavioral and attendance issues Decreasing special education/ACT referrals Increase in computer use time in all subject areas Increase in student use of computers for doing homework in all subject areas Increase in homework return rates Staff/Teacher Outcomes/Program Goals Increase in the frequency that teachers use technology-based resources to enhance instruction Increase in the frequency that teachers allow students to use multiple technology- based resources to address assessment demands Increase in the frequency that teachers structure learning opportunities that: are inquiry-based, include a writing component, allow students to engage with and utilize technology-based resources, and allow students to demonstrate mastery In Year 1 (2012/2013), revision of at least one unit per trimester where technology is used to transform learning from a traditional teacher-directed curriculum-based activity to a blended learning experience with an inquiry-based mode of facilitating learning Decrease the number of teacher complaints concerning the lack of technology resources available for instruction

Questions/Follow Up Damian Bebell, Principal Investigator James Burraston, Research Associate