Student Perception Survey: Survey Coordinator Training Office of Policy and Evaluation April 2016

Session Objectives Understand the background and purpose of the Student Perception Survey What is the Student Perception Survey? What type of questions are on the survey? Understand your role as a coordinator 2

Outline Overview of Student Perception Survey Panorama Education and the Survey Instrument Survey Administration Role as a Survey Coordinator 3

Overview of the Student Perception Survey 4

The Panorama Student Survey is a research-based, anonymous student survey used across the country to provide teachers with students’ feedback about their classroom experiences. The Student Perception Survey will be used for formative purposes only and replaces the Tripod Student Survey, previously piloted for use with Advance, NYCDOE’s teacher development and evaluation system. 5

Overview of the Student Perception Survey Teachers, principals, and administrators will receive reports of the results prior to the school year. In addition to an interactive online survey report, teachers will have access to the Panorama Education Playbook, an online professional development tool that allows teachers to share practices and create a personalized playbook of instructional strategies based on the needs of their students and classroom. 6

Overview of the Student Perception Survey 28 questions measuring 5 different scales Available on paper and online Can be completed in less than 30 minutes 7

Panorama Education and the Survey Instrument 8

Panorama Student Survey  NYCDOE will administer the Panorama Student Survey  The Panorama Student Survey was developed by Panorama Education in partnership with the Harvard Graduate School of Education  The Panorama Student Survey is used in diverse school cities across the country with student populations that mirror NYCDOE  The Panorama Student Survey was piloted at 35 NYCDOE schools in

Survey Scales The survey will ask students questions across five scales:  Pedagogical Effectiveness  Classroom Climate  Rigorous Expectations  Classroom Engagement  Teacher-Student Relationships 10

Survey Administration and Professional Development  Playbook enables teachers to find strategies to use in their classes that are aligned with the survey scales and gives teachers access to a community of educators to support their professional learning. 11

Survey Administration and Professional Development 12

Survey Administration and Professional Development 13

Survey Administration 14

When will the survey be administered? The survey administration window is May 2 - June 17 Schools can choose to administer on any day(s) within that survey window 15

Which teachers are eligible to participate in the 2016 Student Perception Survey? Teachers of grades 6-12 who teach at least 10 students SETTS, 6:1:1, Push-In, Pull-Out, and AIS teachers if they teach at least 10 students If teachers do not meet the 10 student minimum in one course, teachers can have up to two of their classes surveyed. Teachers who have less than 10 student respondents will not receive a report. For D75, only teachers of students in grades 6-12 who are in a 12:1:1 class and who take standardized assessments 16

Which students are eligible to participate in the 2016 Student Perception Survey? Students in grades 6-12 Students should be taught by the teacher for at least 4 weeks prior to survey administration For teachers who teach students less than five days per week, an effort should be made to survey students who have had at least 10 class meetings with the teacher 17

When will materials arrive? All materials will arrive the week of April 18 Each shipment will include: Survey welcome letter for survey coordinators A roster of all eligible teachers Shrink-wrapped survey packs for every eligible teacher that include the surveys (paper administration) or access code letters (online administration) Survey administration instructions for proctors A bundle of translation guides for schools administering the paper version of the survey 18

Number of surveys per eligible teacher Largest section of student enrollment greater than surveys Largest section of student enrollment is between surveys Largest section of student enrollment is less than surveys Gym teachers75 surveys 19

Translation Survey Guides Schools with paper survey administration will receive translated copies of the survey in the 9 DOE supported languages: Arabic Bengali Chinese French Haitian Creole Korean Russian Spanish Urdu 20

Translation Survey Guides (continued) Students will be able to use a translated copy of the survey side- by-side with the English version of the survey. Students will bubble in responses only on the English version of the survey. 21

Translation Survey Guides (continued) Students at schools with online survey administration can complete the survey online in any of the 9 DOE supported languages. 22

Students with Disabilities If necessary, accommodations can be made to assist students with disabilities Accommodations should not compromise survey confidentiality Example: If a student provides responses orally, a teacher who is not the subject of the survey must proctor the survey 23

Proctoring The best practice is for a different pedagogue or administrator other than the teacher who is the subject of the survey to proctor the survey In all instances, proctors should clearly communicate to students which teacher is the subject of the survey Ensure that all proctors are prepared to administer the survey following the instructions provided in the survey packs Exception: If a principal determines that, based on scheduling, it is not feasible to implement this best practice, then the school may administer the survey with teachers proctoring their own classes 24

Collecting and Returning Paper Surveys Proctors should wait until all students complete the survey before having one student collect the completed surveys Must ensure all individual envelopes have been sealed Completed surveys must be returned to the survey coordinator The proctor can discard or recycle all unused survey materials and translation guides or return the unused materials to the survey coordinator who will discard them Use the pre-paid FedEx return label included in your survey shipment for shipping completed surveys to Panorama. Please save this original box in which the materials were shipped to your school so that you may use it to return your surveys to Panorama. 25

Scheduling Administration We recommend that students take the survey during third period for their third period teacher Exceptions: Teachers who do not teach third period should administer the survey in the school’s second to last period Teachers who teach neither periods should administer the survey in whatever period would be least disruptive to instruction time Survey may be administered during another period chosen by the principal or school leader ensuring that all students are surveyed the same time Co-teachers should have students take the survey for one co-teacher at the scheduled survey period and complete the survey for the other co-teacher during another class period 26

Scheduling Helper The Student Perception Survey Scheduling Helper will be available on the Student Perception website at It can assist you with the scheduling process by allowing you to: View a list of all teachers eligible to participate in the Student Perception Survey at your school Understand how many surveys each teacher will receive in the shipment Review and edit the recommended course sections that should be surveyed for a given teacher (note: courses have been defaulted to 3rd period) Examine how many students are currently enrolled in the selected course sections to ensure that there are enough surveys provided to administer within that course section 27

Scheduling Helper (continued) The Student Perception Survey Scheduling Helper will be available on the Student Perception website at 28

Survey Ethics Guidelines for administration of the survey:  Respondents may fill out the survey in a totally confidential manner without any influence over their responses from anyone  School leaders and other school personnel should avoid any breach, or the appearance of a breach, in survey confidentiality for students  School leaders and school staff should avoid taking any steps that influence or suggest – or have even the appearance of attempting to influence or suggest – the survey answers that respondents provide  Further ethics guidance is available for review at

Survey Ethics (continued) “Please fill out the survey! Your participation is valuable to our school!” “Please complete the survey. Your positive feedback is important!” 30

Survey Ethics (continued) “Students, please read the survey carefully. Your feedback will help improve our classrooms.” “Students, please read the survey carefully. As you read, think about the support your teachers provide. Your feedback will improve our classrooms.” 31

Role as a Survey Coordinator 32

Role As Coordinator Primary point of contact Oversee o Distribution o Administration o Return 33

Survey Logistics 34 Speak with Principal About:  What date(s) survey administration will occur at school? (survey window: May 2 – June 17)  Which school-wide period or periods will be surveyed?  Who will proctor those corresponding course sections?

Survey Logistics 35 Proctoring Guidance:  Distribute survey packs to the proctors.  Create an accommodation plan for English Language learners and students with disabilities.  Ship the completed surveys back to Panorama Education for processing and analysis. Surveys need to be shipped on or before Friday, June 17, 2016.

Communicate to Teachers The Student Perception Survey is not being administered as a component of Advance and will not be part of their Advance rating. The results of this survey will be used for formative purposes only (i.e., to guide practice). Teachers will receive individual survey reports, principals will receive school-wide reports, and superintendents will receive district-wide reports. The results from the Student Perception Survey will not be otherwise shared. 36

Questions? 37

Resources 38 Student Perception Website: Scheduling Helper Survey Ethics Reference Guide FAQ Panorama Education: Playbook: