Education Data Services & Educator Evaluation Team Reporting Educator Evaluation Information in EPIMS for RTTT Districts April – May, 2013 Robert Curtin and Samantha Warburton

Agenda  Why is ESE collecting educator evaluation information?  What data is ESE collecting?  Who is ESE collecting data on?  When is ESE collecting the data?  Reporting tips, validations, and exception requests  ESE Public Reporting  Contact page  Questions 2

Why is ESE collecting Educator Evaluation Data?

Purpose: ESE Goals  Assess effectiveness of district evaluation systems and overall implementation  Identify areas for increased ESE support  Increase strength of educator pipeline and career continuum  Ensure equitable distribution of effective educators 4

Purpose: Legislation  “The board shall establish and maintain a data system to collect information from school districts for the purpose of assessing the effectiveness of district evaluation systems in assuring effective teaching and administrative leadership in the public schools.” An Act Providing for the Implementation of Education Evaluation in School Districts, Section 2 5

Confidentiality: Legislation  “Such information shall be made available in the aggregate to the public; provided, however, that any data or information that school districts, the department or both create, send or receive in connection with educator evaluation that is evaluative in nature and which may be linked to an individual educator…that may be used as part of an individual educator’s evaluation, shall be considered personnel information…and shall not be subject to disclosure…” An Act Providing for the Implementation of Education Evaluation in School Districts, Section 2 6

Regulations  “Districts shall provide [ESE] with individual educator evaluation data for each educator in the district in a form and manner prescribed by the Commissioner, including, but not limited to:  the educator's performance rating on each standard and overall;  the educator has Professional Teacher Status;  the educator's impact on student learning, growth, and achievement (high, moderate, low).” 603 CMR (5) 7

Confidentiality: Regulations  “Any data or information that school districts or the Department or both create, send, or receive in connection with educator evaluation that is evaluative in nature and may be linked to an individual educator…that may be used as part of an individual educator's evaluation, shall be considered personnel information…and shall not be subject to disclosure under the public records law.” 603 CMR (6) 8

What data is ESE collecting?

What are we collecting? Implementation Perspective EPIMSEducator Evaluation Data PointResponses SR28Professional Teacher Status Yes, No Not Applicable SR29 Overall Summative Evaluation Rating OR Formative Evaluation Rating Unsatisfactory, Needs Improvement, Proficient, Exemplary Not Applicable, Not Evaluated SR30- SR33 Standards I, II, III, and IV Unsatisfactory, Needs Improvement, Proficient, Exemplary Not Applicable, Not Evaluated SR34Impact Rating High, Moderate, Low Not Applicable  Seven data points: NOT APPLICABLE FOR ALL EDUCATORS THIS YEAR  At least 50% of the educators in all Race to the Top districts must have been evaluated under the new system in

Not Applicable vs. Not Evaluated  Not Applicable: educator is not required to have been evaluated (e.g. position does not require ESE license)  Not Evaluated: educator is required to be evaluated but district did not evaluate/issue rating in SY 11

What are the implementation implications?  RTTT schools and districts must be prepared to report ratings on at least 50% of educators in the district  Reporting Formative and Summative Evaluation Ratings  Report ratings on all four Standards as well as Overall Summative Rating 12

What are we collecting? EPIMS Perspective Response required: Not Applicable (99) for ALL educators for SY 13

Not Applicable vs. Not Evaluated  Not Applicable: use when the EPIMS data element is not associated with the job classification(s) of the individual reported in the EPIMS work assignment file  Not Evaluated: use when the EPIMS data element is relevant to the job classification(s) of the individual reported in the EPIMS work assignment file, but no information is available 14

Who is ESE collecting data on?

 Race to the Top districts  Educators in a position that requires an ESE license  A minimum of 50% of educators across the district 16

Who is ESE collecting data on?  There are 42 EPIMS job classifications for which a MA license is required  Job classifications are broken down into:  25 Administrator job classifications ­ Principals are a subset  17 Non-Administrator job classifications ­ Teachers are a subset 17

Administrators 1200Superintendent of Schools/Charter School Leader/Collaborative Director 1215Supervisor/Director/Coordinator of Curriculum 1223Supervisor/Director/Coordinator: Science 1201Assistant/Associate/ Vice Superintendents 1216Supervisor/Director/Coordinator: English Language Learner 1224Supervisor/Director/Coordinator: Technology 1202School Business Official1217Supervisor/Director/Coordinator: English 1225Supervisor/Director/Coordinator of Professional Development 1205Other District Wide Administrators1218Supervisor/Director/Coordinator: Foreign Language 1226School Nurse Leader (SNL) 1210Supervisor/Director of Guidance1219Supervisor/Director/Coordinator: History/Social Studies 1305Principal/headmaster/headmistres s/head of school 1211Supervisor/Director of Pupil Personnel 1220Supervisor/Director/Coordinator: Library/Media 1310Deputy/associate/vice-/assistance principal 1212Special Education Administrator1221Supervisor/Director/Coordinator: Mathematics 1312School Special Education Administrator 1213Supervisor/Director/Coordinator: Arts 1222Supervisor/Director/Coordinator: Reading 1320Other School Administrator/ Coordinator 1214Supervisor/Director/Coordinator of Assessment 18

Non-Administrators 2305Teacher2330Instructional Coach3361School Psychologist -- Special Education 2306Co-Teacher3329Guidance Counselor3370School Social Worker -- Non- Special Education 2307Virtual Course Teacher3330Librarians and Media Center Directors 3371School Social Worker -- Special Education 2308Virtual Course Co-Teacher3350School Adjustment Counselor -- Non-Special Education 5020School Nurse -- Non-Special Education 2310Teacher - support content instruction 3351School Adjustment Counselor -- Special Education 5021School Nurse -- Special Education 2325Long Term Substitute Teacher3360School Psychologist -- Non- Special Education 19

When is ESE collecting the data?

End-of-Year 2013 Data Collection Schedule SIMSEPIMSSCS Window Opens6/1/2013 Due Date & Preliminary Certification 7/05/2013 Edits/Duplicates7/5/ /12/2013 Final Certification 7/12/20138/16/2013 Extensions have been eliminated. 21

Reporting tips, validations, and implementation exception requests

Reporting Tips Matrix EPIMS Data ElementRequired DataResponseRace to the Top Districts SR28Professional Teacher Status Yes (01) No (02) Not Applicable (99) Required to report on EOY EPIMS collection Required response: Not Applicable (99) for all job classifications that do not require an ESE license SR29 Overall Summative Rating or Formative Evaluation Rating Exemplary (04) Proficient (03) Needs Improvement (02) Unsatisfactory (01) Not Evaluated (00) Not Applicable (99) Required to report on EOY EPIMS collection Response of required for minimum of 50% of educators within a district Required response: Not Applicable (99) for all job classifications that do not require an ESE license SR30 – Standard I SR31 – Standard II SR32 – Standard III SR33 – Standard IV Evaluation Rating on each of the Standards (I-IV) Exemplary (04) Proficient (03) Needs Improvement (02) Unsatisfactory (01) Not Evaluated (00) Not Applicable (99) Required to report on EOY EPIMS collection If district reports a Summative or Formative Rating (SR29) for an educator, districts must also report on all four Standards (SR30- SR33) Required response: Not Applicable (99) for all job classifications that do not require an ESE license SR34Student Impact Rating* Low (01) Moderate (02) High (03) Not Evaluated (00) Not Applicable (99) Required response: Not Applicable (99) for 100% of educators in EOY EPIMS collection 23

Validation Decision Tree 24

Validation Rules Must Correct Before Submitting Data:  SR34 (Impact Rating) must be Not Applicable (99) for all educators  SR28-33 (PTS, all ratings) must be Not Applicable (99) for all educators in job classification that does not require an ESE license  NOTE: any educator can be evaluated under new system; ESE will only collect ratings on educators for whom it is required Request Implementation Exception from ESE:  SR29-SR33: if any element is not equal to 99 or 00, all elements must be not equal to 99 or 00  All educators must be rated on all four Standards and issued an overall summative or formative evaluation rating  Administrator positions: if SR29 is 03 or 04, SR30 must be 03 or 04  Admins must be rated Proficient or Exemplary on Standard I to be rated Proficient or Exemplary Overall  Non-admin positions: if SR29 is 03 or 04, SR30 and SR31 must be 03 or 04  Teachers/non-admins must be rated Proficient or Exemplary on Standards I and II to be rated Proficient or Exemplary Overall 25 More information to come on process

Implementation Exception Requests  Data must be as accurate as possible  Errors in implementation should not be corrected during data entry  Implementation exception requests will be handled by a forthcoming defined policy 26

EPIMS Transactional Reports 1.At the district and school level for the overall summative or formative evaluation rating All Evaluated Administrators Principals (District level only) Non-Administrators Teachers The following data points: # of staff # evaluated % Exemplary % Proficient % Needs Improvement % Unsatisfactory % Not evaluated 2.List of educators in the evaluated job classifications that are not evaluated 27

ESE Public Reporting

Public Reporting  “Such information shall be made available in the aggregate to the public; provided, however, that any data or information that school districts, the department or both create, send or receive in connection with educator evaluation that is evaluative in nature and which may be linked to an individual educator…that may be used as part of an individual educator’s evaluation, shall be considered personnel information…and shall not be subject to disclosure…” An Act Providing for the Implementation of Education Evaluation in School Districts, Section 2 29

How will data be publicly reported?  Aggregated at the district and school levels  Will be reported in a manner that ensures individual educator confidentiality  Reported on ESE website, beginning with data for RTTT districts  Data Advisory Committee comprised of external stakeholders (e.g. superintendents, principals, union/association presidents) advising ESE on public reporting 30

Proposed Public Reporting 31  Report at district and school level:  What? ­ # staff and # evaluated; % not evaluated ­ % of educators at each performance level (Exemplary, Proficient, Needs Improvement, & Unsatisfactory)  Overall Summative/Formative Rating  Rating on Standards I, II, III, & IV ­ Professional Teacher Status  Who? ­ All evaluated ­ Administrators  Principals (On district report only) ­ Non-administrators  Teachers

Highlights:  Data collection opens June 1, 2013 and closes on August 16, 2013  Seven data points being collected from RTTT districts in (SR28-SR34; SR34 must be Not Applicable)  Report on minimum of 50% of educators in the district  Districts must report Not Applicable on all data elements for educators who are not required to have an ESE license for any job classifications  ESE anticipates that Year 1 implementation data will contain errors reflecting misconceptions  We are eager to learn where districts need additional support and clarification! 32

33

Resources and Contacts

Online Resources  EPIMS Data Collection Online Resources pims/  Educator Evaluation Team Online Resources Quick Reference Guide: Educator Evaluation Data Collection 35

Contacts  For questions about Educator Evaluation implementation and requirements, contact:   For questions about Educator Evaluation data collection, contact:  Your ESE Data Collection Support Specialist (Locate the name of your specialist at

QUESTIONS? 37