New York State Report Cards

Slides:



Advertisements
Similar presentations
Rosemary Matt NYS Director of Accountability April 2014.
Advertisements

COMMON MEASURES Presented by: Phil Degon Workforce Administration September 2006.
COMMON MEASURES. Training Objectives Review Common Measures data sources Discuss Reports and Desk Aids.
It must be borne in mind that the tragedy of life does not live in not reaching your goal. The tragedy of live is having no goal to reach. Benjamin E.
Central Southern Tier RAEN July 17,  Goal Setting Targets are removed from Report Card and Program Evaluation Reports 10 points.
Overview and Discussion of NRS Changes. Massachusetts Department of Elementary and Secondary Education 2 NRS Changes for FY13 AGENDA  Review changes.
New York State Report Cards Program Report Cards Fiscal Year 12/13 Presented by: Rosemary Matt.
New York State Report Cards Program Report Cards Fiscal Year 10/11 Presented by: Rosemary Matt NYS Director of Accountability.
New York State Report Cards Program Report Cards Fiscal Year 08/09 Presented by: Rosemary Matt NRS Liaison for NYS.
The National Reporting System: Foundations Technical College System of Georgia Office of Adult Education.
1 Literacy and Numeracy Gains Webinar February 3, :00 am - 11:00 am.
Understanding the NRS Rosemary Matt NYS Director of Accountability.
NRS Changes & Implications Central Southern Tier RAEN December 14, 2012.
LIVING WITH WIOA.  WIA= Workforce Investment ACT  WIOA= Workplace Innovation and Opportunity Act (July 2014)
The National Reporting System: Foundations Technical College System of Georgia Office of Adult Education.
New York State Report Cards Program Report Cards Fiscal Year 09/10 Presented by: Rosemary Matt NYS Director of Accountability.
Adult Education Assessment Policy Effective July 1 st, 2011.
New York State’s Report Card Summary.  Evaluated in TWO Methods NYS Benchmarks Quartile Ranked Educational Gain = 46% Post Test Rate = 65% Follow Up.
Understanding the NRS Rosemary Matt NYS Director of Accountability.
Understanding the National Reporting System Rosemary Matt NYS Director of Accountability NRS.
New York State Report Cards Rosemary Matt NYS Director of Accountability
Rosemary Matt Director of Accountability for Adult Education.
MAERS Quick Reference Tool Kit MAERS Development Team.
1 WIOA Review. Try This Cross your arms 2 Now cross your arms the other way. How does it feel? 3.
WIOA Performance Regulations and New NRS Tables CARRIE TUPA TEXAS WORKFORCE COMMISSION ADULT EDUCATION AND LITERACY.
WIOA’s Goal Make Participants’ Skills Everyone’s Business
LEAP Into WIOA, Part II: NRS Measures and Reporting
Department of Labor, Licensing and Regulation
Dr. Kristen Corbell Director of Program Quality and Accountability
Brian Frazier Talent Investment Agency Office of Adult Education
ABE Policy & Accountability
Presented at: INA Multi-Regional Conference Miami, FL January 2017
WIOA Section 166 – Indian and Native American Program
WIOA + MAERS = Performance
Rosemary Matt NYS Accountability
Welcome back Finger Lakes RAEN adult education FY
YCC Performance and Reporting
WIOA and Performance Enhancements
PoPs and MSGs How reporting will be affected in 17/18 based on new Period of Participation and Measurables Skills Gain tracking.
Important Changes New York State Report Cards Program Report Cards
Introduction to Performance and Accountability in Adult Education
Priority Data Strategies for FY2015 Finger Lakes RAEN
The Application of Common Measures
Part 2 Carrie Tupa Texas Workforce Commission December 6, 2017
Defining Student Success in WIOA*
Conducting Follow-Up Great Expectations V
Poll Question Have you read the Supplemental Wage Information Guidance issued under TEGL 26-16, PM 17-6, and TAC 17-04?
WIOA Accountability Ben Konruff
NRS Updates Long island raen part II
Kim Miller Oregon Department of Education
Adult Education Adult Literacy Job Training Employer Specific Training.
ABE Performance Measures, Accountability and Assessment
NRS Updates Long island raen part I
Basic Skills and Continuing Education: Working Together for the Future
Central Southern Tier RAEN
NRS Updates and Changes
Understanding Transition Data Reporting under WIOA
English Language Acquisition
Managing Performance Under WIOA
Important Changes New York State Report Cards Program Report Cards
Making Common Sense of the Common Measures
ASISTS Program Manager’s Training
Office of Adult Education Instructional Services Team
Technical Assistance Webinar
Office of Adult Education Instructional Services Team
WIOA Youth Performance
Data Management for FY2017 Reporting
Workforce Innovation and Opportunity Act (WIOA)
NRS Training: Reporting Student Performance on Table 4 - ABE Scenarios
NRS Training: Reporting Student Performance on Table 4 - ESL Scenarios
Presentation transcript:

New York State Report Cards Rosemary Matt NYS Director of Accountability Rosemary.Matt@cayuga-cc.edu

www.nysed.gov http://www.acces.nysed.gov/document-search?filename=&field_type_of_document_tid%5B%5D=310&=Search

NYACCE - NYSED Presentation FY 2015 - 2016 Evaluated with TWO Methods NYS Benchmarks Quartile Ranked Educational Gain = 51% Post Test Rate = 70% Follow Up Outcomes = 69% Educational Gain (Weighted) Post Test Rate Follow Up Outcomes R. Matt/NRS Liaison for NYS

Educational Gain = 51% Post Test Rate = 70% NYS Benchmarks FY15/16 Follow Up Outcomes = 69%

Quartile Ranks Missed one or more benchmark & in the 1st quartile Unacceptable Missed one or more benchmark & in the 1st quartile Needs Improvement Missed one or more benchmark & in the 2nd, 3rd, or 4th quartile Proficient Has met all the benchmarks (any quartile) Highly Proficient Has met all the benchmarks & in quartile 4

NYS Benchmark Summary: Meeting NRS Criteria Check Funding Sources

NYS Benchmark Details: Benchmark uses Unweighted Gain

Weighted Academic Gain: Quartile Ranked

Educational Gain Benchmark NYS average in FY14/15 was 61% Educational Gain Benchmark remained 51% in FY16

Post Test Rate Quartile Ranked remained 70% in FY16 NYS average in FY14/15 was 82%

# students achieving goal # students exiting with goal Follow Up Outcomes: Raw numbers used to calculate Program Performance Percentage # students achieving goal # students exiting with goal = 74%

Follow Up Outcomes: Not used in the calculation

Follow Up Outcomes: Therefore, the remaining 3 outcomes carry more weight into the 69% benchmark

Survey Response Rate:

Quartile Rank Summary:

Final Ranking:

Final Ranking: Quartiles Quartile 1 0 - .99 Quartile 2 1 – 1.99

Overall Performance: 1.53 Quartile 1 Quartile 2 Quartile 3 Quartile 4 1 2 3 4 1.53

Total Score – Calculations for FY14/15 NYACCE - NYSED Presentation Total Score – Calculations for FY14/15 Maximum rating points to be earned: Weighted Academic Gain 50 Follow-up Measures 20 Post Test Rate 20 Response Rate 10 Maximum Total 100 R. Matt/NRS Liaison for NYS

Report card statistics (147 Programs) Benchmark status Number of agencies Did Not Meet NYS Benchmarks 21 Met NYS Benchmarks 126 Program rating Unacceptable 7 Needs Improvement 5 Proficient 131 Highly Proficient 16

Workforce Innovation and Opportunities Act WIOA Workforce Innovation and Opportunities Act FY16-17

NATIONAL REPORTING SYSTEM NRS New York’s REPORTING SYSTEM NYRS

What has changed? New terminology New reporting timelines New expectations New ISRF Reminders

New Terminology

Participant vs Reportable Individual A reportable individual who has received services after satisfying all applicable programmatic requirements for the provision of services, such as eligibility determination. To be considered a Participant, the student must be pre tested. TABE Math and Reading, BEST Plus 2.0, or BEST Literacy Reportable individual. An individual who has taken action that demonstrates an intent to use program services and who meets specific reporting criteria of the program, including: (1) Individuals who provide identifying information; (2) Individuals who only use the self-service system; or (3) Individuals who only receive information-only services or activities.

Participant vs Reportable Individual For Title II, when an individual in an AEFLA program has completed at least 12 contact hours and have a valid pre test they are considered a participant. An adult in an AEFLA program who has completed less than 12 contact hours. Participants count towards accountability measures. Reportable Individuals DO NOT count towards accountability measures however, they will be counted.

Program Entry and Exit Program Entry- is the date that a reportable individual enrolls in an adult education program. Program Exit - As defined for the purpose of performance calculations, exit is the point after which a participant who has received services through any program meets the following criteria: For the adult, under Title II, the exit date is the last date of service. The last day of service cannot be determined until at least 90 days have elapsed since the participant last received services; services do not include self-service, information-only services, activities, or follow-up services. This also requires that there are no plans to provide the participant with future services. Does this mean that a student who tells the program that they are not returning can’t be exited from the program until 90 days have passed? The rule did not have language regarding program entry.

Program Entry and Exit Program Exit – New Policy for New York State When no attendance is recorded for 90 consecutive days in ASISTS, the student will be automatically exited. Data check reports are being constructed to provide programs with the names of those students who have been automatically exited. Programs will not be exiting their students as done in the past. Does this mean that a student who tells the program that they are not returning can’t be exited from the program until 90 days have passed? The rule did not have language regarding program entry.

Periods of Participation For the purposes of reporting measurable skill gain, each time a participant enters during a reporting period, it is considered a period of participation. For the purposes of reporting on Employment 2nd Quarter, Employment 4th Quarter, Median Earnings, and the Credential indicators, each program entry and exit per participant during the reporting period is considered a period of participation. A new period of participation is counted each time a participant exits and reenters again, even if it occurs during the same program year.

Employment Performance Indicators All Students, regardless of employment status MUST be Tracked for Employment Performance Indicators This includes those students who are: Employed at Entry Unemployed at Entry and Seeking Employment Not in the Labor Force *the only exclusion are students in Incarcerated Settings New York will participate in the UI Data Matching process for those students with Social Security Numbers. Students without Social Security Numbers must be tracked manually with documentation log of date, time, and response from contact.

Employment Performance Indicators Employment, the Second Quarter after Exit: The percentage of participants who are in unsubsidized employment during the second quarter after exit. Median Earnings, Second Quarter after Exit: Median earnings of participants who are in unsubsidized employment during the second quarter after exit from the program. Employment, Fourth Quarter after Exit: The percentage of participants who are in unsubsidized employment during the fourth quarter after exit.

Measurable Skill Gain Indicator The percentage of participants who, during a program year, are in an education or training program that leads to a recognized postsecondary credential or employment and who are achieving measurable skill gains, defined as academic, technical, occupational, or other forms of progress, towards such a credential or employment. Translation: The Secondary Credential will now count as a Measurable Skill Gain!!

New Reporting Timelines

FY15/16 Reporting Deadline = September 30 FY16/17 OCTAE is moving the State Deadline up to October 15th from December 31st Reporting Deadline = September 15th

New Individual Student Record Form (ISRF)

Very important piece of information Intake staff are now asked to attest to having made the request

Employment Status must be TRACKED Student’s annual income Training is now a very specific type and recorded specifically as well

Supplemental Form must be completed for any student that returns from FY15/16 The ISRF Supplemental Form must be included in the student’s permanent file

Reminders

BEST Plus 2.0 BEST Plus 2.0 ALL ESL students must have a valid BEST Plus 2.0 or if they score out of top range, a BEST Literacy or TABE Glitch in ASISTS, not counting just yet, will be fixed

BEST Plus 2.0 BEST Plus 2.0 NRS Educational as of Functioning Level If BEST Plus 2.0 Pre-Test is 565 or Higher, the BEST Literacy will count NRS Educational Functioning Level BEST Plus 2.0 as of July 1, 2016 Beginning ESL Literacy 88 to 361 Low Beginning ESL 362 to 427 High Beginning ESL 428 to 452 Low Intermediate ESL 453 to 484 High Intermediate ESL 485 to 524 Advanced ESL 525 to 564 Exit criteria from NRS 565 and higher

Questions? Rosemary.matt@cayuga-cc.edu