1. Performance – What is it? (and how do I manage it) Bec JacksonSeptember 17 th 2010 ACE National Senior Policy Officer Terry Thomson Business Analyst - APM

2. Once upon a time…. 4% 6% 9% 11% 14% 21% 18% 12% 5% 0% 5% 10% 15% 20% 25% 1.01.52.02.53.03.54.04.55.0 Star Rating

3. In a program far far away… KPI1: Efficiency Retention between DPI and 12 months(5%) Retention between 12 and 18 months where no outcome (5%) KPI2: Effectiveness 13 week employment outcome(30%) 26 week employment outcome(40%) (5%) VET 13 week outcome (5%) Average weekly wage from work (higher better)(5%) 12 month employment status(5%) Employment assistance (NB: weightings are separate) KPI 1: Effectiveness/Efficiency Remain in employment and leave maintenance KPI 2: Effectiveness (10%) Remain in employment – same or better earnings(30%) Remain in employment(60%) Workers in Maintenance (NB: weightings are cumulative) Average hours per week in work (higher better) KPI 3: Quality of Disability Open Employment services (pass/fail)

4. The New Framework KPI Performance Measure DMS Weighting ESS Weighting Efficiency 1.1Responsive55 1.2 Time taken to achieve employment outcome 55 Effectiveness 2.1Job Placements55 2.213 week Full Outcome2520 2.3 13 week Pathway Outcome 55 2.4 13 week Bonus Outcome 55 2.526 week Full Outcome3530 2.6 26 week Pathway Outcome 55 2.7 26 week Bonus Outcome 55 2.8Ongoing Support515

5. The New Framework KPI Performance Measure DMS Weighting ESS Weighting Efficiency 1.1Responsive55 1.2 Time taken to achieve employment outcome 55 Effectiveness 2.1Job Placements55 2.213 week Full Outcome2520 2.3 13 week Pathway Outcome 55 2.4 13 week Bonus Outcome 55 2.526 week Full Outcome3530 2.6 26 week Pathway Outcome 55 2.7 26 week Bonus Outcome 55 2.8Ongoing Support515

6. So how do we turn that into a star rating…..

7. Simple!!!!

8. Just like this….. INTERIM = C(1) + C(2)*PREV + C(3)*INDIG + C(4)*MALE + C(5)*AGE + C(6)*AGE*AGE + C(7)*ALST1 + C(8)*ALST2 + C(9)*ALST3 + C(10)*ALST4 + C(11)*ALST5 + C(12)*ALST6 + C(13)*DIS + C(14)*EDU1 + C(15)*EDU2 + C(16)*EDU4 + C(17)*EDU5 + C(18)*NESB1 + C(19)*NESB2 + C(20)*NESB3 + C(21)*METRO + C(22)*BIGSLA + C(23)*DAYAVIS1*DAYAVIS1 + C(24)*DAYAVIS1 + C(25)*UEDUR1 + C(26)*UEDUR1*UEDUR1 + C(27)*EMGROW + C(28)*I1 + C(29)*I2 + C(30)*I3 + C(31)*I4 + C(32)*I5 + C(33)*I6 + C(34)*I7 + C(35)*I8 + C(36)*I9 + C(37)*I10 + C(38)*I11 + C(39)*I12 + C(40)*I13 + C(41)*I14 + C(42)*I15 + C(43)*I16 + C(44)*UERATE + C(45)*METROIND

9. The Formula Outcomes are the most crucial component of performance Focus on Job Placement and Outcome Playing around the edges isn’t the key – address that last, never first

10. Understanding KPI’s Numerator Denominator *important to note that you must have minimum numbers of 20 in the denominator for rating

11. Understanding KPI’s 1.1 Responsiveness A count of participants in the denominator who have a valid commencement date A count of participants who were referred between 1 March 2010 and last day of the month preceding the end of the performance period (excluding referrals that were exited for the reasons detailed in Attachment D of the Star Rating Guidelines)

12. Understanding KPI’s 1.2 Time taken to achieve employment outcome The sum of total days between commencement date and the employment anchor date for an approved 13 week full employment outcome (excluding time spent on suspensions, in qualifying training and whilst in the Productivity Places Program (or equivalent in VIC). Count of participants who have an approved claim for a 13 wk full employment outcome

13. Understanding KPI’s 2.1 Job Placements Count of participants in the denominator who have an approved claim for a job placement Count of participants who have commenced in DES from 1 March 2010 to the last day of the performance period

14. Understanding KPI’s 2.2 13 Week Full Outcome Count of participants in the denominator who have an approved claim for a 13 week full outcome Count of participants who have commenced in DES and duration in assistance is at least 13 weeks (excluding all periods of suspension)

15. Understanding KPI’s 2.6 26 Week Full Outcome Count of participants in the denominator with an approved claim for a 26 week full outcome Count of participants who have commenced in DES and duration in assistance is at least 26 weeks (excluding all periods of suspension)

16. Understanding KPI’s 2.8 Ongoing Support Flexible Ongoing Support Count of participants included in the denominator who are still current in ongoing support phase + those who have exited ongoing support as independent worker Count of participants with an approved claim for at least one instance of flexible ongoing support

17. Understanding KPI’s 2.8 Ongoing Support Moderate or High Ongoing Support Count of participants included in the denominator who are still current in ongoing support phase + those who have exited ongoing support as independent worker Count of participants who have a valid commencement date in the ongoing support phase of assistance

18. Understanding KPI’s 2.8 Bonuses Count of participants included in the denominator who are still Count of participants in the denominator for which there is an approved claim for a bonus 13 week full or pathway outcome plus a count of Indigenous participants who achieve an approved claim for a 13/26 week full or pathway outcome Count of participants for which there is an approved claim for a 13 week full or pathway outcome

19. The Bands Toto – I don’t think we’re in Kansas anymore -50% - 20% +20% +40%

20. Timelines First performance feedback (informal)Nov/Dec 2010 Six monthly follow stars release First star ratings to 31 December 2010Feb 2011 To providers for internal use Interim stars to 31 March 2011May 2011 End March, end September First Published Stars to 30 th JuneAug 2011

21. So how do we track it? Tools at your disposal: DES Reports – EA Reporting DES Caseload DES Jobseeker DES Appointment & Session Availability DES Claims DES Market Share

22. So how do we track it? Tools at your disposal: DES Reports – Health Checks Provider administrative and performance data Modeled on star rating performance measures No regression applied Site level + ESA level Comparative data to National & ESA

23. Reports Caseload  DES Caseload  DES Job Seeker Diary  DES Appointment  DES Session Availability Payments  DES Adjustment Note  DES Claims Current  DES Remittance advice Referral  DES Provider Market Share Vacancy  Employer BDF  Vacancy Report

24. Make sure this isn’t you in June 2012!