Social Security Policy Branch – Random Sample Surveys.

Slides:



Advertisements
Similar presentations
MONITORING OF SUBGRANTEES
Advertisements

Multiple Indicator Cluster Surveys Survey Design Workshop
Survey design. What is a survey?? Asking questions – questionnaires Finding out things about people Simple things – lots of people What things? What people?
Federal Guidance on Statistical Use of Administrative Data Shelly Wilkie Martinez, Statistical and Science Policy, OIRA U. S. Office of Management and.
Chapter 7: Key Process Areas for Level 2: Repeatable - Arvind Kabir Yateesh.
LECTURE 5 Assertions and Tests of Detail
EGM – Population & Housing Censuses Eurostat / UNECE - Geneva - 24/25 May 2012 Beyond 2011 The future of population statistics (England & Wales) Alistair.
Global Poverty Action Fund Community Partnership Window Funding Seminar January 2014 Global Poverty Action Fund Community Partnership Window Funding Seminar.
Chapter 1 The Where, Why, and How of Data Collection
The Information Systems Audit Process
Methodology for a school- leavers’ survey Irena Kogan MZES, University of Mannheim.
Report on Internal Audit and Investigation activities
17 June, 2003Sampling TWO-STAGE CLUSTER SAMPLING (WITH QUOTA SAMPLING AT SECOND STAGE)
Piloting the Household Vulnerability Index to Improve Targeting in WVI programmes in Lesotho, Swaziland and Zimbabwe Tendayi Kureya
Beyond 2011 – A new paradigm for population statistics? Pete Benton, Beyond 2011 Programme Director Office for National Statistics, UK.
Internal Auditing and Outsourcing
1 WORLD TOURISM ORGANIZATION (UNWTO) MEASURING TOURISM EXPENDITURE: A UNWTO PROPOSAL SESRIC-UNWTO WORKSHOP ON TOURISM STATISTICS AND THE ELABORATION OF.
Copyright 2010, The World Bank Group. All Rights Reserved. Agricultural Census Sampling Frames and Sampling Section A 1.
Central Piedmont Community College Internal Audit.
Determining the Sampling Plan
Transfer Payment and Financial Reporting Branch Ministry of Education Financial Statement Checking Procedures TPFR Information Sessions Fall 2007.
Effective Management and Compliance 1 ANA GRANTEE MEETING  FEBRUARY 5, 2015.
Presented to President’s Cabinet. INTERNAL CONTROLS are the integration of the activities, plans, attitudes, policies and efforts of the people of an.
Slide 1 D2.TCS.CL5.04. Subject Elements This unit comprises five Elements: 1.Define the need for tourism product research 2.Develop the research to be.
National Disability Advocacy Program (NDAP) Quality Assurance (QA) – report on the FaHCSIA trial.
NIST Special Publication Revision 1
Multiple Indicator Cluster Surveys Survey Design Workshop Sampling: Overview MICS Survey Design Workshop.
Module 6: Quantifying gaps and measuring coverage ILO, 2013.
7-1 Chapter Seven SAMPLING DESIGN. 7-2 Selection of Elements Population Element the individual subject on which the measurement is taken; e.g., the population.
Risk Assessment and Management. Objective To enable an organisation mission accomplishment, by better securing the IT systems that store, process, or.
1 Department for Work and Pensions The Work Programme Prospectus Supplier Briefing 8 th December 2010.
Copyright © 2007 Pearson Education Canada 1 Chapter 14: Completing the Tests in the Sales and Collection Cycle: Accounts Receivable.
McGraw-Hill/Irwin © The McGraw-Hill Companies 2010 Audit Planning and Types of Audit Tests Chapter Five.
Programme Objectives Analyze the main components of a competency-based qualification system (e.g., Singapore Workforce Skills) Analyze the process and.
Chapter 15 Sampling and Sample Size Winston Jackson and Norine Verberg Methods: Doing Social Research, 4e.
5-4-1 Unit 4: Sampling approaches After completing this unit you should be able to: Outline the purpose of sampling Understand key theoretical.
College Reviews An Overview Presented by Howard Lutwak, CIA Director of Internal Audit January 2004.
Copyright  2005 McGraw-Hill Australia Pty Ltd PPTs t/a Australian Human Resources Management by Jeremy Seward and Tim Dein Slides prepared by Michelle.
Internal Controls Christina Urias Managing Director – International Regulatory Affairs NAIC.
UNSD/STATISTICS KOREA International Seminar on Population and Housing Censuses: Beyond the 2010 Round Seoul, November 2012 Beyond 2011: The future.
The Long Term Strategy for Population Surveys in Scotland 2009 – 2019 Alex Stannard Statistician, Scottish Government.
Chapter 6: 1 Sampling. Introduction Sampling - the process of selecting observations Often not possible to collect information from all persons or other.
Targeting of Public Spending Menno Pradhan Senior Poverty Economist The World Bank office, Jakarta.
BSBPMG501A Manage Application of Project Integrative Processes Manage Project Integrative Processes Unit Guide Diploma of Project Management Qualification.
Kathy Corbiere Service Delivery and Performance Commission
Bangor Transfer Abroad Programme Marketing Research SAMPLING (Zikmund, Chapter 12)
CHAPTER 8 Materiality and Risk
Evaluate Phase Pertemuan Matakuliah: A0774/Information Technology Capital Budgeting Tahun: 2009.
Audit Evidence Process
STATISTICAL DATA GATHERING: Sampling a Population.
Chapter 8 Auditing in an E-commerce Environment
Monitoring Afghanistan, 2015 Food Security and Agriculture Working Group – 9 December 2015.
Erman Taşkın. Information security aspects of business continuity management Objective: To counteract interruptions to business activities and to protect.
Session 21-1 Session 44 The Verification Selection Process.
Governor’s Office for Technology Service Level Management Overview Office of Policy & Customer Relations September 21, 2001 Governor’s Office for Technology.
UN ECE Seminar on New Frontiers for Statistical Data Collection 31 Oct – 2 Nov 2012 Beyond 2011 The future of population statistics Andy Teague, Office.
Ombudsman Western Australia Serving Parliament – Serving Western Australians Evaluation in the Western Australian Ombudsman’s Office Kim Lazenby & Jane.
Quality assurance surveys and program administration – when accuracy really counts Stephen Horn Contributed paper Q2008.
Template for CORAS Risk Analysis. The eight steps of a CORAS risk analysis.
The evolution of the England and Wales census in a European context Garnett Compton, ONS RSS Conference, 9 September 2015.
An Overview on Risk Management
Sampling.
Let Auditing Be Your Superpower
Market Research Sampling Methods.
How to conduct Effective Stage-1 Audit
Key Value Indicators (KVIs)
Medium-term estimates
AUDIT TESTS.
Internal Audit’s Role in Preventing Fraud and Corruption
Internal Control Internal control is the process designed and affected by owners, management, and other personnel. It is implemented to address business.
Presentation transcript:

Social Security Policy Branch – Random Sample Surveys

Began in 98/99 Continues as an ongoing project Methodology tested, improved and ratified by External Consulting Actuaries Audited by the Australian National Audit Office (ANAO) Recommendations have been implemented Random Sample Surveys Background

Social Security Policy Branch – Random Sample Surveys Service level agreement FaHCSIA and Centrelink have an SLA in place to manage the RSS SLA is a set of agreed processes and procedures to be followed by both parties Living Document – can be modified to meet changing political or departmental requirements

Social Security Policy Branch – Random Sample Surveys Sample Design Define Sample Population (Age Pension, Carer Payment) Make Exclusions where Necessary Define Strata – Population Groups defined by characteristics (eg Gender, Rate, Marital Status) Consideration for Remote Customers (Clustering) Allocate Sample (operational requirements and strata)

Social Security Policy Branch – Random Sample Surveys Exclusions and Substituons In an Ideal sample ALL customers have a chance of selection RSS Population is not a closed system Need to balance randomness of the sample against burden to the customers Exclusion Rules ensure that: customers that have an outstanding or recently completed review; customers that are seriously ill or out of the country; Are not selected

Social Security Policy Branch – Random Sample Surveys Stratification The target population is divided into discrete, non-overlapping sub populations This assists in ensuring a Representative Sample is selected Exploits the depth of administrative information held on populations under review Sharpens the final estimates around variables associated with compliance status Allows for unequal probability selection

Social Security Policy Branch – Random Sample Surveys

Clustering - Background Centrelink’s most remote Areas (North & Central QLD, North Australia, Western Australia) have smaller customer populations over wider geographic areas Need to balance the requirement to sample in these locations with the cost of travel and distance Clustering concentrates the selections to a smaller location within the remote Area

Social Security Policy Branch – Random Sample Surveys

Selection Design Delivered to Centrelink Random Selection of Customers within Allocation Boundaries by Centrelink FaHCSIA views selection Centrelink proceeds after approval

Social Security Policy Branch – Random Sample Surveys Reviews Selected Customer attends an Interview in Centrelink Office (CSC or ASO) Full Re-Assessment of Entitlement conducted via Questionnaire (Income, Assets, Residency, POI, Qualification, Accommodation) More Detailed information from Review filled out by Centrelink Officer after review concluded and entered into RRRS Quality Assurance is performed by Centrelink on a sample of the results

Social Security Policy Branch – Random Sample Surveys Review Results Assessment of Current and Prior Entitlement can have the following results Cancellation of Payment Variation (Upward or Downward) of Current Fortnightly Rate Debt Raised for an overpayment in an earlier period Arrears Paid for an underpayment in an earlier period These Results are not mutually exclusive. A Cancellation/Variation can happen in conjunction with a Debt and/or Arrears. Supplementary Components (Eg RA, PHA, TAL) are also reviewed.

Social Security Policy Branch – Random Sample Surveys FaHCSIA Processing Centrelink Review Results Stored on ISIS/IRS/RRRS Data is Transmitted from Centrelink to FaHCSIA FaHCSIA tests the data integrity Validates a sample (10%) of the Reviews - (Centrelink QAs this sample) Tabulates and Analyses the Results

Social Security Policy Branch – Random Sample Surveys

Results Results used by FaHCSIA to: Provide an estimate FaHCSIA Programme Outlay Accuracy Identify Emerging Risks Assess effectiveness of Compliance Budget measures Evidence Base for Compliance Policy Latent Debt Measure – Debt KPI Improve predictors for Service Profiling

Social Security Policy Branch – Random Sample Surveys Outlay Accuracy Modelled Estimate of the Mispayed Amount / Outlayed Amount subtracted from 100% Does not discriminate between customer and Centrelink errors Weighted by $ Value – a $450 cancellation has a greater effect than a $0.05 upward variation Only counts current episodes of mispayment ie. is not affected by debts for prior periods of mispayment Sourced from Dataset 1

Social Security Policy Branch – Random Sample Surveys Payment Correctness Modelled Estimate of the Number of Customers with an Administrative Error that affected Payment / Total Population subtracted from 100% Only counts customers where the error was made by Centrelink which caused a dollar impact Does include dollar impact from debts (ie prior periods of mispayment) Does not count multiple errors – if any 1 of up to 4 Errors meets the criteria the customer is counted once Not weighted by dollar value - Counts customers not amounts – a $35,000 debt contributes the same as a $0.05 variation Sourced from Dataset 4

Social Security Policy Branch – Random Sample Surveys Latent Debt Measure of the level of undetected indebtedness in the benefit population Key Prevention Indicator for Debts is the Latent Measure of Indebtedness to Outlays Make the distinction between “Current Year” Indebtedness and New Debts

Social Security Policy Branch – Random Sample Surveys

Addressing emerging risk top 10 reasons for mispayment Random Sample Results are further subdivided by reason for mispayment These indicate the Risks to Outlays to be addressed by Compliance and Prevention measures Mispayments in debt and variation can be for the same or different reasons Risks are ranked by number (incidence) and value (magnitude) Charts observe the Higher risks to outlays

Social Security Policy Branch – Random Sample Surveys