Seminar on New Frontiers for Statistical Data Collection WP 30 Moving to common survey tools and processes – the ABS experience Jenine Borowik, Adrian Bugg, Brent Ross

Outline ABS experience – progressive convergence of data collection tools and methods ABS 2017 directions Risks and issues Conclusion 2

1960’s - Integration of Economic Statistics -Integration of Household Statistics 1950’s Introduction of Sample Surveys ’s Formal User Consultation Introduced Major ABS Change National Project Centres 1990’s Increased use of Adm Data 1992 Lotus Notes/ WDBs 1995 Analysis Unit Established -ABS Website -1 st Confidentialised unit record file 2002 Business Statistics Innovation Program st Mainframe 2011 Future Organisat ion Structure Economic Census ABS 2017 Information Management Transformation

Individual collection methods and systems for Household surveys Business surveys Population Census Others “cottage industries” Progressive convergence of tools and methods CAPI / CATI Paper and scanning Establishment of ESDC ( office based interviewers) Single field interviewer workforce ( field based interviewers) Administrative Data Acquisition Unit Integrated Collection and Dissemination Division 4

ABS experience Existing purpose built capability Specialised Inflexible and vulnerable High cost to maintain and change Slow to change Cycle of leap and legacy 5

Increasing cost & difficulty of acquiring data New competitors & changing expectations Rapid changes in the environment Competition for skilled resources - low unemployment Reducing budget Riding the big data wave

Where are we headed? Over the next 5 years we will transform the way the ABS manages information from collection to dissemination Providing a better evidence base for use by Governments and the community 7

ABS 2017 Program Goals 1.Reduce the cost and time of doing business 2.Grow the business through new statistical products and services 3.Deliver the first large scale digital Census (2016) on time, to budget and quality  while delivering Business As Usual. 8

How will we get there? Through large scale Innovation across the whole ABS We will: –radically transform the way we acquire, collate, use, reuse and disseminate statistical information By: –industrialising, modernising and reengineering our business processes –reengineering our statistical infrastructure and the way we manage information –developing capability needed to meet future needs –collaborating with other international NSIs –focussing on a limited number of centralised projects, including the digital Census for

1. Business Process Reengineering Change the way we acquire and process data – emphasis on e-collect for Census 2016, business and household surveys, including web and hand held devices Increase our access to and use of large administrative datasets Integrate and join data from a range of sources 10

2. Reengineering Statistical Infrastructure New Core Information Management Infrastructure tools –metadata driven systems based on agreed standards –One ABS data warehouse to store, manage data from all sources –On-line data that can be queried –Management of statistical workflows –International collaboration to build next generation statistical tools 11

Expected Changes in our statistical cycle 12

High Level Overview Businesses Individuals Households Governments On line On site On the go Receive data Transform & Load data Digitise data Design, Build & Test Collection Instruments, Processes & Systems Support Providers Manage Provider Information Run Collection Manage Workforce & Workload Despatch Instruments / Requests for Info On the phone ABS CHANNELS/MODES PROVIDERS On paper en masse (system to system)

Collection Futures for Census, Household & Business Surveys Population Census Household Surveys Business Surveys

Enterprise Solution Enterprise Ready Line of business - utilising core infrastructure Line of business - silo / legacy ABS 2017 Strategy Freeze, Minimise investment Minimise - where enterprise is undesirable (business case doesn't exist) Candidate for future upgrade ABS 2017 Infrastructure

Functional AreasLevel of Development Address RegisterEnterprise Solution CAI Data CaptureEnterprise Solution Contact ServicesEnterprise Solution eForm ApplicationEnterprise Solution eForm Data LoadEnterprise Solution eForm PlatformEnterprise Solution Event and Operation ManagementEnterprise Ready Frame Create, Maintenance and Sample SelectEnterprise Solution Knowledge ServicesEnterprise Ready Paper Forms Data Capture RFT and implementationEnterprise Solution. Provider ManagementEnterprise Ready Provider PortalEnterprise Solution Provider Portal Web Services Mix of Enterprise Ready and Enterprise Solution Questionnaire DevelopmentEnterprise Solution Spreadsheet Data CaptureEnterprise Solution Workforce PortalEnterprise Solution Workforce Portal Web Services Mix of Enterprise Ready and Enterprise Solution Workload ManagementEnterprise Ready

Risks and issues New stovepipes with standard tools Future organisational structure – “Operations Division” Don’t want to build if we don’t need to Standards versus flexibility Cultural change and resistance Achieving the savings One size may not fit all Trade offs will need to occur in some business areas We can’t resolve all problems 17

Thank you Further information: –Jenine Borowik –Adrian Bugg 18