CENTRAL STATISTICS OFFICE IRELAND ITSIP PROJECT OVERVIEW

Slides:



Advertisements
Similar presentations
Statistics NZs experience in using Administrative Data in an Integrated Programme of Economic Vince Galvin General Manager Strategy & Communications.
Advertisements

Module B-4: Processing ICT survey data TRAINING COURSE ON THE PRODUCTION OF STATISTICS ON THE INFORMATION ECONOMY Module B-4 Processing ICT Survey data.
Making the Case for Metadata at SRS-NSF National Science Foundation Division of Science Resources Statistics Jeri Mulrow, Geetha Srinivasarao, and John.
HACCP Manager Software™
Components and Architecture CS 543 – Data Warehousing.
Database Management COP4540, SCS, FIU An Introduction to database system.
ITSIP Case Study : Ireland METIS Workshop, 4-6 July 2007 Data Management System (DMS)
ETL By Dr. Gabriel.
The Canadian Integrated Approach to Economic Surveys Marie Brodeur, Peter Koumanakos, Jean Leduc, Éric Rancourt, Karen Wilson Statistics Canada International.
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie.
Development of metadata in the National Statistical Institute of Spain Work Session on Statistical Metadata Genève, 6-8 May-2013 Ana Isabel Sánchez-Luengo.
The Adoption of METIS GSBPM in Statistics Denmark.
Chapter 6 SAS ® OLAP Cube Studio. Section 6.1 SAS OLAP Cube Studio Architecture.
Statistics Sweden Results from operations in 2006: 146 publications 356 press releases commissions 3,7 million visitors at
Current and Future Applications of the Generic Statistical Business Process Model at Statistics Canada Laurie Reedman and Claude Julien May 5, 2010.
Jump to first page (o ns) Modernising Statistical Systems to improve Quality The experiences of the Office for National Statistics (ONS) Presented by Emma.
Statistics New Zealand’s End-to-End Metadata Life-Cycle ”Creating a New Business Model for a National Statistical Office if the 21 st Century” Gary Dunnet.
Use of Administrative Data Seminar on Developing a Programme on Integrated Statistics in support of the Implementation of the SNA for CARICOM countries.
Copyright © 2004, SAS Institute Inc. All rights reserved. SAS Stored Processes An analyst’s perspective Sylvain Tremblay SAS Canada 24 February 2006.
Electronic data collection System in CSB of Latvia By Karlis Zeila, Vice President, CSB of Latvia IT DG meeting, October , Eurostat.
Statistical Expertise for Sound Decision Making Quality Assurance for Census Data Processing Jean-Michel Durr 28/1/20111Fourth meeting of the TCG - Lubjana.
Business model Transformation Strategy (BmTS) John Pearson and Tracey Savage Statistics NZ’s.
EXPERIENCES FROM DISTRIBUTED REGISTERING OF METADATA IN METAPLUS Klas Blomqvist and Lars-Göran Lundell Statistics Sweden.
Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.
Database Management Systems (DBMS)
IT Directors Group, Luxembourg, October Statistics for a Modern Ireland CSO Data Management System (DMS) Update Joe Treacy Director, IT and.
United Nations Oslo City Group on Energy Statistics OG7, Helsinki, Finland October 2012 ESCM Chapter 8: Data Quality and Meta Data 1.
Corporate Data Vault Data Warehousing Workshop Sept Data Warehousing Workshop Sept
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
RECENT DEVELOPMENT OF SORS METADATA REPOSITORIES FOR FASTER AND MORE TRANSPARENT PRODUCTION PROCESS Work Session on Statistical Metadata 9-11 February.
Recent Enhancements to Quality Assurance and Case Management within the Emissions Modeling Framework Alison Eyth, R. Partheepan, Q. He Carolina Environmental.
Unified Enterprise Survey New Horizons International Conference on Establishment Surveys Daniela Ravindra and Marie Brodeur Montreal, June 2007 Statistics.
AFS Overview, the Universal Interface, and AFS Modernization Plans Network Operations Board (NOB) Meeting October 25, 2006 David Hindin, Director Enforcement.
Towards the 2011 UK Census Editing Strategy Heather Wagstaff and Steven Rogers Methodology Directorate Office for National Statistics, U.K.
CSO ITSIP Project - implementation of new Data Management System (DMS) ITDG meeting, Luxembourg, October 2006 Presentation by Joe Treacy CSO, Ireland.
5.8 Finalise data files 5.6 Calculate weights Price index for legal services Quality Management / Metadata Management Specify Needs Design Build CollectProcessAnalyse.
The business process models and quality issues at the Hungarian Central Statistical Office (HCSO) Mr. Csaba Ábry, HCSO, Methodological Department Geneva,
Take Your Data Analysis and Reporting to the Next Level by Combining SAS Office Analytics, SAS Visual Analytics, and SAS Studio David Bailey Tim Beese.
Implementation of Quality indicators for administrative data
MANAGEMENT OF STATISTICAL PRODUCTION PROCESS METADATA IN ISIS
An Introduction to database system
Introduction to Visual Basic 2008 Programming
Census Technology: Processing architecture and data analysis
Generic Statistical Business Process Model (GSBPM)
Working Group on Population and Housing Censuses
Data Warehouse Overview September 28, 2012 presented by Terry Bilskie
Tomaž Špeh, Rudi Seljak Statistical Office of the Republic of Slovenia
Integrated Statistical Information System (ISIS) in Croatia By Maja Ledić Blažević, Senior Advisor, Research & Development Dept. and Branka Cimermanović,
Course: Module: Lesson # & Name Instructional Material 1 of 32 Lesson Delivery Mode: Lesson Duration: Document Name: 1. Professional Diploma in ERP Systems.
Vygandas Norkus Deputy Director General October 2009, IT DG
Issues in Administrative Data
DAT381 Team Development with SQL Server 2005
Lecture 1 File Systems and Databases.
IT and Development support services
Agenda Context of the BR Redesign Redesign Objectives Redesign changes
Data validation in Statistical Office of the Republic of Serbia
Albania 2021 Population and Housing Census - Plans
Education and Training Statistics Working Group – 2-3 June 2016
Mapping Data Production Processes to the GSBPM
Statistical System in India
Statistical process as a structured chain of successive actions and intermediate products, supported by the coherent use of metadata  Focused on energy.
The role of metadata in census data dissemination
2.7 Annex 3 – Quality reports
Sample Assessment & Governance Results
Best Practices in Higher Education Student Data Warehousing Forum
Petr Elias Czech Statistical Office
ESS conceptual standards for quality reporting
Hands-on GSIM Mauro Scanu ISTAT
GSIM overview Mauro Scanu ISTAT
Presentation transcript:

CENTRAL STATISTICS OFFICE IRELAND ITSIP PROJECT OVERVIEW IT Director’s Meeting – Luxembourg 21 October 2004

BEGINNINGS Processing mainly on VAX mainframe 1999 IT Strategy Out of date Legal requirement to Open Systems 1999 IT Strategy ‘Islands of data’ inefficient Too many applications Data Management Strategy Further analysis Corporate Data Model Fewer and better applications ITSIP Information Technology Strategic Implementation Programme

DMS Logical Model System Comprises Four Databases Two micro-data databases Input (Data Capture, Validation, Edit, Imputation) Clean Unit Data Repository Two macro-data databases Aggregation Dissemination (Publication) Metadata associated with these databases Incorporates Register and Survey Management Metadata driven

CORPORATE DATA MODEL - Data Flow Respondent Management Data Capture Seasonal Adjustment Imputation Aggregation Dissemination Corporate Data Model based on Swedish Model Input Clean Unit Aggregate Disseminate

ITSIP PROJECT STAGES Stage A (Oct 2002 to Apr 2003) Requirements specification and high-level architectural design Stage B (Nov 2003 to Apr 2006) Detailed design, build and implementation Go Live 2 May 2006

STAGE A OUTCOMES High-Level Design of Architecture Functional Design of Applications Associated Conceptual Database Models and Designs Migration Plan Report on WWW Potential

DATA MANAGEMENT SYSTEM (DMS) CARS is our classification system sourced from SNZ Sprocet is a survey processing system BoPFacts is our balance of payments processing system

These are the applications involved inb the DMS Register Management Data Capture Select Register Form Set-Up Data Entry Search Register Duplicate Search Select Form/ Period Create Survey Instance Select Coding Type Unit Details Edit Summary Unit Details Duplicate View Form Summary File Definition CorrectionComment Associated Surveys Coding Data Entry/ Correct Data Edit Report Correction History Imputation Variable Group Set-Up VariableGroup Summary Edit Rule Summary Sample Selection Batch Summary View Form Data Detailed Report Select Survey /Period Select Survey Variable Details Validation Set-Up Variable Edit Rule Set-Up CARS Set up Imputation Cells Set Up Imputation Rules Run Imputation Sample Selection Criteria Include in Sample Exclude from Sample Derived Variables CARS LVCF Set-up Strata Cells Sample Proportions Aggregation Set Up Imputation Cell Merge Settings Time Series View Imputation Results Unit Details Enter Survey/ Period Nearest Neighbour Selected Sample (Conditional Census or Random) Direct Imputation Exclude Records Stratum Average Set Up Aggregation SnapShot of Input Database Run Aggregation View Rule Summary Survey Management Select Survey/ Period CARS Set Up Group Define Aggregate Set Up Aggregate Table View Aggregate Results SetUp PostOut Items Receipting Response Tracking Follow Up Detail Basic Aggregate Seasonal Adjustment Complex Aggregate Set Up Weights Set Up Macro Edits Confidentiality Rules for Aggregate Aggregation Results Seasonal Adjustment Define Relative Postout Detailed Report View Non- Respondents Comments Define Mean Drill Down Rescale Index View Graph Set-Up Seasonal Adjustment Run Seasonal Adjustment Recipient List Update New Index Weights These are the applications involved inb the DMS There is also a security application, not in the diagram To save time I will skip over most of these.Ythe completely new application is the Respondent Management System, which will give us an overview of respondents overall surveys, and should assist in helping to reduce the burden on respondents –this is a strategic corporate goal. Data View Results Respondent Management Dissemination Summary Select Respondent View Graph Create Disseminate Tables Footnotes Populate Disseminate Database Timeliness Monitor Extract Disseminate Data CARS Compliance History Survey Instance List Disseminate Table Footnote Links Footnote Copy Aggregate Data Timeliness Overview Select Facts Details Report View Form Data Data Column Meta Data Timeliness Table Select Classifications

Respondent Management Select Respondent Compliance History Survey Instance List Details Report View Form Data Provides cross-survey view of form data submitted to the CSO Provides cross-survey view of compliance history of a unit

STAGE B REQUIREMENTS Detailed design Specify and install infrastructure Gather data & process migration information required Build applications (and overall DMS) User Training UAT Migrate business areas’ data & processes Implement DMS First Year Maintenance

Project Organisation Contractor: Cognizant Technology Solutions On-shore off-shore model On-shore Fifteen CSO personnel Six CTS personnel Off-shore Twenty – Thirty developers in Chenai, India

Project Management Project Managers CSO on shore CTS on shore CTS offshore Shared Lotus Notes Database, replicated between Cork and Chennai Weekly teleconference beween Cork & Chennai

Integration & System Testing OUTLINE PLAN Start-up System Requirements Analysis Increment 1 Increment 2 Increment 3 Integration & System Testing Delivery Acceptance Testing Implementation 12 24 36 Project Month

DEVELOPMENT/TEST ENVIRONMENT

MAIN SOFTWARE TOOLS Microsoft Windows A/S Server - OS Microsoft Visual Studio Desktop - Development Sybase ASE 12.5 Server - Database Sybase IQ 12.5 Server - Database BEA Systems Weblogic 7.1 Clustered Server - Application Server Informatica Power Center 6.2 Server Server - Data Migration Informatica Power Center 6.2 Client Desktop - Data Migration JAVA Swing Application (Sun Java Studio)/J2EE

E N D