February 17, 1999Open Forum on Metadata Registries 1 Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith,

Slides:



Advertisements
Similar presentations
Health Ingenuity Exchange (HingX) Best Practices for User Groups and Resource Registration.
Advertisements

Metadata to Support the Survey Life Cycle Alice Born, Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (METIS) Geneva,
Transformations at GPO: An Update on the Government Printing Office's Future Digital System George Barnum Coalition for Networked Information December.
Basic guidelines for the creation of a DW Create corporate sponsors and plan thoroughly Determine a scalable architectural framework for the DW Identify.
4.1 Blended approaches: Information Engineering IMS Information Systems Development Practices.
Is Your Data Facility ISO Compliant? Progress Towards Harmonizing the DDI and ISO/IEC Dan Gillman Information Scientist US Bureau of Labor Statistics.
Oct 31, 2000Database Management -- Fall R. Larson Database Management: Introduction to Terms and Concepts University of California, Berkeley School.
Update and Thoughts on Directions for Metadata Work Carol Hert March 17, 2003.
Codebook Centric to Life-Cycle Centric In the beginning….
Reducing Metadata Objects Dan Gillman November 14, 2014.
Lecture Nine Database Planning, Design, and Administration
Database Administration Chapter 16. Need for Databases  Data is used by different people, in different departments, for different reasons  Interpretation.
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
What is Business Analysis Planning & Monitoring?
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
XML Registry and Repository for the Education Community Holly Hyland, Federal Student Aid.
WP.5 - DDI-SDMX Integration
Database System Development Lifecycle © Pearson Education Limited 1995, 2005.
Overview of the Database Development Process
WP.5 - DDI-SDMX Integration E.S.S. cross-cutting project on Information Models and Standards Marco Pellegrino, Denis Grofils Eurostat METIS Work Session6-8.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Implementing ESS standards for reference metadata and quality reporting at Istat Work Session on Statistical Metadata Topic (i): Metadata standards and.
M ETADATA OF NATIONAL STATISTICAL OFFICES B ELARUS, R USSIA AND K AZAKHSTAN Miroslava Brchanova, Moscow, October, 2014.
Methodology - Conceptual Database Design Transparencies
9/14/2012ISC329 Isabelle Bichindaritz1 Database System Life Cycle.
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
1 Chapter 15 Methodology Conceptual Databases Design Transparencies Last Updated: April 2011 By M. Arief
Architecture for a Database System
Met a-data Resources in Europe: within NSIs and from Dosis Projects Wilfried Grossmann Department of Statistics and Decision Support Systems University.
Metadata Registries Workshop April 15, 1998 Slide 1 of 20 ANSI X Douglas D. Mann Stewardship Naming & Identification Classification.
1-1 System Development Process System development process – a set of activities, methods, best practices, deliverables, and automated tools that stakeholders.
1/26/2004TCSS545A Isabelle Bichindaritz1 Database Management Systems Design Methodology.
Chapter 7 Applying UML and Patterns Craig Larman
Metadata Architecture at StatCan MSIS 2008 Luxembourg, April 7-9, 2008 Karen Doherty Director General Informatics Branch Statistics Canada.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Enterprise Architecture, Enterprise Data Management, and Data Standardization Efforts at the U.S. Department of Education May 2006 Joe Rose, Chief Architect.
Mr. Gopi Nair Defense Technical Information Center Briefing at Board on Research Data and Information (BRDI) Meeting September 24, 2009 Approved for Public.
Chapter 6 Supporting Knowledge Management through Technology
Methodology - Conceptual Database Design
Information Systems Engineering. Lecture Outline Information Systems Architecture Information System Architecture components Information Engineering Phases.
InSPIRe Australian initiatives for standardising statistical processes and metadata Simon Wall Australian Bureau of Statistics December
ISO/IEC Metadata Registry Implementations Larry Fitzwater
LoG: A Methodology for Metadata Registry-based Management of Scientific Data July 5, 2002 Doo-Kwon Baik
Pilot Census in Poland Some Quality Aspects Geneva, 7-9 July 2010 Janusz Dygaszewicz Central Statistical Office POLAND.
Tutorial on XML Tag and Schema Registration in an ISO/IEC Metadata Registry Open Forum 2003 on Metadata Registries Tuesday, January 21, 2003; 4:45-5:30.
SDMX IT Tools Introduction
Open GSBPM compliant data processing system in Statistics Estonia (VAIS) 2011 MSIS Conference Maia Ennok Head of Data Warehouse Service Data Processing.
User-Driven Integrated Statistical Solutions: Government for the People by the People Open Forum on Metadata Registries Santa Fe, New Mexico January 20,
MetaPlus Klas Blomqvist Statistics Sweden Research and Development – Central Methods
Statistical Metadata Extensions to the X3.285 Metamodel By Daniel W. Gillman Chairman, NCITS/L8 U.S. Bureau of the Census.
1 Data Management and Information Delivery The Data Management and Information Delivery (DMID) Project 10 Apr 2008 Ashwell Jenneker & Matile Malimabe.
Main tasks of system analysis ? 1-study exit=sting information system 2-identify problem 3-spelify system requirement 4-asalysis decision ========= How.
Use of Standardized Metadata to Find, Select and Access Statistical Data - Experience of Statistics Canada - Joint UNECE/Eurostat/OECD Work Session on.
ERM E-Gov Initiative Transfer of Permanent Geospatial Data Records to NARA Briefing for FGDC Coordination Group Bruce Ambacher, NARA September 2, 2003.
IPDA Registry Definitions Project Dan Crichton Pedro Osuna Alain Sarkissian.
Metadata requirements for archiving structured data Alice Born Statistics Canada Joint UNECE/Eurostat/OECD Work Session on Statistical Metadata (9-11 April.
Metadata models to support the statistical cycle: IMDB
Introduction to DBMS Purpose of Database Systems View of Data
Introduction To DBMS.
MANAGEMENT OF STATISTICAL PRODUCTION PROCESS METADATA IN ISIS
Physical Data Model – step-by-step instructions and template
Prepared by: Galya STATEVA, Chief expert
Data Management: Documentation & Metadata
Introduction to Database Systems
Metadata in the modernization of statistical production at Statistics Canada Carmen Greenough June 2, 2014.
Chapter 11: Software Configuration Management
Introduction to DBMS Purpose of Database Systems View of Data
HingX Project Overview
Chapter 2 Database Environment Pearson Education © 2014.
WHERE TO FIND IT – Accessing the Inventory
Presentation transcript:

February 17, 1999Open Forum on Metadata Registries 1 Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith, Jr. U.S. Bureau of the Census

February 17, 1999Open Forum on Metadata Registries 2 Overview Objectives Definitions Standards Models Implementation

February 17, 1999Open Forum on Metadata Registries 3 Census Bureau Metadata Objectives Gain Acceptance of One Logical Metadata Registry Model Support wide Range of Projects, Surveys, Applications, and Users Comply with Federal Standards

February 17, 1999Open Forum on Metadata Registries 4 Statistical Metadata: Definition Descriptive information or documentation that facilitates sharing and understanding statistical data over the lifetime of the data. Includes –file location, record layout, database schemas, data dictionary, definitions, questions, questionnaires, sample design, processing steps, data quality, etc. Definitions

February 17, 1999Open Forum on Metadata Registries 5 Purposes of a Statistical Metadata Repository End-user oriented –Electronic Data Dissemination Production oriented –Automated Survey Design and Processing

February 17, 1999Open Forum on Metadata Registries 6 What is the Corporate Metadata Repository (CMR)? Electronic card catalog Provides access to metadata describing many classes of objects –throughout a survey –across many surveys Types of classes are –variables or data elementsquestionnaires –datasetsother products (reports) –documentssurveys Metadata quality monitored through registration process

February 17, 1999Open Forum on Metadata Registries 7 Problems The CMR Solves? Supports Cataloging and Reuse of Metadata –Design and Processing –Data Dissemination Facilitates –Sharing of Data / Metadata –Data Administration –Survey Design and Processing –Survey Reengineering Complies with Required Federal Standards –GILS –FGDC –and other standards, e.g. DDI

February 17, 1999Open Forum on Metadata Registries 8 Standards Supporting the CMR CMR SDSM Census Bur MMSD X3.285

February 17, 1999Open Forum on Metadata Registries 9 Models Repository Models –Business Data Model –Data Element Registry Model –Metamodel Model for Searching and Classifying –Business Process Model Table of Contents

February 17, 1999Open Forum on Metadata Registries 10 Integrated Statistical Model Metadata Repository Metamodel Business Data Model Data Element Registry Model

February 17, 1999Open Forum on Metadata Registries 11 Repository Model Overview Registration Metamodel Business Data Documen- tation Data Element

February 17, 1999Open Forum on Metadata Registries 12 Survey Survey Instance Survey Dataset Questionnaire Questions Products Sample Universe/Frame Business Data Model

February 17, 1999Open Forum on Metadata Registries 13

14 Business Data Model + DER Model + Meta Model (access, search, security) TOC Browser Tool Metadata CRUD Tool Variables / Documentation/ Data sets/ Tools Registration Tool Prototype Corporate Metadata Repository CMR w/ Standard Interface DocsOpen DADSFERRET

February 17, 1999Open Forum on Metadata Registries 15 Near Term Implementation Find a Home Design & Build Physical Architecture Production Pilot –Automated Survey Design and Processing DocsOpen Econ Questionnaire Design –Electronic Data Dissemination Integration DADS FERRET Product Registry

February 17, 1999Open Forum on Metadata Registries 16 Long Term Implementation: Integrated Information Solutions Program (IIS) Data Integration, Access and Delivery –provides access to integrated data sets –provides ongoing customer support Product Creation System Policies and Standards New Business Practices Metadata and Data Support

February 17, 1999Open Forum on Metadata Registries 17 Current Situation Observations Each Program Area Operates Independently, Thereby: –Creating difficulty when two program areas must coordinate –Discouraging the notion of corporate data or metadata assets –Minimizing economies of scale or reuse –Discouraging the production of and access to integrated data

February 17, 1999Open Forum on Metadata Registries 18 Integrated Information Solutions Process Model Overview Products Customers Resources Prospect for Customers Target Customers Optimize Customers Plan and Acquire Resources Implement Resources Maintain Resources Conceive Products Plan and Design Products Develop Products Deliver Products Maintain Products The IIS program will manage :

February 17, 1999Open Forum on Metadata Registries 19 IIS Product Process Customer Conceive products Plan and design products Develop products Deliver Products Maintain Products Customer Needs High-level product concepts Product Concept Final model Preliminary Marketing plan Approved product Final marketing plan Product access Questions Support Orders Feedback Customer Database Resource Allocation Tracking System Corporate data and metadata repository Source data & metadata Approved product Feedback summaries Product Concept Approved business case Feedback summaries Decision to improve product Product concept Previous experience with similar products Approved model Product concept Approved product Usage statistics Improve or discontinue decisions

February 17, 1999Open Forum on Metadata Registries 20

February 17, 1999Open Forum on Metadata Registries 21 Phased Implementation Strategy Phase 1 : (January 99 - September 00) –Specifications for technology solutions developed –Establish corporate metadada repository –Pilot projects Phase 2: (FY2001 and FY2002) –Implementing technology solutions –Non-Decennial portion of DADS incorporated Phase 3: (FY2003) –Bulk of IIS processing vision put in place –DADS fully incorporated into IIS

February 17, 1999Open Forum on Metadata Registries 22 Questions

February 17, 1999Open Forum on Metadata Registries 23 DATA ELEMENT CONCEPTDATA ELEMENT Property Representation (1:1) (1:N) Object Class (1:N) Object Class X3.285 Fundamental Model

February 17, 1999Open Forum on Metadata Registries 24 Value Domain Data Element Data Element Concept Data Element Model

February 17, 1999Open Forum on Metadata Registries 25 Administered Component Classified ComponentClassification Scheme Common Attributes subtype Metadata Objects... Registration Model

February 17, 1999Open Forum on Metadata Registries 26 Administered Component Documentation Documentation Type Documentation Model

February 17, 1999Open Forum on Metadata Registries 27 SDSM Chapters Access Constraint Archive Citation Contact Data Dataset Supplier Data Quality Dataset Descriptive Statistics Distribution Information Documentation Emprise Field Format Frame Methodology Planning and Design Pointer to Object Product Program Questionnaire Question Sample Series Sponsor Status Survey Survey Instance System Technique Theme Universe FGDC