February 17, 1999Open Forum on Metadata Registries 1 Census Corporate Statistical Metadata Registry By Martin V. Appel Daniel W. Gillman Samuel N. Highsmith, Jr. U.S. Bureau of the Census

February 17, 1999Open Forum on Metadata Registries 2 Overview Objectives Definitions Standards Models Implementation

February 17, 1999Open Forum on Metadata Registries 3 Census Bureau Metadata Objectives Gain Acceptance of One Logical Metadata Registry Model Support wide Range of Projects, Surveys, Applications, and Users Comply with Federal Standards

February 17, 1999Open Forum on Metadata Registries 4 Statistical Metadata: Definition Descriptive information or documentation that facilitates sharing and understanding statistical data over the lifetime of the data. Includes –file location, record layout, database schemas, data dictionary, definitions, questions, questionnaires, sample design, processing steps, data quality, etc. Definitions

February 17, 1999Open Forum on Metadata Registries 5 Purposes of a Statistical Metadata Repository End-user oriented –Electronic Data Dissemination Production oriented –Automated Survey Design and Processing

February 17, 1999Open Forum on Metadata Registries 6 What is the Corporate Metadata Repository (CMR)? Electronic card catalog Provides access to metadata describing many classes of objects –throughout a survey –across many surveys Types of classes are –variables or data elementsquestionnaires –datasetsother products (reports) –documentssurveys Metadata quality monitored through registration process

February 17, 1999Open Forum on Metadata Registries 7 Problems The CMR Solves? Supports Cataloging and Reuse of Metadata –Design and Processing –Data Dissemination Facilitates –Sharing of Data / Metadata –Data Administration –Survey Design and Processing –Survey Reengineering Complies with Required Federal Standards –GILS –FGDC –and other standards, e.g. DDI

February 17, 1999Open Forum on Metadata Registries 8 Standards Supporting the CMR CMR SDSM Census Bur MMSD X3.285

February 17, 1999Open Forum on Metadata Registries 9 Models Repository Models –Business Data Model –Data Element Registry Model –Metamodel Model for Searching and Classifying –Business Process Model Table of Contents

February 17, 1999Open Forum on Metadata Registries 10 Integrated Statistical Model Metadata Repository Metamodel Business Data Model Data Element Registry Model

February 17, 1999Open Forum on Metadata Registries 11 Repository Model Overview Registration Metamodel Business Data Documen- tation Data Element

February 17, 1999Open Forum on Metadata Registries 12 Survey Survey Instance Survey Dataset Questionnaire Questions Products Sample Universe/Frame Business Data Model

February 17, 1999Open Forum on Metadata Registries 13

14 Business Data Model + DER Model + Meta Model (access, search, security) TOC Browser Tool Metadata CRUD Tool Variables / Documentation/ Data sets/ Tools Registration Tool Prototype Corporate Metadata Repository CMR w/ Standard Interface DocsOpen DADSFERRET

February 17, 1999Open Forum on Metadata Registries 15 Near Term Implementation Find a Home Design & Build Physical Architecture Production Pilot –Automated Survey Design and Processing DocsOpen Econ Questionnaire Design –Electronic Data Dissemination Integration DADS FERRET Product Registry

February 17, 1999Open Forum on Metadata Registries 16 Long Term Implementation: Integrated Information Solutions Program (IIS) Data Integration, Access and Delivery –provides access to integrated data sets –provides ongoing customer support Product Creation System Policies and Standards New Business Practices Metadata and Data Support

February 17, 1999Open Forum on Metadata Registries 17 Current Situation Observations Each Program Area Operates Independently, Thereby: –Creating difficulty when two program areas must coordinate –Discouraging the notion of corporate data or metadata assets –Minimizing economies of scale or reuse –Discouraging the production of and access to integrated data

February 17, 1999Open Forum on Metadata Registries 18 Integrated Information Solutions Process Model Overview Products Customers Resources Prospect for Customers Target Customers Optimize Customers Plan and Acquire Resources Implement Resources Maintain Resources Conceive Products Plan and Design Products Develop Products Deliver Products Maintain Products The IIS program will manage :

February 17, 1999Open Forum on Metadata Registries 19 IIS Product Process Customer Conceive products Plan and design products Develop products Deliver Products Maintain Products Customer Needs High-level product concepts Product Concept Final model Preliminary Marketing plan Approved product Final marketing plan Product access Questions Support Orders Feedback Customer Database Resource Allocation Tracking System Corporate data and metadata repository Source data & metadata Approved product Feedback summaries Product Concept Approved business case Feedback summaries Decision to improve product Product concept Previous experience with similar products Approved model Product concept Approved product Usage statistics Improve or discontinue decisions

February 17, 1999Open Forum on Metadata Registries 20

February 17, 1999Open Forum on Metadata Registries 21 Phased Implementation Strategy Phase 1 : (January 99 - September 00) –Specifications for technology solutions developed –Establish corporate metadada repository –Pilot projects Phase 2: (FY2001 and FY2002) –Implementing technology solutions –Non-Decennial portion of DADS incorporated Phase 3: (FY2003) –Bulk of IIS processing vision put in place –DADS fully incorporated into IIS

February 17, 1999Open Forum on Metadata Registries 22 Questions

February 17, 1999Open Forum on Metadata Registries 23 DATA ELEMENT CONCEPTDATA ELEMENT Property Representation (1:1) (1:N) Object Class (1:N) Object Class X3.285 Fundamental Model

February 17, 1999Open Forum on Metadata Registries 24 Value Domain Data Element Data Element Concept Data Element Model

February 17, 1999Open Forum on Metadata Registries 25 Administered Component Classified ComponentClassification Scheme Common Attributes subtype Metadata Objects... Registration Model

February 17, 1999Open Forum on Metadata Registries 26 Administered Component Documentation Documentation Type Documentation Model

February 17, 1999Open Forum on Metadata Registries 27 SDSM Chapters Access Constraint Archive Citation Contact Data Dataset Supplier Data Quality Dataset Descriptive Statistics Distribution Information Documentation Emprise Field Format Frame Methodology Planning and Design Pointer to Object Product Program Questionnaire Question Sample Series Sponsor Status Survey Survey Instance System Technique Theme Universe FGDC