1. 1 Experiences With Developing and Using Metadata-Driven Processing Systems for the Economic Census June 19, 2007 Mark Wallace Mark.E.Wallace@census.gov

2. 2 What is Metadata? Data 12 Yes 02152005 Metadata Number of month in operation Does your company conduct research and development? Date completed

3. 3 Forms Design - 1997 Before Metadata: Each trade worked independently Inconsistent layout practices No standards for content or design Design of each paper questionnaire one page at a time A handful of custom coded computerized questionnaires

4. 4 Dissemination - 1997 Some Metadata in place: Major advancements to reduce paper and focus on electronic data products Metadata was used to create publications and dissemination products –Metadata was handled as independent files –No centralized Metadata system existed Inconsistencies existed across questionnaires and data products

5. 5 Examples of Inconsistencies from 1997 – Question Numbering SECTOREMPLOYMENTPAYROLLFRINGE BENEFITS ConstructionItem 5Item 6Item 8 Mining LongItem 2Item 3AItem 3C Mining ShortItem 2Item 3AN/A Annual Survey of ManufacturesItem 2Item 3AItem 3C Manufacturing LongItem 2Item 3AN/A Manufacturing ShortItem 2Item 3N/A Retail LongItem 6Item 5aN/A Retail ShortN/A Service LongItem 7Item 6aN/A Service ShortN/A Wholesale LongItem 6aItem 5aN/A Wholesale ShortItem 5aItem 4aN/A Transportation/Utilities LongItem 6Item 5aN/A Transportation ShortN/A Finance LongItem 6Item 5aN/A Finance ShortN/A AuxiliariesItem 7Item 6N/A

6. 6 Examples of Inconsistencies from 1997 – Forms Design Picture 2 Picture 1

7. 7 Examples of Inconsistencies from 1997 – Dissemination Picture 1 Picture 2

8. 8 Questionnaire Design - 2002 After Metadata: Each trade worked only trade-specific questions Established standards for questions and layouts Design of each question once, allowing for re-use across all questionnaires Introduced a generalized system to offer computerized questionnaires to all respondents

9. 9 Categorization of Forms Content Question Number (generated) Question Title Question Instructions Item Numbers Headers (calculated) Item Wording Item Instruction Data Elements

10. 10 Reusable Content - Questions

11. 11 Dissemination - 2002 With Integrated Metadata System: Metadata was entered once and used multiple times Data products were more consistent across subject area and format The system allowed hundreds of users the ability to analyze and output publications simultaneously

12. 12 Categorization of Dissemination Content

13. 13 Forms Design Process Improvements for 2007 The Redesign of the database has streamlined processes and improved performance. The integration of tools has fostered contiguous development of paper and electronic forms. Electronic forms have been completed early and made available for advance customer outreach program.

14. 14 Dissemination Plans for 2007 Continue using same system with some improvements –System upgrade from UNIX to LINUX Blade –Implementation of Software Quality Assurance Incorporate additional new products into the current system Upgrade publication tools to utilize all metadata

15. 15 Questions