Metadata Management Case Study Date: 10/21/2008 Dan McCreary President Dan McCreary & Associates (952) 931-9198 M D Metadata Solutions.

Slides:



Advertisements
Similar presentations
Minnesota Department of Education Metadata Registry Case Study Date: October 31 st, 2008 Dan McCreary President Dan McCreary & Associates
Advertisements

Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
1 eXtended Metadata Registry (XMDR) Two Slides for Ontology Summit Presentation Bruce Bargmeyer Lawrence Berkeley National Laboratory and University of.
DOCUMENT TYPES. Digital Documents Converting documents to an electronic format will preserve those documents, but how would such a process be organized?
Jena based Implementation of a ISO Meta-data Registry A. Anil Sinaci, SRDC 1 / 37.
GridVine: Building Internet-Scale Semantic Overlay Networks By Lan Tian.
Interoperability of Distributed Component Systems Bryan Bentz, Jason Hayden, Upsorn Praphamontripong, Paul Vandal.
Semantics and Information Exchanges Overview – Public Sector NIEM Team, June 2011 CAM Test Model Data Deploy Requirements Build Exchange Generate Dictionary.
Using oXygen Using oXygen to build and execute XQuery applications on eXist Date: September 2008 Dan McCreary President Dan McCreary & Associates
© 2004 – Fairfax County Government - DIT Information Sharing Standards and Architecture.
Information and Business Work
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
XRX: The Metadata Registry Example 21 October 2008 Jeremy Sutton Matt Steele.
Chapter 10: Analyzing Systems Using Data Dictionaries Instructor: Paul K Chen.
XML Exchange Development CAM Technology Tutorial – Public Sector NIEM Team, June 2011 CAM Test Model Data Deploy Requirements Build Exchange Generate Dictionary.
Overview of XPath Author: Dan McCreary Date: October, 2008 Version: 0.2 with TEI Examples M D.
SDC JE-xxxx. Bruce Bargmeyer EPA/OIRM/EIM Division Tel: (202) WWW URL:
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
GJXDM Information Exchange Package Methodology Naming & Design Rules (MNDR) John Ruegg County of Los Angeles Information Systems Advisory Body GJXDM User.
OpenMDR: Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
Managing & Integrating Enterprise Data with Semantic Technologies Susie Stephens Principal Product Manager, Oracle
1 No SQL Metadata Management Dan McCreary President Dan McCreary & Associates October 20 th, 2010.
Patterns of Semantic Integration Riding the Next Wave April 2006 Dan McCreary President Dan McCreary & Associates (952) Managed.
OpenMDR: Alternative Methods for Generating Semantically Annotated Grid Services Rakesh Dhaval Shannon Hastings.
Case Studies: Statistics Canada (WP 11) Alice Born Statistics UNECE Workshop on Statistical Metadata.
Practical RDF Chapter 1. RDF: An Introduction
Enterprise Service Bus Lowering the cost of integration Date: 9/1/2009 Dan McCreary President Dan McCreary & Associates (952)
Environmental Terminology Research in China HE Keqing, HE Yangfan, WANG Chong State Key Lab. Of Software Engineering
Sample Auto-generated XForms With XQuery Date: 1/17/2009 Dan McCreary President Dan McCreary & Associates (952) M D Metadata.
The Semantic Web William M Baker
Styling XForms Using CSS to make your forms look great Date: 10/9/2008 Dan McCreary President Dan McCreary & Associates (952)
4 April 2007METIS Work Session1 Metadata Standards and Their Support of Data Management Needs Daniel W. Gillman Bureau of Labor Statistics Paul Johanis.
Interfacing Registry Systems December 2000.
Presentation Topic: XML and ASP Presented by Yanzhi Zhang.
Development Process and Testing Tools for Content Standards OASIS Symposium: The Meaning of Interoperability May 9, 2006 Simon Frechette, NIST.
EXist Indexing Using the right index for you data Date: 9/29/2008 Dan McCreary President Dan McCreary & Associates (952) M.
Revelytix SICoP Presentation DRM 3.0 with WordNet Senses in a Semantic Wiki Michael Lang February 6, 2007.
Recursive Functions Creating Hierarchical Reports Date: 9/30/2008 Dan McCreary President Dan McCreary & Associates (952) M.
9 th Open Forum on Metadata Registries Harmonization of Terminology, Ontology and Metadata 20th – 22nd March, 2006, Kobe Japan. Presentation Title: Day:
Dr. Bhavani Thuraisingham August 2006 Building Trustworthy Semantic Webs Unit #1: Introduction to The Semantic Web.
FEA DRM Management Strategy Presented by : Mary McCaffery, US EPA.
Auto-generation of Repeated Elements Part 2 of a series of XForms auto generation Date: 1/25/2008 Dan McCreary President Dan McCreary & Associates
Keyword Searching Weighted Federated Search with Key Word in Context Date: 10/2/2008 Dan McCreary President Dan McCreary & Associates
XRX Basic CRUDS Create, Read, Update and Delete and Search XML Data Date: May 2011 Dan McCreary President Dan McCreary & Associates
Dr. Bhavani Thuraisingham The University of Texas at Dallas Trustworthy Semantic Webs March 25, 2011 Data and Applications Security Developments and Directions.
Using oXygen 12 with XQuery Using oXygen to build and execute XQuery XQuery applications on eXist Date: April 2011 Dan McCreary President Dan McCreary.
User Profiling using Semantic Web Group members: Ashwin Somaiah Asha Stephen Charlie Sudharshan Reddy.
Overview of SC 32/WG 2 Standards Projects Supporting Semantics Management Open Forum 2005 on Metadata Registries 14:45 to 15:30 13 April 2005 Larry Fitzwater.
Strategies for subject navigation of linked Web sites using RDF topic maps Carol Jean Godby Devon Smith OCLC Online Computer Library Center Knowledge Technologies.
Tutorial on XML Tag and Schema Registration in an ISO/IEC Metadata Registry Open Forum 2003 on Metadata Registries Tuesday, January 21, 2003; 4:45-5:30.
XQuery Labs Basic Reporting Date: 9/29/2008 Dan McCreary President Dan McCreary & Associates (952) M D Metadata Solutions.
Information Architecture The Open Group UDEF Project
1 Open Ontology Repository initiative - Planning Meeting - Thu Co-conveners: PeterYim, LeoObrst & MikeDean ref.:
Manufacturing Systems Integration Division Development Process and Testing Tools for Content Standards Simon Frechette National Institute of Standards.
A Portrait of the Semantic Web in Action Jeff Heflin and James Hendler IEEE Intelligent Systems December 6, 2010 Hyewon Lim.
© The ATHENA Consortium. Susan Thomas SAP AG, Research Department How do you do semantics? Semantic Web Drawings by Sebastian Cremers Unit 3:
Strategy Markup Language (StratML) Enterprise Content Management Association (AIIM)
Improvement of Semantic Interoperability based on Metadata Registry(MDR) Doo-Kwon Baik Dept. of CSE Korea University.
Oksana Hoard LIS Overview MatML stands for Materials Markup Language It is a freely-available XML schema designed to describe materials (metals,
XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.
Semantic Web. P2 Introduction Information management facilities not keeping pace with the capacity of our information storage. –Information Overload –haphazardly.
OMG Architecture Ecosystem SIG Enterprise Data World 2011.
Collaborative Vocabulary Management
Achieving Justice Information Interoperability
Dan McCreary President Dan McCreary & Associates (952) M D
Introduction DoDAF 2.0 Meta Model (DM2) TBS dd mon 2009 VERSION 15
Introduction Special appreciation to Panel Co-Organizers
The Re3gistry software and the INSPIRE Registry
Sequences in XQuery Core data structure of XQuery Date: 8/25/2009
XRX Diagrams Application Architecture Diagrams Date: Aug 21st, 2008
Presentation transcript:

Metadata Management Case Study Date: 10/21/2008 Dan McCreary President Dan McCreary & Associates (952) M D Metadata Solutions

M D Copyright 2008 Dan McCreary & Associates 2 Overview The Challenge Why XRX is an Ideal Solution Screen Images Results

M D Copyright 2008 Dan McCreary & Associates 3 Gartner on Metadata Metadata cast into formal logics will drive interoperability, automation, cost cutting, better search capabilities and new business opportunities. Semantic Web Drives Data Management, Automation and Knowledge and Discovery Alexander Linder March 2005 G

M D Copyright 2008 Dan McCreary & Associates 4 The Challenge Allow the business people (not the IT department or developers) to manage all aspects of metadata –Definitions –Approval –ISO/IEC Metadata Registry –Shopping Cart –Wantlist Management –Automatic Form Generation

M D Copyright 2008 Dan McCreary & Associates 5 Semantic Triangle Concept Referent Refers To Symbolizes Stands For “cat” Physical Objects A pattern of neural activity in our brain Symbol Ogden, C. K., & Richards, I. A. (1923) The Meaning of Meaning “katze” (German) “gato” (Spanish)

M D Copyright 2008 Dan McCreary & Associates 6 Semantic Web Standards Stack URI/IRI Unicode XML Namespaces XML Query XML Schema RDF Model & Syntax Ontology (OWL) Rules/Query Logic Proof Trusted Semantic Web Signature Encryption Source: Tim Berners-Lee

M D Copyright 2008 Dan McCreary & Associates 7 Example of K-12 Registry

M D Copyright 2008 Dan McCreary & Associates 8 A (meta) Data Registry Goal: create semantic maps to a federal & state metadata standard, not many standards R5R5 R2R2 R3R3 R4R4 R6R6 R7R7 RNRN Mapping from Minnesota's metadata registry to N other metadata registries: The O(N 2 ) problem R2R2 R3R3 R4R4 R5R5 R6R6 R7R7 RNRN NIEM Mapping from Minnesota's metadata registry to counties & federal The O(N) problem NIEM

M D Copyright 2008 Dan McCreary & Associates 9 Evolving Metadata Standards ISO standards dominate most metadata registries ISO/IEC MDR GJXDM NIEM ebXML Public Schemas xBRL Minnesota Data Standards Federal XML Naming and Design Rules Non-ISO schemas Federal Data Reference Model (DRM) Federal XML Developer’s Guide (xml.gov) XML UML XMI CWM MOF XML Dept Stds. Division Stds XLink OASIS Standards Doc ISO commercial schemas Future Standards (?) UBL

M D Copyright 2008 Dan McCreary & Associates 10 Minnesota Enterprise Technical Architecture Follow established Minnesota metadata standards

M D Copyright 2008 Dan McCreary & Associates 11 Build an Inventory of Data Elements Sample Data Element

M D Copyright 2008 Dan McCreary & Associates 12 Examples of Federal Meta Data Registries NIEM – National Information Exchange Model GJXDM – Global Justice XML Data Model ebXML – Extensible Business XML UBL – Universal Business Language EPA – Environmental Protection Agency DOD – Department of Defense Metadata Registry xBRL – XML Business Reporting Language

M D Copyright 2008 Dan McCreary & Associates 13 Examples of Local Metadata Registries Minnesota Department of Education Registry Minnesota Department of Revenue Property Taxation Registry Financial Institution

M D Copyright 2008 Dan McCreary & Associates 14 Property Taxation Example

M D Copyright 2008 Dan McCreary & Associates 15 Example: NIEM.gov Fill your shopping cart with Data elements Easily create sub- schemas for different needs

M D Copyright 2008 Dan McCreary & Associates 16 Column Table Column Metadata Registry A Registry helps track data source mapping OLTP RDBMS Registry data elements can map to one or more data sources. Concepts usually map to tables and properties map to columns. Mappings can be used to facilitate transfers Mapping can be stored directly in the registry Tools are frequently used to create initial mappings Organizations can create mappings between their internal systems and a central metadata registry Column Table Column Data Warehouse Local Registry or database

Metadata Registry Workflow Funnel Create the Registry Define your glossary and data elements Review & make changes Approve & publish by stakeholders Use the Registry Generate data schemas (XML) by selecting and organizing data elements Add new items to the registry as needs change Review & Edit Approve Glossary Of Terms Draft Data Elements Requirements & data needs The registry defines the data we exchange and keeps our need for code changes to a minimum

M D Copyright 2008 Dan McCreary & Associates 18 Federated Search Federation: When many different sources can return search results from a single search Business Terms ACORD Data Elements RDMS Columns Other Standards WebSite Terms Search

M D Copyright 2008 Dan McCreary & Associates 19 Federated Search Results

M D Copyright 2008 Dan McCreary & Associates 20 Metadata Shopper

M D Copyright 2008 Dan McCreary & Associates 21 Why XRX? Metadata is complex Many nested structures Metadata needs to be quickly customized to meet the needs of different stakeholders Data governance is a collaborative process

M D Copyright 2008 Dan McCreary & Associates 22 Before XRX Staffing/Skills –XML Schemas –XSLT to transform data elements into HTML –DBAs to create RDBMS tables and indexes –One or more Java Developers –HTML Forms and Reports –CSS –Reporting tools (Crystal Reports etc) –Limited form functionality (no AJAX) Six people, 9 months $250,000 to $500,000

M D Copyright 2008 Dan McCreary & Associates 23 After XRX Skills –XForms, REST and XQuery Steps –Import data definitions from spreadsheets and XML sources –Create data element registry –Create shopping cart tools with XForms –Generate XML sub-schemas for importing into document exchanges –Higher quality user experience (suggest items) One Person Three Months: $40,000

M D Copyright 2008 Dan McCreary & Associates 24 Thank You! Please contact me for more information: Metadata Management Metadata Registries Service Oriented Architectures Business Intelligence and Data Warehouse Semantic Web Native XML Databases Dan McCreary, President Dan McCreary & Associates Metadata Strategy Development (952)