Convergence of Semantic Naming and Identification Technologies?

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

Status on the Mapping of Metadata Standards
Information and Business Work
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
Convergence of Semantic Naming and Identification Technologies? What are the Choices and What are the Issues? Ron Schuldt Lockheed Martin Enterprise Information.
Aligning Business Processes to SOA B. Ramamurthy 6/16/2015Page 1.
ReQuest (Validating Semantic Searches) Norman Piedade de Noronha 16 th July, 2004.
EbXML Registry Technical Committee n Defining and managing interoperable registries and repositories n The OASIS ebXML Registry TC develops specifications.
Web Service Architecture Part I- Overview and Models (based on W3C Working Group Note Frank.
DCMO - CIO Architecture Federation Pilot Larry Singer 5 January, 2012.
IBM User Technology March 2004 | Dynamic Navigation in DITA © 2004 IBM Corporation Dynamic Navigation in DITA Erik Hennum and Robert Anderson.
Redefining Perspectives A thought leadership forum for technologists interested in defining a new future June COPYRIGHT ©2015 SAPIENT CORPORATION.
Semantic Web Technologies Lecture # 2 Faculty of Computer Science, IBA.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Future of MDR - ISO/IEC Metadata Registries (MDR) Larry Fitzwater, SC 32 WG 2 Convener Computer Scientist U.S. Environmental Protection Agency May.
Enterprise Systems & Architectures. Enterprise systems are mainly composed of information systems. Business process management mainly deals with information.
Chapter 9: Achieving Operational Excellence and Customer Intimacy: Enterprise Applications Dr. Andrew P. Ciganek, Ph.D.
SC32 WG2 Metadata Standards Tutorial Metadata Registries and Big Data WG2 N1945 June 9, 2014 Beijing, China.
Chapter 6: Foundations of Business Intelligence - Databases and Information Management Dr. Andrew P. Ciganek, Ph.D.
A Disaster Response Pilot Demonstrating Web Services and Semantic Naming and Identification Technologies Ron Schuldt, Chair The Open Group UDEF Forum February.
Using the Open Metadata Registry (openMDR) to create Data Sharing Interfaces October 14 th, 2010 David Ervin & Rakesh Dhaval, Center for IT Innovations.
Emerging Technologies Work Group Master Data Management (MDM) in the Public Sector Don Hoag Manager.
Metadata Management Case Study Date: 10/21/2008 Dan McCreary President Dan McCreary & Associates (952) M D Metadata Solutions.
Interfacing Registry Systems December 2000.
Development Process and Testing Tools for Content Standards OASIS Symposium: The Meaning of Interoperability May 9, 2006 Simon Frechette, NIST.
Revelytix SICoP Presentation DRM 3.0 with WordNet Senses in a Semantic Wiki Michael Lang February 6, 2007.
ECIMF meeting, Paris Overview of some international projects related to ECIMF Andrzej Bialecki.
9 th Open Forum on Metadata Registries Harmonization of Terminology, Ontology and Metadata 20th – 22nd March, 2006, Kobe Japan. Presentation Title: Day:
©Ferenc Vajda 1 Semantic Grid Ferenc Vajda Computer and Automation Research Institute Hungarian Academy of Sciences.
1 UNIT –II Architecting Web Service. 2 Why SOA? – business point of view  Information Technology (IT) workers face many challenges, including: Limited.
1 6/4/2016 UDEF_Solutions, Inc. Universal Data Element Framework UDEF_Solutions, Inc. UDEF_Solutions, Inc. June 29, 1998 UDEF Power Coupled with XML for.
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
Overview of SC 32/WG 2 Standards Projects Supporting Semantics Management Open Forum 2005 on Metadata Registries 14:45 to 15:30 13 April 2005 Larry Fitzwater.
Tutorial on XML Tag and Schema Registration in an ISO/IEC Metadata Registry Open Forum 2003 on Metadata Registries Tuesday, January 21, 2003; 4:45-5:30.
Metadata and Meta tag. What is metadata? What does metadata do? Metadata schemes What is meta tag? Meta tag example Table of Content.
Information Architecture The Open Group UDEF Project
Providing web services to mobile users: The architecture design of an m-service portal Minder Chen - Dongsong Zhang - Lina Zhou Presented by: Juan M. Cubillos.
IT Enablement Approaches Large Business may have hundreds of processes to be enabled by IT. Several Types of Application may be deployed –Departmental.
Achieving Semantic Interoperability at the World Bank Designing the Information Architecture and Programmatically Processing Information Denise Bedford.
Universal Data Element Framework (UDEF) The Semantic DNS and a Disaster Response Pilot Use Case Ron Schuldt, Chair The Open Group UDEF Forum December 6,
The Semantic Web. What is the Semantic Web? The Semantic Web is an extension of the current Web in which information is given well-defined meaning, enabling.
ONION Ontologies In Ontology Community of Practice Leader
ISO TC37/SC4 N435 Nov 12, 2007 Presented by Miran Choi/ETRI Written by Jae Sung Lee/Chungbuk National Univ.
Semantic Data Extraction for B2B Integration Syntactic-to-Semantic Middleware Bruno Silva 1, Jorge Cardoso 2 1 2
XML and Distributed Applications By Quddus Chong Presentation for CS551 – Fall 2001.
Introduction To DBMS.
The Semantic Web By: Maulik Parikh.
Agenda Federated Enterprise Architecture Vision
Knowledge Management Systems
Lecture #11: Ontology Engineering Dr. Bhavani Thuraisingham
Data-Information-Knowledge-Wisdom
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
ENTERPRISE BUSINESS SYSTEMS part II
XML Based Interoperability Components
Wsdl.
System And Application Software
MANAGING DATA RESOURCES
© Unicorn Solutions Inc.
2. An overview of SDMX (What is SDMX? Part I)
2. An overview of SDMX (What is SDMX? Part I)
Metadata Framework as the basis for Metadata-driven Architecture
Universal Data Element Framework (UDEF)
1/18/2019 Transforming the Way the DoD Manages Data Implementing the Net Centric Data Strategy using Communities of Interest Introduction
HingX Project Overview
One Language. One Enterprise.™
2/15/2019 Transforming the Way the DoD Manages Data Implementing the Net Centric Data Strategy using Communities of Interest Introduction
Metadata The metadata contains
SOA Strategies for Enterprise X
Semantic Wikis Expedition #52 Conor Shankey CEO July 18, 2006
SDMX IT Tools SDMX Registry
Presentation transcript:

Convergence of Semantic Naming and Identification Technologies? What are the Choices and What are the Issues? Arlington, VA April 27, 2006 Ron Schuldt Lockheed Martin Enterprise Information Systems Senior Staff Systems Architect

The IT Challenge – A Perspective An Extensive IT Infrastructure

Agenda The Semantics Problem Relevant Architectures and Standards Semantics Naming and Identification Choices Semantic Web based Metadata Registry - ISO/IEC 11179 based Universal Data Element Framework (UDEF) – A Semantic DNS for Structured Data Disaster Response Example Use Case Semantics Naming and Identification Issues

The Semantics Problem

The Problem - Global Perspective Many are attempting to set their own semantics standard Each must interface with organizations they do not control Elec Banks Supplies Raw Mtl Customers Tax Agencies Trans Organization Insurance Other Utility Retail The problem is the lack of common semantics and schema between organizations

The Problem - Enterprise Perspective Conflicting semantic overlaps between back-office systems App A App B App C Other Apps Legacy Data Though semantically equal, the following are 4 different XML tag names <PARTNUMBER>111-222-333</PARTNUMBER> <partNumber>111-222-333</partNumber> <PartNumber>111-222-333</PartNumber> <partnumber>111-222-333</partnumber>

The Problem – Legacy Applications Across the globe there are millions of legacy applications that will remain for many decades that need to be Web enabled – in preparation for Web Services and Service Oriented Architecture XML and associated W3C standards address the syntax requirements but an adopted content semantics standard does not exist yet that can transcend all functions of all organizations Users of the legacy applications consistently resist changing the names of the fields The semantics solution needs to be non-intrusive to the application user

The Problem – Content Discovery Content (Web pages, various documents in various formats, data in databases, etc.) resides on countless servers across the globe. Lack of standard names and their meaning makes it difficult to find the data objects of interest – both inter- and intra-enterprise. W3C is attempting to address this through the Semantic Web suite of metadata standards (RDF, OWL, etc.) and URI for unique identification of instances.

Relevant Architectures and Standards

OASIS Reference Model for SOA* * Reference Model for Service Oriented Architecture v1.0, Committee Draft, 10 Feb 2006 for Public Review

An Example Data Reference Model United States Federal Enterprise Architecture Data Reference Model http://www.whitehouse.gov/omb/egov/a-2-EAModelsNEW2.html

A Semantics Reference Model Understandable semantics transcend every aspect of inter- and intra-enterprise data exchange – whether machine-to-machine or machine-to-human or human-to-human. Semantics Reference Model by Andreas Tolk (2005)

An Example Information Architecture Secure Infrastructure Presentation GUI/Web Portal Mobile Identity & Access Management Information Acquisition Discovery Search Intelligent Agents Business Analytics Metadata Management Integration Taxonomy Semantics Registry Web Services Metadata Data Standards Content Management Enterprise Application Integration Author Approve Store Publish Information Repositories Documents Web Content Rich Media Data Warehouse Legacy Databases

Example Metadata Use Cases Social Networking Inference & Rules Semantic Linking Finding People: (Tacit Knowledge) Finding Content: (Explicit Knowledge) Achieving Visibility: (Potential Knowledge) Building Applications: Interoperability: Inference & Rules Semantic Search Content Repository Content Repository Content Discovery RSS Feeds Inference & Rules Semantic Aggregation database Dashboards & Business Intelligence desktop Map/Transform web service legacy Inference & Rules Business Logic Application GUI & Workflow Persistent Data (RDB/XML/RDF) Inference & Rules Semantic Mediation Service- Oriented Architectures Service- Oriented Architectures Anything

Sample Definitions of “Semantics” Sample of Definitions from the Web: The relationships of characters or groups of characters to their meanings, independent of the manner of their interpretation and use. Contrast with syntax. The science of describing what words mean, the opposite of syntax. The meanings assigned to symbols and sets of symbols in a language. The study of meaning in language, including the relationship between language, thought, and behavior. The meaning of a string in some language, as opposed to syntax which describes how symbols may be combined independent of their meaning.

Proposed Definition and Standards “Semantic Interoperability” Proposed Definition: The shared meaning of a string of characters and/or symbols in some language within a context that assures the correct interpretation by all actors. “Semantic Interoperability” Standards Cross Standard Semantics and Metadata Alignment – UDEF, RDF, OWL Domain Specific “Semantic and Syntax Payload” Standards Domain Specific Implementation Conventions (subsets & extensions) OAGIS ACORD XBRL HL7 EIA-836 PLCS …. Others “Semantic Foundation” Standards ISO/IEC 11179-5, ISO 15000-5, UN Naming and Design Rules “Syntax Foundation” Standards W3C – XML, XML Schema

Example Domain Specific Payload Standards OAGIS – Open Applications Group http://www.openapplications.org/ Participants - ERP and middleware vendors and end users Example payload – purchase order HL7 - Health Care http://www.hl7.org/ Participants – health care providers across the globe Example payload – health records ACORD – XML for the Insurance Industry http://www.acord.org/ Participants – insurance providers across the globe Example payload – company insurance claim XBRL – Business Reporting - Accounting http://www.xbrl.org/ Participants – major accounting firms across the globe Example payload – general ledger and company financial report to SEC EIA-836 – Configuration Management Data Exchange and Interoperability http://www.dcnicn.com/cm/index.cfm Participants – DoD and aerospace and defense industry (AIA and GEIA) Example payload – engineering change

ISO/IEC 11179 - Has Six Parts Part 1: Metadata Registries - Framework Part 2: Metadata Registries - Classification Part 3: Metadata Registries - Registry Metamodel and Basic Attributes Part 4: Metadata Registries - Formulation of Data Definitions Part 5: Metadata Registries - Naming and Identification Principles Part 6: Metadata Registries - Registration http://isotc.iso.ch/livelink/livelink/fetch/2000/2489/Ittf_Home/PubliclyAvailableStandards.htm

Semantics Naming and Identification Choices

Comparing The Two Choices Comparison Topic Semantic Web Metadata Registry Key Standards RDF & OWL each with variations ISO/IEC 11179 – six parts Domain Specific Payload Standards Hundreds to thousands Primary Scope Unstructured content on servers Structured data in databases and back-office applications Naming Approach Ontologies with controlled vocabulary (e.g., WordNet) ISO/IEC 11179-5 based controlled vocabulary Identification Approach Definition instance URI Data Element Concept unique identifier Primary Benefit Enable content discovery and inference relationships Reduce costs of integrating multiple applications & Simplicity

UDEF – A Semantic DNS for Structured Data

Goal of Global Semantics Standard Reduce Requirements and Design-Time Phase Semantics Analysis Time and Cost Common Point-to-Point Approach --- n(n-1) Adopt Global Semantics Standard Approach --- 2n Global Semantics Standard 50 100 150 200 250 300 350 400 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 $$ Savings

ISO/IEC 11179 Terminology Object Class Property Representation Data Element Concept UDEF Maps Data Element Concepts - The Semantics Data Element Value Domain Core Data Element Application Data Element

Universal Data Element Framework UDEF is a proposed universal instantiation of ISO/IEC 11179-5 UDEF Object Class List Entity Document Enterprise Place Program Product Process Person Asset Law-Rule Environment Condition Liability Animal Plant Mineral Event Property List* Amount Code Date Date Time Graphic Identifier Indicator Measure Name Percent Picture Quantity Rate Text Time Value Sound Video ISO/IEC 11179-5 Naming Convention Data Element Name Object Class Term 0...n qualifiers + 1 or more required Object Class Property Term 0..n qualifiers + 1 required Property + Example UDEF-Based Data Element Concept Names Document Abstract Text Enterprise Name Product Price Amount Product Scheduled Delivery Date Engineering Design Process Cost Amount Patient Person First Name UDEF names follow the rules of English – qualifiers precede the word they modify * Based on Tables 8-1 and 8-3 in ISO 15000-5

Taxonomy Based Semantic DNS IDs UDEF Trees 17 Object Class Trees 18 Property Trees 1 2 1 4 Entity Asset Document … Amount … Code … t 1 33 68 Order Region … Type … Language a b c d Work Change Technical Purchase … Purchase Order Document_Type Code has UDEF ID = d.t.2_33.4 See http://www.opengroup.org/udefinfo/defs.htm

Mapping Across Standards Organizations cannot avoid multiple data standards ** Need global semantics standard ** PDM Sys A Part No OAGIS 7.1 ItemX X12 (EDI) Product/Service ID STEP AP 203 Product ID PDM Sys B Part Num RosettaNet ProprietaryProductIdentifier EDIFACT Item Number xCBL PartID 9_9.35.8 UDEF Universal Identifier Product(9)_Manufacturer(9).Assigned (35).Identifier(8) N (N-1) mapping effort instead becomes a 2N mapping effort

Transformation Engines Metadata Registry/Repository Enabling Discovery on Global Scale Enterprise Metadata Management Interfaces to Back-Office Systems Vendors with Canonical Models Run Time EAI Transformation Engines UDEF-Indexed Metadata Registries Global Semantics Registry Internet Std Schema Use Matrices Data Dictionary Mapping Matrices Std XML Schema Design Time Interface Developers Extend Matrices Software Vendors with UDEF ID APIs Build/Extend Schema UDEF-Indexed Metadata Registry/Repository UDEF Extension Board Web Public Data Modelers And Apps Developers Centralized metadata registry/repository Enables reuse to reduce costs Encourages standardization

Value of Semantic Standard API 1 API 2 Business Value Typical Interface Build Tasks Analyze and document the business requirements. Analyze and document the data interfaces (design time) Compare data dictionaries Identify gaps Identify disparate forms of representation Perform data transformations as required at run time Transform those data that require it Sys 1 Sys 2 Reduces dependency on system expert Sys 1 Data Names UDEF ID Sys 2 Data Names PO Num d.t.2_13.35.8 Order ID Date Ship 9_1.32.6 Ship Dt Allows automated compare Accept Loc i.0_1.1.71.4 Accept Point Business Id 3_6.35.8 Company Code Ship From Bus ID 3_6.35.8 Ship From Code Reduce design time labor Ship To ID a.a.v.3_6.35.8 Ship To Code PO Line Num d.t.2_1.17.8 Order Line Part Num 9_9.35.8 Prod Number Part Descr 9_9.14.14 Prod Descr Step toward automated transform Part Ser 9_1.1.31.8 Prod Ser Ship Qty 9_10.11 Qty Ship Part UOM 9_1.18.4 Prod Unit Part Price 9_1.2.1 Prod Unit Price UID 9_54.8 Part UID

A Few Example Domain Taxonomies Like A Semantic DNS UDEF IDs provide global semantic DNS-like indexing mechanism to discover services and data outside the firewall UDEF Domain Concept Service Emergency Management Inventory Geographic Location Transportation Electrical Goods A Few Example Domain Taxonomies

Disaster Response – Example Use Case

Disaster Response Scenario Natural disaster response team shows up lacking batteries to operate GPS system and walkie-talkie for 200 search and rescue workers – need four hundred 9-volt batteries to even begin the search and rescue effort Assumes that UDEF has been adopted globally and that UDEF IDs are exposed at company portals Goal – determine if resources might be available nearby within a manufacturer’s or supplier’s inventory Uses two UDEF tags (IDs) to locate available resources in a battery manufacturer’s inventory near the response team command center – an ad hoc query since formal interface not previously defined Use UDEF ID tags to support semantic integration of disparate procurement applications that use different purchase order semantics Two vendors participated – Unicorn and Safyre Solutions

Disaster Response Architecture Open Group Global UDEF Registry/Repository HTTP/XML Battery Manufacturers’ Industry UDEF Registry Two UDEF IDs in outbound message NineVolt.Lithium.Battery.PRODUCT_Inventory.QUANTITY a.a.aj.9_36.11 NineVolt.Lithium.Battery.PRODUCT_Postal.Zone.CODE a.a.aj.9_1.10.4

http://www.opengroup.org/udefinfo/demo0511/demos.htm Oct 20, 2005 Disaster Response Video Videos of Live Demos http://www.opengroup.org/udefinfo/demo0511/demos.htm Oct 20, 2005 http://www.opengroup.org/projects/udef/doc.tpl?CALLER=index.tpl&gdid=9189 Dec 1, 2005

For Additional Information The OPEN GROUP UDEF Forum Web Site http://www.opengroup.org/udef/ ISO/IEC 11179 – Specification and standardization of data elements http://isotc.iso.ch/livelink/livelink/fetch/2000/2489/Ittf_Home/PubliclyAvailableStandards.htm Videos of live UDEF Disaster Response Pilot Use Case demo http://www.opengroup.org/udefinfo/demo0511/demos.htm Oct 20, 2005 http://www.opengroup.org/projects/udef/doc.tpl?CALLER=index.tpl&gdid=9189 Dec 1, 2005 For Possible Follow-up Questions - Contact Dr. Chris Harding – c.harding@opengroup.org Ron Schuldt – ron.l.schuldt@lmco.com

Semantics Naming and Identification Issues

Convergence – What Are Some Issues? Issues Topic Semantic Web Metadata Registry Key Standards RDF & OWL variations make it difficult to decide best match Few vendors have adopted ISO/IEC 11179 Domain Specific Payload Standards Too many overlapping payload standards Primary Scope Less suited to structured data in databases and back-office systems Less suited to unstructured data Naming Approach Cross-domain terms that carry different meanings due to different context Lacks rigor in defining terms Identification Approach URI does not help one find the same concept across multiple systems Primary Challenge Each domain needs ontology based vocabulary Metadata management is a technology that needs greater attention