Gerald M. Radack
Copyright © 2010 PiLog. All rights reserved. What is Master Data? master data data held by an organization that describes the entities that are both independent and fundamental for an enterprise, that it needs to reference in order to perform its transactions Customers Suppliers Materials Services Assets Locations Employees Rules Regulations
Copyright © 2010 PiLog. All rights reserved. What is Data Quality? quality degree to which a set of inherent characteristics fulfills requirements [ISO 9000:2005]
Copyright © 2010 PiLog. All rights reserved. ISO 8000 ISO 8000 is concerned with: principles of data quality characteristics of data that determine its quality frameworks for data quality processes to ensure data quality Adapted from ISO :2009.
Copyright © 2010 PiLog. All rights reserved. Design Goals Low implementation cost Enable self-certification Use automated data checking wherever possible Neutral with respect to data format
Data Dictionary Master Data Data Specification is coded using concepts in specifies data requirements (templates, rules, and constraints) for coding master data using concepts from Identification Scheme specifies preferred terminology for concepts in uses identifiers from conforms to Formal Syntax for Master Data conforms to specifies the use of provenance accuracy completeness
Copyright © 2010 PiLog. All rights reserved. ISO 8000 Parts Part 1:Overview Part 100: Master data: Exchange of characteristic data: Overview Part 102: Master data: Exchange of characteristic data: Vocabulary Part 110: Master data: Exchange of characteristic data: Syntax, semantic encoding, and conformance to data specification Part 120: Master data: Exchange of characteristic data: Provenance Part 130: Master data: Exchange of characteristic data: Accuracy Part 140: Master data: Exchange of characteristic data: Completeness
Syntax Semantic encoding Conformance to data specification ISO Accuracy ISO Provenance ISO Completeness ISO
Copyright © 2010 PiLog. All rights reserved. ISO 8000 Parts ISO/TS :2009 – specifies requirements that can be checked by computer for the exchange, between organizations and systems, of master data that consists of characteristic data ISO/TS :2009 – optional addition to ISO/TS that specifies requirements for information about the provenance (history or pedigree) of master data
Copyright © 2010 PiLog. All rights reserved. ISO 8000 Parts ISO/TS :2009 – optional addition to ISO/TS that specifies requirements for declarations of master data accuracy ISO/TS :2009 – optional addition to ISO/TS that specifies requirements for declarations of master data completeness
Copyright © 2010 PiLog. All rights reserved. ISO/TS Syntax Each master data message shall contain in its header a reference to the formal syntax to which the master data message complies. The reference shall be an unambiguous identifier for the specific version of the formal syntax that was used to encode the master data message. Semantic encoding Semantic encoding is the technique of replacing natural language terms in a message with identifiers that reference data dictionary entries…Each reference shall be to a data dictionary entry contained in a data dictionary. The reference shall preserve the integrity of the recipient’s data in that the reference to the data dictionary entry may be integrated with the recipient’s own data without the creation of a joint work. Syntax and semantic resolution shall be available at no charge unless the data carries a “fee based encoding” warning label. Conformance to data specification Each master data message shall contain in its header a reference to the data specification to which the master data message complies. The reference shall be an unambiguous identifier for the specific version of the data specification that was used to encode the master data message.
Copyright © 2010 PiLog. All rights reserved. ISO Technical standards for implementing ISO 8000 Includes: – Data models and exchange formats for master data, data specifications, dictionaries, and identifiers – Guidelines for formulating dictionary content and procedures for maintaining dictionaries – Queries for master data – Definition of dictionary query services – Procedures for dictionary registration
Copyright © 2010 PiLog. All rights reserved. ISO Parts Part 1: Overview and fundamental principles Part 2: Vocabulary Part 10: Dictionary representation Part 11: Guidelines for the formulation of terminology Part 13: Identification of concepts and terminology Part 14: Dictionary query interface Part 20: Procedures for the maintenance of an open technical dictionary Part 30: Identification guide representation Part 35: Query for master data Part 40: Master data representation Part 50: Registration of open technical dictionaries
Dictionary ISO ISO Master data (catalogue) ISO ISO Identification Guide ISO is coded using concepts in uses concepts from specifies data requirements (templates and rules) for coding Query for master data ISO ISO requests Dictionary query ISO , 6 ISO , 10 requests information from is coded using concepts in Identification scheme ISO ISO has concepts identified by
ISO 8000 high-level requirements ISO detailed requirements & data formats other standards detailed requirements & data formats (e.g., ISO , EDI) can be used with ECCMA Open Technical Dictionary (eOTD) other dictionaries (e.g., ISO ,511) can be used with
eOTD Concept Registry (metadata registry) Terminology GSA-IAE Terminology SDO Terminology SDO Terminology SDO Terminology Public domain concept identifiers Free identifier resolution to underlying terminology (web services) Hyperlink to source standards Multilingual Multiple terms, definitions and images linked to single concept identifier Standard Terminology
Copyright © 2010 PiLog. All rights reserved. Automating the data supply chain Codification at Source Data User Data Provider Sub eOTD-i-xml (data requirements statement) ISO eOTD-q-xml (query) ISO Sub-Tier eOTD-q-xml Sub-Tier eOTD-r-xml eOTD-r-xml (data exchange) ISO
Ian Smith, UK National Codification Bureau
Step 1: Define data requirements Knowing what data you need and how to ask for it.
Building a data specification (identification guide)
XML representation of data spec.
Step 2: Assemble quality data set Clean existing data and collect missing data in accordance with data specification.
Copyright © 2010 PiLog. All rights reserved. Level 1 & 2 Cataloguing Power Rating Frame Electrical Rating Speed Mounting Insulation Class Poles Service Factor Enclosure PropertiesItemClass Part NoMnfr MOTOR ELECTRIC WEG 1234EF Original Client Description MOTOR 400KW 6 POLE 525VOLT MAKE WEG P/N 1234EF: SF1,0 CODE G:IP65:IL/IN 6.6:DUTY SI: NR :AMB 40DEGREE C:DELTA T 80DEG: COS 0,86:COOLING IC 411:ALT1000M:MPD SEC DREDGE MAIN MOTOR FFT 400KW, 6 POLE, 525VOLT, SF1,0 CODE G:IP65:IL/IN 6.6:DUTY SI: NR :AMB 40DEGREE C:DELTA T 80DEG: COS 0,86:COOLING IC 411:ALT1000M:MPD SEC DREDGE MAIN MOTOR
Copyright © 2010 PiLog. All rights reserved. MOTOR 400KW 6 POLE 525VOLT MAKE WEG P/N 1234EF: SF1,0 CODE G:IP65:IL/IN 6.6:DUTY SI: NR :AMB 40DEGREE C:DELTA T 80DEG: COS 0,86:COOLING IC 411:ALT1000M:MPD SEC DREDGE MAIN MOTOR Original Client Description ItemClass MOTOR ELECTRIC Frame Electrical Rating Power Rating Speed Mounting Insulation Class Poles PropertiesValues Service Factor VAC KW UOM Part NoMnfr 1.0 CODE G FFT IL/IN 6.6: DUTY SI: NR :AMB 40 DEGREE C:DELTA T 80DEG: COS 0,86:COOLING IC 411:ALT 1000M: MPD SEC DREDGE MAIN MOTOR WEG 1234EF EnclosureIP65 Level 3 Cataloguing
Copyright © 2010 PiLog. All rights reserved. MOTOR 400KW 6 POLE 525VOLT MAKE WEG P/N 1234EF: SF1,0 CODE G:IP65:IL/IN 6.6:DUTY SI: NR :AMB 40DEGREE C:DELTA T 80DEG: COS 0,86:COOLING IC 411:ALT1000M:MPD SEC DREDGE MAIN MOTOR Original Client Description Frame Electrical Rating Power Rating Speed Mounting Insulation Class Poles PropertiesValues Service Factor VAC KW RPM 6 F 988 FOOT HGF355E UOM 1.0 CODE G EnclosureIP65 Level 4 Cataloguing Item Class MOTOR ELECTRIC IL/IN 6.6: DUTY SI: NR :AMB 40 DEGREE C:DELTA T 80DEG: COS 0,86:COOLING IC 411:ALT 1000M: MPD SEC DREDGE MAIN MOTOR FFT Part NoMnfr WEG 1234EF
Value Standardization Conformance to a Standard Representation UOM 1.10MM 2.10 mm 3.1 cm 4.1CM 5.10mm 6.1,0 cm 7.1,0CM STANDARDIZE 10 MM UOM 1.10 MM 2.10 MM 3.10 MM 4.10 MM 5.10 MM 6.10 MM 7.10 MM
Step 3: Render data for multiple user groups and applications Display data in multiple formats and languages in accordance with the needs of users and downstream systems. Examples: ERP short descriptions, marketing descriptions, ERP long descriptions, …
Copyright © 2010 PiLog. All rights reserved.
Localization
Managing requirements for data and rendering guides
Example: Russian
Contacts Peter Benson Project leader: ISO 8000 and ISO Dr. Gerald Radack Editor: ISO 8000 and ISO PiLog USA 2980 Linden St. Ste E2 Bethlehem, PA