SICoP 2011: Transforming Government through Innovation with Semantic Technologies Semantic Tech and Business Conference, November 29 – December 1, 2011.

Slides:



Advertisements
Similar presentations
SICoP 2011: Transforming Government through Innovation with Semantic Technologies Brand L. Niemann Director and Senior Data Scientist, Semantic Community.
Advertisements

Semantic Search for NSF Decision Making Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for Business: Semantic Verses Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science With Spotfire for Opening Government Data for Innovators and Entrepreneurs Dr. Brand Niemann Director and Senior Enterprise Architect – Data.
Semantic Enhancements for DoD Information Sharing, Enterprise Architecture, and Standards Dr. Brand Niemann Director and Senior Enterprise Architect –
Dynamic Case Management for Military and Intelligence Departments Can Improve Their Enterprise Architecture Programs Dr. Brand Niemann Director and Senior.
1 NCOIC Semantic Knowledgebase- Cloud Computing Tools Pilot Brand Niemann NCOIC Guest October 7, Updated October 29, 2010.
DoDAF 3.0: A Web 2.0 and SOA Mashup!
Semantic Data Architecture for DoD’s Federal Shared Services Brand Niemann Semantic Community July 27,
A Quint: Cross Information Sharing and Integration for the Intelligence Community NCOIC-NGA Kickoff Meeting Brand Niemann Director and Senior Enterprise.
Title: Build EPA Apps in the Cloud Dr. Brand Niemann Former US EPA Senior Enterprise Architect and Data Scientist Current Binary Group Senior Enterprise.
Presentation to Data.gov PMO Semantic Web/Linked Data Team Dr. Brand Niemann Director and Senior Data Scientist Semantic Community July 27,
Build the Binary Group in the Cloud Brand Niemann Senior Enterprise Architect Binary Group August 5, Updated August 8,
Build Systems of Systems in the Cloud: Tutorial Brand Niemann Director and Senior Data Scientist Semantic Community November 9,
A Search for Veterans Benefits Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community December 22,
Binary Group at the LandWarNet Conference "Transforming Cyber While at War" Tampa Convention Center August 22-26, 2011 This document contains Binary Group,
Semantic Interoperability Community of Practice (SICoP) Semantic Web Applications for National Security Conference Hyatt Regency Crystal City, Regency.
OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Big Data Innovation: Semantic Analytics 14 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi
Semantic Data Discovery: Proof of Concept for DHS
Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Cloud: SOA, Semantics, & Data Science Welcome and Overview Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Mandates for Data Transparency in 113th Congress: DataCoalition.org Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
3 Round Stones: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
1 Semantic Cloud Computing & Open Linked Data Pattern Brand Niemann Invited Expert to the NCIOC SCOPE and Services WGs September 22, 2009.
1 Gov 2.0 for EPA: Pollution Prevention and Toxics In Support of the June 9-13, 2008 National Dialogue on How to Enhance Access to Environmental Information:
Imagine Everything is Before You: Past, Present, and Future Paper and Demonstration for the 2014 Family History Technology BYU Dr. Brand Niemann.
Semantic Knowledge Bases and Be Informed for the FAA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
1 Briefing for EPA and OEI Communications Coordinators and Press Officers Brand Niemann US EPA Senior Enterprise Architect and Federal CoP Leader January.
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect.
1 Semantic Cloud Computing with Linked Open Data Brand Niemann, Senior Enterprise Architect U.S. EPA November 20, 2009.
XBRL Seminar: The New Data Reference Model
Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
1 Semanticommunity.info Tutorial Brand Niemann December 7, 2010.
NCOIC Geospatial Interoperability Task Team Presentation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
1 Wikify Your Best Content in Support of the OGD and Data.gov/semantic: Information Architecture Tutorial EPA Web Work Group, EPA Wiki and Blog Work Group,
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Why Doesn't EPA Have a Self- Contained Statistical Unit?: A Tribute to Doug Engelbart Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Data Science for USDA Big Data
1 Services and Cloud Computing Work Groups: Status Report Brand Niemann US EPA December 3, 2009.
Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for Migration Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Health Datapalooza IV: Child and Adolescent Health Data App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
NCOIC-NGA Demonstration of Demonstrations Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Binary Group Knows What It Knows Because of It’s Information Attitude Brand Niemann Senior Enterprise Architect and Data Scientist August 26,
Build the NITRD Dashboard in the Cloud Brand Niemann Semantic Community March 14,
Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for Semantics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Semantics.
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Cross Information Sharing and Integration for the Intelligence Community: 13 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise.
NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.
1 Promoting Careers in Knowledge Management: My Experiences Brand Niemann Library of Congress June 3, 2010.
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
U.S. Federal Government Handling of Data for Open Government Data in Japan Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Semantic Interoperability for the Office of the National Coordinator for Health Information Technology Brand Niemann and the Health Information Technology.
Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Semantic Enhancements for DoD Information Sharing, Enterprise Architecture, and Standards Dr. Brand Niemann Director and Senior Enterprise Architect –
Spotfire 5 Users Guide Dashboard
Title: Build EPA Apps in the Cloud
Presentation transcript:

SICoP 2011: Transforming Government through Innovation with Semantic Technologies Semantic Tech and Business Conference, November 29 – December 1, 2011 Brand Niemann, Director and Senior Data Scientist, Semantic Community Mills Davis, Managing Director, Project 10X Chuck Rehberg, CTO, Semantic Insights 1

Some Examples of Build Systems of Systems in the Cloud Semantic Community - US EPA and Federal CIO Council 1105 Government Information Group – Wyatt Kash SEMIC.EU – Francisco Garcia Moran DoD CIO – Teri Takai Army Systems of Systems Engineering – Terry Edwards NIEM PMO – Donna Roy FAA – NextGen – Steve Cooper Intelligence Community – Gus Hunt and Todd Myers METI – Hiroyuki Hotta DoD DCMO CTO – Dennis Wisnosky 2

DoD Deputy Chief Management Officer (DCMO) Request for Information (RFI) 3

Build DoD in the Cloud 4

5

System of Systems Architecture 6 S Semantic Index of Linked Data (e.g. Excel) Dynamic Case Management (e.g. Be Informed) Data Science Library (e.g. Spotfire) Data Science Products (e.g. Spotfire)

DoD CIO: IT Enterprise Strategic Management Tutorial Brand Niemann Director and Senior Data Scientist Semantic Community October 28,

My Best Strategic Advice to You Is: Service StepsToolProcess 1. Provision Instead of Procure Amazon Federal (secure) Web Services AWS’s Migrating Applications to the Cloud 2. Linked Data on Mobile Devices for the Warfighter MindTouch, Excel, SIRA, & Spotfire Build DoD in the Cloud 3. Dynamic Case Management for Business Agility Be InformedBe Structured DemosTitleURL AWS Gov Cloud Summit IIAWS Provision and MigrateWeb Army Weapons 2011Knowledge and Capability Management Services for ASA(ALT) SOSE Web SemTech 2011 Washington DC So Our Veterans Can Be Informed Web 8

Applying Data Science to Build a Knowledgebase Knowledgebase = Model + Instances Model = Vocabulary, Taxonomy, and Ontology/Rules Instances = Linked Data Semantically Linked to the Model 9

Applying Data Science to Build a Knowledgebase Model = – Vocabulary – Glossary in MindTouch – Taxonomy - Contents and Resources in MindTouch – Ontology/Rules in Be Informed Instances = – Linked Data Semantically Linked to the Model – MindTouch, Excel and Spotfire 10

Business Process Best Content to a Knowledgebase (MindTouch) – DoD IT Enterprise Strategy and Roadmap, etc. Knowledgebase to Spreadsheet (Excel) – Linked Data to Subparts of the Knowledgebase Excel to Dashboard (Spotfire) – Data integration and interoperability interface Spotfire Dashboard to Dynamic Case Management (Be Informed) – Structured process for updating data in the dashboard 11

Best Content to a Knowledgebase (MindTouch) 12 Well-defined URLs to subparts of the document and figure and tables.

Best Content to a Knowledgebase (MindTouch) 13 Desktop publishing- like control of content.

Knowledgebase to Spreadsheet (Excel) 14

Knowledgebase to Spreadsheet (Excel) 15

Excel to Dashboard (Spotfire) 16 PC Desktop

Excel to Dashboard (Spotfire) 17 Web Player See the Data Sort/Facet Search the Data Download the Data Share the Data (iPad)

Spotfire to Be Informed Be Structured Questions: – Greenfield: Are you starting the report from scratch? – Legacy: Are you updating the report? – Dynamic Case Management: Does Spotfire need to be updated frequently? So the Business Process Pattern Includes: – Greenfield, Legacy, and Dynamic Case Management Definitions (and Rules!): – DoD Dictionary and JCDIS Manual Executable Model: – Semantically Linked Taxonomy, Ontology, and Rules (started in previous slides) 18

Spotfire to Be Informed 19 Semantic Insights Research Assistant (SIRA). See next slide.

SIRA: Builds a simple report and an ontology of the content 20

Spotfire to Be Informed 21 Web Player DoD Dictionary Terms (5093) and Acronyms (6599) DoD Campaign Plan (100 Linked data URLs) GAO DoD Enterprise Architecture (113 Linked data URLs) JCDIS Manual (405 Linked data URLs) Note: There are additional Spotfire files with DoD data: Build DoD (Vocabulary) in the Cloud Build DoD Semantic Data Architecture in the Cloud Build the DoD IG Report to Congress in the Cloud See: Binary Services for DoD CIO and DHS NIEM PMO, PowerPoint, October 14, 2011, 48 slides.

Work in Process 22

Federation of Data Sets Strategy One Table: – Two Columns Example: Column 1: Section and Column 2: URL – Note: A Column 3: Description could be in the URL – Example: See Slide 14 – Three Columns: Example: Column 1: Subject, Column 2: Object, and Column 3: Predicate – Note: This is the Semantic Web’s Linked Open Data Cloud as Linked Open Data for Network Analytics! – Example: See Next Slide – Four Columns: Examples: Column 1: Subject, Column 2: Attribute, Column 3: From, and Column 4: To, or Column 1: City, Column 2: Country, Column 3: Longitude, and Column 4: Latitude – Note: This is the format for Spotfire’s Network Analytics Module developed for the CIA – Example: See Slide 25 23

Linked Open Data Cloud as Linked Open Data for Network Analytics 24 Is it easy to add columns for who links to who? Not in a single table. SPARQL can't do cross-tabulation (Richard Cyganiak).

Spotfire Network Analytics 25

Federation of Data Sets Strategy 26 Multiple Data Tables

Spotfire Information Designer 27

Spotfire Information Designer 28

Federated SPARQL Query: CKAN 29 Federated SPARQL Query across 14 data sources for 40,000 results (Richard Cyganiak). See Slide 31.

Federated SPARQL Query: Virtuoso 30 Linked Data Virtualization meets Oracle via ODBC (Kingsley Idehen)

Spotfire: Semantic Web Data 31 W3C Linked Data Community Directory (David Wood, as of November 28, 2911) Web Player

DoD RFI Questions Can the interview be done at/after the November 30 th Industry Discussion? Can one see the EIW work done so far in presentations and Web content? Can one use the EIW public content to pilot semantic technologies while all of this RFI process is going on? Is the overall goal to significantly reduce the number and cost of DoD Information Systems as my first story found? Is the RFI goal to federate selected DoD content for delivery to the warfighter on mobile devices over secure networks? E.g. my TBI knowledgebase Is the RFI goal to deliver public DoD content so the public can better understand and use it? E.g. my Weapons Systems 2011 knowledgebase Is the RFI goal to use the most advanced semantic technology that I know of to do Dynamic Case Management (e.g. Be Informed)? Is the DoD considering forming a Semantic Interoperability Center of Excellence like the EU’s SEMIC.EU? Should industry form a non-profit consortium with multiple organizations to do this kind of work under say a CRADA like the NCOIC is doing for the FAA NextGen and National Geospatial Intelligence Agency? Will there be a follow-up event to discuss the results of the RFI with the participants/public? How many have responded to the RFI/are registered to attend the two Industry Events? 32