Semantic Data Architecture for DoD’s Federal Shared Services Brand Niemann Semantic Community July 27, 2011 1.

Slides:



Advertisements
Similar presentations
BENEFITS OF SUCCESSFUL IT MODERNIZATION
Advertisements

The National Declassification Center Releasing All We Can, Protecting What We Must Public Interest Declassification Board NDC Project Update April 22,
DoD’s FPDS-NG Training Day Project Overview and Status 20 April 2006 Business Transformation Agency.
Dynamic Case Management for Military and Intelligence Departments Can Improve Their Enterprise Architecture Programs Dr. Brand Niemann Director and Senior.
Connecting People With Information DoD Net-Centric Services Strategy Frank Petroski October 31, 2006.
Agile insurance carrier - What the carrier has to look like? Glenn Lottering Senior Director, EMEA Insurance Product Strategy and Sales Consulting.
Build Air Force OneSource in the Cloud for the Data.Gov and Open Government Vocabulary Teams UDEF Deployment Workshop Planning Meeting at the Open Group.
IT PLANNING Enterprise Architecture (EA) & Updates to the Plan.
Build the Binary Group in the Cloud Brand Niemann Senior Enterprise Architect Binary Group August 5, Updated August 8,
Build Systems of Systems in the Cloud: Tutorial Brand Niemann Director and Senior Data Scientist Semantic Community November 9,
Binary Group at the LandWarNet Conference "Transforming Cyber While at War" Tampa Convention Center August 22-26, 2011 This document contains Binary Group,
EbXML Registry Technical Committee n Defining and managing interoperable registries and repositories n The OASIS ebXML Registry TC develops specifications.
Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi
Semantic Data Discovery: Proof of Concept for DHS
Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Navigating the Maze How to sell to the public sector Adrian Farley Chief Deputy CIO State of California
1 Semantic Cloud Computing & Open Linked Data Pattern Brand Niemann Invited Expert to the NCIOC SCOPE and Services WGs September 22, 2009.
Data Science for USGS Minerals Big Data Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data.
DoD Architecture Registry System DARS 16 September 2009 Walt Okon Senior Architect Engineer Senior Architect Engineer for Information Sharing Enterprise.
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
9/11/ SUPPORT THE WARFIGHTER DoD CIO 1 Sample Template Community of Interest (COI) Steering Committee Kick-off Date: POC: V1.0.
1 Briefing for EPA and OEI Communications Coordinators and Press Officers Brand Niemann US EPA Senior Enterprise Architect and Federal CoP Leader January.
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
9/15/ SUPPORT THE WARFIGHTER DoD CIO 1 (U) FOUO Conclusions Version 1.2 DoD Net-Centric Data Strategy (DS) and Community of Interest (COI) Training.
XBRL Seminar: The New Data Reference Model
Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Geospatial Platform Update Migration of GOS to Data.gov Rob Dollison GOS Project Manager FGDC Metadata Summit 10/26/11.
1 Semanticommunity.info Tutorial Brand Niemann December 7, 2010.
Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
1 Wikify Your Best Content in Support of the OGD and Data.gov/semantic: Information Architecture Tutorial EPA Web Work Group, EPA Wiki and Blog Work Group,
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Binary Group Knows What It Knows Because of It’s Information Attitude Brand Niemann Senior Enterprise Architect and Data Scientist August 26,
1 A Target Data Architecture for the US EPA: Implementing DRM 3.0 and Data.gov Brand Niemann Senior Enterprise Architect, US EPA April 21, 2009 PARS 2009.
Build the NITRD Dashboard in the Cloud Brand Niemann Semantic Community March 14,
Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Semantic Data Science for the US Census Bureau Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
1 Services and Cloud Computing Work Groups: Status Update Brand Niemann US EPA December 18, 2009.
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
FEA DRM Management Strategy Presented by : Mary McCaffery, US EPA.
Geospatial Platform Update FGDC Steering Committee 7 June 2011.
Department of Defense Knowledge Fair Tim Young Office of Management and Budget September 27, 2007.
SICoP 2011: Transforming Government through Innovation with Semantic Technologies Semantic Tech and Business Conference, November 29 – December 1, 2011.
1 Build the EPA Enterprise Architecture IMPART in the Cloud Brand Niemann U.S. EPA July 21, Updated September 26, 2010.
EPA Geospatial Segment United States Environmental Protection Agency Office of Environmental Information Enterprise Architecture Program Segment Architecture.
1 Shift Happens! Briefing for the EPA Enterprise Architecture Team Brand Niemann Senior Enterprise Architect, US EPA, and Federal Web 2.0/3.0 Community.
NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Cross Information Sharing and Integration for the Intelligence Community: 13 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise.
1 Tutorial for the EAWG: Solution Architecture for 2010 Brand Niemann Senior Enterprise Architect U.S. EPA January 28, 2010.
1 Social Business Intelligence from Open Government Data Brand Niemann Senior Enterprise Architect US EPA November 27, 2010 DISCLAIMER: While allowed to.
NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.
A Net-Centric DoD NII/CIO 1 Sample Template Community of Interest (COI) Steering Committee Kick-off Date: POC:
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Federal Software Asset Management Initiative Concept of Operations Report to the Executive Steering Committee March 8, 2004 Implementing the President’s.
Connecting People With Information Transforming the Way the DoD Manages Data M. David Allen OASD(NII)/DoD CIO May 23, 2006 “The.
Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
1 Collaboration: Communities of Practice Using Wiki Technology OGETA Forum Meeting, Atlanta, Georgia Atlanta-Augusta Room, 3rd Floor, Sam Nunn Atlanta.
Leadership Guide for Strategic Information Management Leadership Guide for Strategic Information Management for State DOTs NCHRP Project Information.
PP 620: Public Policy and Health Administration Unit One Seminar Kris R. Foote, J.D., M.P.A., M.S.W. Kaplan University.
Better Data, Better Decisions, Better Government: Digital Accountability and Transparency Act (DATA Act) Implementation Update Christina Ho, Deputy Assistant.
Environment, Safety, and Occupational Health Opportunities in DoD Business Transformation May 4, 2006.
Semantic Enhancements for DoD Information Sharing, Enterprise Architecture, and Standards Dr. Brand Niemann Director and Senior Enterprise Architect –
Brand Niemann, US EPA and
Spotfire 5 Users Guide Dashboard
1/18/2019 Transforming the Way the DoD Manages Data Implementing the Net Centric Data Strategy using Communities of Interest Introduction
2/15/2019 Transforming the Way the DoD Manages Data Implementing the Net Centric Data Strategy using Communities of Interest Introduction
Presentation transcript:

Semantic Data Architecture for DoD’s Federal Shared Services Brand Niemann Semantic Community July 27,

Overview 1. Motivation 2. Federal IT Spending Dashboard 3. Build TOGAF in the Cloud 4. Build DoD IG in the Cloud 5. OMB and DoD Federal Services 6. Semantic Data Architecture 7. Project Needs 8. Pilots 9. Questions and Answers 2

1. Motivation 3

1. Motivation / 4

1. Motivation DoD Deputy Chief Management Officer Beth McGrath welcomed about 300 attendees yesterday and referred to her April 4th memorandum that said: DoD historically spends more than $6.0B annually developing and maintaining a portfolio of more than 2,000 business systems and Web services. Many of these systems, and the underlying processes they support, are poorly integrated. It is imperative, especially in today's limited budget environment, to optimize our business processes and the systems that support them to reduce our annual business systems spending. She said: "It is all about all of the data and how to work with it". 5

1. Motivation During his afternoon keynote, I had the opportunity to ask General James Cartwright, Vice Chairman of the Joint Chief of Staff and our nation's second highest ranking military officer, what the goal of that memo reduction was: say reduce the cost and number of systems by 50%? General Cartwright responded by saying the goal was to drive the cost down significantly and get more agile results. He also said that the military's highest priority was to get programmers and social scientists "deployed to the edge" to met the needs of our warfighters. 6

1. Motivation A recurring question has been: show me the analytic for any claim about a more efficient and effective DoD information environment. So I decided to first check the Federal IT Spending Dashboard that I had reproduced to see what the DoD situation was. More on that in my next report. 7

2. Federal IT Spending Dashboard Semantic Data Architecture Using MindTouch and Spotfire 8

2. Federal IT Spending Dashboard Exhibit 53 Results Tab Live Spotfire Web PlayerWeb Player 9

2. Federal IT Spending Dashboard Cover Page: – Metadata: See Wiki – Notes: For IT spending figures, the numbers are the actual spending for the given fiscal year, except for FY2010 and FY2011. FY2010's figures are "enacted" as of the 2011 Budget. FY2011 is an estimate of future spending as indicated by the President's 2011 Budget for the Federal Government. – Individual Agencies (Click on Agency and see all other Tabs). – Created by: Brand Niemann, July 15, Updated July 18, Updated August 13, Tabs: – Exhibit 53 – Exhibit 300 – Milestones – Contracts – Performance Metrics – Investment Rebaseline – Investment CIO Rating 10

3. Build TOGAF in the Cloud 11 Purpose: Help the Students in a Recent TOGAF Certification Course. Invited to Present it to the Washington Metropolitan Area, AOGEA-WMA and the London Open Group Conference Recently.

3. Build TOGAF in the Cloud 12 Purpose: An Architecture Repository for TOGAF 9 built with "cloud tools" that re- architects the architecture itself, focuses on the "architectural data", and provides an "interoperability interface".

4. Build DoD in the Cloud 13 Purpose: An Interoperability Dashboard Interface to the DoD Semi-Annual Report to Congress that Uses Cloud Tools to Support the Warfighter, Social Scientist and Computer Programmer!

4. Build DoD in the Cloud Demo in Response to DoD IG RFI and Used Presentation at 3 rd Annual SOA and Semantic Technologies Symposium, July 13-14, 2011, Build DoD (Vocabularies) in the Cloud (Web Link) Providing a Tutorial on the Semantic Community Semantic Data Architecture.Web Link Dennis Wisnosky asked the Semantic Community to provide comments on the DoD Semantic Training – see next slide. 14

Semantic Community: Suggestions for DoD Semantic Training LevelFocusProduct ExecutiveBuild DoD in the CloudKoulopoulos: Semantic web is agile connections that can be changed rapidly by minimal disruption and risk. Niemann: The cloud is the broader business context to reduce the cost and number of DoD information systems. Hands-onDoD Pilots-to- Implementations Those that can teach the Executive and take Pilots-to Implementations CertificationDoD Case StudiesThose that can teach the Executive and Hands-on and produce a peer-reviewed case study of a DoD implementation. Note: See my symposium presentation for examples of all three of these.

General Government Policy Resources Oversight Transparency Education & Workforce Sector Defense & Security Sector Law & Justice Sector Diplomacy & Trade Sector Economic & Financial Sector Transport & Space Sector Energy & Technology Sector Environment & Natural Resources Sector Health & Well-Being Sector Sector designations are needed to support new services and interoperability across traditional agency boundaries. Example: On-line Learning Example: Energy Efficient Housing Example: Smart-Roads Example: Alternative Fuels Example: Electronic Patient Records Example: Border Protection Example: International Legal Cases Example: International Trade & Exports Example: Global Economic Tracking Central sector for general government support services and transparency Changes in Use – Shared Services 5. OMB and DoD Federal Services Source: Walt Okon, July 15, See Next Slide!

5. OMB and DoD Federal Services 17 Database Size: 856,351 rows by 45 columns. 230 MB!

6. Semantic Data Architecture Walt Okon’s Slides: – Architecture viewpoints are composed of data that has been organized to facilitate understanding. – Structured Knowledge Base – Common Model We could turn all the information in and behind his slides into those two objectives which is what Brand piloted in the Build TOGAF in the Cloud! Walt Okon’s Slides: – Goal: Eliminate redundancies and identify information sharing services, at the same time, by: Inventorying data systems and their data elements and dictionaries which shows "data element bloat" (redundant data elements in multiple systems) and poor data quality and governance which leads to a mission critical set of higher-quality data elements (some call them "master data management golden data elements" now) that increases the efficiency of the enterprise (in a virtual system on top of the legacy systems) and provide a best-practice shared system for others that need those data elements. – We do this in a collaboration and data analysis tool like Spotfire support by a Wiki like MindTouch like Brand has been doing for the US EPA, Data.gov, SEMIC.EU, DoD IG, etc. » See: My recent interview in Smart Enterprise.Smart Enterprise 18

7. Project Needs We need the DoD Information System Inventory to help identify Healthcare, Cloud and Identity Management System with Data Dictionaries. – We expert to be able to build upon and coordinate with work being done for Dennis Wisnosky by his support staff. We need the help of the Data Stewards/Subject Matter Experts to answer questions about the semantics of their data dictionaries. – We are suggesting a knowledgeable expert be added to our staff. We need to setup our tools (MindTouch, Spotfire and SIRA) in the type of secure environment dictated by the content we are using. – NOTE: DoDIS and CIA have enterprise licenses of Spotfire. We hope that some of this can be made available publically for purposes of briefing, training, and promoting Build DoD in the Cloud! – Brand is making two presentations next week on this kind of work: Data.gov Semantic Web/Linked Data Team and Digital Government Institute Webinar. 19

8. Pilots Goal: Linked Open Data for DoD Information Enterprise Architecture: – I have worked with the DoD public data sets to create some initial dashboard displays as linked data with faceted search. – The goal is to define the DITPR data elements as linked data, relate them to the Joint Capability Areas and other data sets and documents to create a dashboard that can be used to develop IT policy supported by analytics and provided as a Federal Shared Service to other agencies. – Public Data Sets: DoD IEA, JAC, DISA Campaign Plan 2010, DoDAF 2.0 (see TOGAF9.xls), 3 rd Annual DoD SOA and Semantic Technology Symposium, etc. – Private Data Sets: DITPR (Access), BEA8SA – IMB (XML or Excel), SNAP- IT, MDR, DARS, Service Repositories, Extract related JCIDS documents, etc. – Results: Dashboard (Spotfire) and Semantic Search (SIRA) Machine-processable 20

8. Pilots 21 PC Desktop Spotfire

DoD IT Portfolio Registry DITPR is the DoD IT portfolio registry, and it contains information on DoD IT systems. It was originally established to help track those systems and their compliance with a variety of DoD and Federal initiatives, like FISMA. So, if you look at the database schema, you’ll see it’s grown a bit organically over time. One thing added has been a mapping of the systems to a taxonomy of capability areas known as the Joint Capability Areas (JCA). 22

DoD IT Portfolio Registry 23

DoD IT Portfolio Registry 24

DoD IT Portfolio Registry 25

DoD IT Portfolio Registry 26 PC Desktop Spotfire

Business Enterprise Architecture The BEA is the DoD’s Business Enterprise Architecture, described on a portal at It’s been a large effort over the past 4-5 years to standardize the description of the non-military support functions of DoD. The encyclopedia is the IBM System Architect architecture tool repository containing the latest version of that description, Version 8.0. It was the first public DoD architecture data I could get my hands on. We’re trying to get you an XML export of that architecture. As an alternative, we can get it imported into Enterprise Elements (we have this software at Binary and it runs on top of Oracle), from which we could do various data extracts into spreadsheets. Depending on the problem area chosen, some of this architecture might be helpful to provide standard domain language, end-to-end business processes, etc. 27

9. Questions and Answers 28