NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.

Slides:



Advertisements
Similar presentations
1 Ontolog OOR Use Case Review Todd Schneider 1 April 2010 (v 1.2)
Advertisements

Federal Transparency.gov As Data For the Digital Government Strategy Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Information Builders Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for Business: Semantic Verses Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Oracle Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Presentation to Data.gov PMO Semantic Web/Linked Data Team Dr. Brand Niemann Director and Senior Data Scientist Semantic Community July 27,
Build Air Force OneSource in the Cloud for the Data.Gov and Open Government Vocabulary Teams UDEF Deployment Workshop Planning Meeting at the Open Group.
Build the Binary Group in the Cloud Brand Niemann Senior Enterprise Architect Binary Group August 5, Updated August 8,
Build Systems of Systems in the Cloud: Tutorial Brand Niemann Director and Senior Data Scientist Semantic Community November 9,
A Search for Veterans Benefits Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community December 22,
OMB Data Visualization Tool Requirements Analysis: IBM Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Logi Analytics Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: QlikView Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi
EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Semantic Data Discovery: Proof of Concept for DHS
Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: SAP Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
3 Round Stones: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Introduction to SharePoint 2010 Sayed Ali (MCTS, MCITP) Senior SharePoint Administrator Arabian Advanced Systems(Naseej)
A TEDMED Data Reveal: Big and Little Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government.
Imagine Everything is Before You: Past, Present, and Future Paper and Demonstration for the 2014 Family History Technology BYU Dr. Brand Niemann.
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
GIS Data Science for Collaboration Across Communities: GIScience 2.0 and Beyond Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Xperience 2013 Be Informed 4.2 Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.
Data Science Publication for NSF Polar Cyberinfrastructure Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect.
1 GJXDM/NIEM Presentation. Global Information Sharing Initiatives Executive Briefing Global Information Sharing Initiatives Executive Briefing 2 Background:
Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Internet Fundamentals Total Advantage MS Excel 97, Hutchinson, Coulthard, 1998 McGraw Introduction to HTML Chapter 7.
Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.
Data Science ESIP Publication Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Why Doesn't EPA Have a Self- Contained Statistical Unit?: A Tribute to Doug Engelbart Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Data Science for EPA Big Data Analytics: Oregon Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for Migration Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Health Datapalooza IV: Child and Adolescent Health Data App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
An Internet of Things: People, Processes, and Products in the Spotfire Cloud Library Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist.
Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Harnessing Data to Address Diabetes in the US Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL.
Data Science for HealthCare.gov Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
FEA DRM Management Strategy Presented by : Mary McCaffery, US EPA.
Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.
SICoP 2011: Transforming Government through Innovation with Semantic Technologies Semantic Tech and Business Conference, November 29 – December 1, 2011.
Data Science for FDA RFI Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for Conservation International's Big Ecosystem Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Cross Information Sharing and Integration for the Intelligence Community: 13 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise.
Harnessing Health.Data.gov Data to Address Diabetes in the US Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
U.S. Federal Government Handling of Data for Open Government Data in Japan Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Brand Niemann, US EPA and
Spotfire 5 Users Guide Dashboard
Title: Build EPA Apps in the Cloud
Tutorial 7 – Integrating Access With the Web and With Other Programs
NIEM Tool Strategy Next Steps for Movement
Presentation transcript:

NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger May 5,

Background Previous Stories and Analytics NIEM Linked in Discussions DoD Officially Adopts NIEM NIEM 3.0 Alpha Review Request Thetus Savannah Knowledge Base & Platform CSDS: Cloud, SOA, Semantic, & Data Science Conference and Pilots 2

Previous Stories and Analytics 3

NIEM Linked in Discussions 4 URL

DoD Officially Adopts NIEM 5

NIEM 3.0 Public Review 6

NIEM 3.0 Public Review Steps STEP 1 Download Alpha 2 STEP 2 Determine your Review Type and Access Materials – Non-Technical Review MY NOTE: Why is this a non-technical review? – Reviewing the model in Excel allows you to see the elements and types in NIEM 3.0 without having to understand XML schemas. To begin a non-technical review: – Locate the Microsoft Excel (.xlsx) file in the Alpha 2 package. MY NOTE: There are three Excel Files. – Open the Excel file. The file is a spreadsheet with several tabs. The first tab contains the content of NIEM Core. The other tabs each contain an individual NIEM domain. All domains are included. STEP 3 Conduct your Review – We’re looking for your review and feedback on all things 3.0! If you have never taken part in a model review and/or not sure what to look for, a few suggested items to consider when reviewing NIEM 3.0 Alpha 2 are: – Definitions: Do you see a definition that appears to be incorrect? Do any definitions appear to conflict with each other? Are definitions distinct and distinguishable (or at least different)? – Grammar/spelling/punctuation: Do you see errors in the text of the model? – Technical Architecture: You might notice some things look different in NIEM 3.0, such as augmentations. NIEM 3.0 has over a dozen technical improvements to architecture and structure. Because we are currently updating the NIEM Naming and Design Rules (NDR) for 3.0, we don’t expect that reviewers will be able to comment on all changes during Alpha 2. – Harmonization: Do data element exists only once? Are they semantically precise and clear? Are they reusable and scalable across domains and the NIEM community? – Code Lists: Are code lists up-to-date and relevant? – Other: Are there content or structural items or issues that need to be addressed? STEP 4 Submit your Feedback on NIEM.gov 7

NIEM 3.0 Alpha 2 Public Review 8

niem-3.0-alpha2 File Inventory 9

niem-3.0-alpha2.xlsx: NIEM Core 10 My Note: Why these yellow lines and Web links?

niem-3.0-alpha2.xlsx: Tabs 1.Knowledge Base 2.Consolidation: Number NIEM Core 4.Biometrics 5.CBRN 6.CYFS 7.Emergency Management 8.Immigration 9.Intel 10.Infrastructure Protection 11.International Trade 12.JXDM 13.Maritime 14.Screening 15.Type Description 16.Elts Sorted by Type 17.Elts Sorted by Name 18.Attributes 19.Namespaces 20.Class Type 11

niem-3.0-alpha2.xlsx: Consolidation 12

niem-3.0-alpha2.xlsx: Spotfire 13 Navigation and Metadata Inventory Data Set Knowledge Base Distribution of Types in Knowledge Base 99 Excel Tabs 112 XSDs Consolidation Data Set Distribution of NIEM Types

NIEM and Thetus Knowledge Base 14 Mashup Federated Search Well-defined URLs Semantic Index (see next slide)

NIEM and Thetus Knowledge Base: Semantic Index 15

niem-3.0-alpha2-codes.xlsx: Spotfire 16

Thetus Savannah: Knowledge Base & Platform 17

Thetus Savannah: All Source Analysis Capabilities Mindmap, an analysis process modeling interface and visualization. Search interface with connectors to external data sources such as CIDNE, as well as the local application repository. My Stuff for organizing analysis assets, grouping them thematically and tracking sources. Link chart tool for creating link charts that can be the inputs to SNA analytics or used as a network visualization. Geospatial tool for creating high-quality maps and visualizing data with geo coordinates. Document viewer and annotation/markup for managing and synthesizing unstructured text. Virtual document to allow analysts to track content and capture insights. Production tool to quickly assemble high quality output. Structured data visualization for quick line, bar, scatter, pie, and bubble chart visualizations. 18

Conclusions and Recommendations This NIEM 3.0 Alpha Review Pilot Demonstrates: – Cloud Tools – MindTouch and Spotfire – SOA Services – Integrate Multiple Data Sources – Semantic Search – Facets and Context – Data Science – Extract meaning from data, create data products, and tell a story that can be easily understood by non-practitioners. Source: WikipediaWikipedia Thetus Savannah Is An Example of Mature Platform That Does These Things Well for the Intelligence Community. Which Is the Subject of Our Conference 19

CSDS: Cloud, SOA, Semantic, & Data Science Conference and Pilots 20