NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger May 5,

Background Previous Stories and Analytics NIEM Linked in Discussions DoD Officially Adopts NIEM NIEM 3.0 Alpha Review Request Thetus Savannah Knowledge Base & Platform CSDS: Cloud, SOA, Semantic, & Data Science Conference and Pilots 2

Previous Stories and Analytics 3

NIEM Linked in Discussions 4 URL

DoD Officially Adopts NIEM 5

NIEM 3.0 Public Review 6

NIEM 3.0 Public Review Steps STEP 1 Download Alpha 2 STEP 2 Determine your Review Type and Access Materials – Non-Technical Review MY NOTE: Why is this a non-technical review? – Reviewing the model in Excel allows you to see the elements and types in NIEM 3.0 without having to understand XML schemas. To begin a non-technical review: – Locate the Microsoft Excel (.xlsx) file in the Alpha 2 package. MY NOTE: There are three Excel Files. – Open the Excel file. The file is a spreadsheet with several tabs. The first tab contains the content of NIEM Core. The other tabs each contain an individual NIEM domain. All domains are included. STEP 3 Conduct your Review – We’re looking for your review and feedback on all things 3.0! If you have never taken part in a model review and/or not sure what to look for, a few suggested items to consider when reviewing NIEM 3.0 Alpha 2 are: – Definitions: Do you see a definition that appears to be incorrect? Do any definitions appear to conflict with each other? Are definitions distinct and distinguishable (or at least different)? – Grammar/spelling/punctuation: Do you see errors in the text of the model? – Technical Architecture: You might notice some things look different in NIEM 3.0, such as augmentations. NIEM 3.0 has over a dozen technical improvements to architecture and structure. Because we are currently updating the NIEM Naming and Design Rules (NDR) for 3.0, we don’t expect that reviewers will be able to comment on all changes during Alpha 2. – Harmonization: Do data element exists only once? Are they semantically precise and clear? Are they reusable and scalable across domains and the NIEM community? – Code Lists: Are code lists up-to-date and relevant? – Other: Are there content or structural items or issues that need to be addressed? STEP 4 Submit your Feedback on NIEM.gov 7

NIEM 3.0 Alpha 2 Public Review 8

niem-3.0-alpha2 File Inventory 9

niem-3.0-alpha2.xlsx: NIEM Core 10 My Note: Why these yellow lines and Web links?

niem-3.0-alpha2.xlsx: Tabs 1.Knowledge Base 2.Consolidation: Number NIEM Core 4.Biometrics 5.CBRN 6.CYFS 7.Emergency Management 8.Immigration 9.Intel 10.Infrastructure Protection 11.International Trade 12.JXDM 13.Maritime 14.Screening 15.Type Description 16.Elts Sorted by Type 17.Elts Sorted by Name 18.Attributes 19.Namespaces 20.Class Type 11

niem-3.0-alpha2.xlsx: Consolidation 12

niem-3.0-alpha2.xlsx: Spotfire 13 Navigation and Metadata Inventory Data Set Knowledge Base Distribution of Types in Knowledge Base 99 Excel Tabs 112 XSDs Consolidation Data Set Distribution of NIEM Types

NIEM and Thetus Knowledge Base 14 Mashup Federated Search Well-defined URLs Semantic Index (see next slide)

NIEM and Thetus Knowledge Base: Semantic Index 15

niem-3.0-alpha2-codes.xlsx: Spotfire 16

Thetus Savannah: Knowledge Base & Platform 17

Thetus Savannah: All Source Analysis Capabilities Mindmap, an analysis process modeling interface and visualization. Search interface with connectors to external data sources such as CIDNE, as well as the local application repository. My Stuff for organizing analysis assets, grouping them thematically and tracking sources. Link chart tool for creating link charts that can be the inputs to SNA analytics or used as a network visualization. Geospatial tool for creating high-quality maps and visualizing data with geo coordinates. Document viewer and annotation/markup for managing and synthesizing unstructured text. Virtual document to allow analysts to track content and capture insights. Production tool to quickly assemble high quality output. Structured data visualization for quick line, bar, scatter, pie, and bubble chart visualizations. 18

Conclusions and Recommendations This NIEM 3.0 Alpha Review Pilot Demonstrates: – Cloud Tools – MindTouch and Spotfire – SOA Services – Integrate Multiple Data Sources – Semantic Search – Facets and Context – Data Science – Extract meaning from data, create data products, and tell a story that can be easily understood by non-practitioners. Source: WikipediaWikipedia Thetus Savannah Is An Example of Mature Platform That Does These Things Well for the Intelligence Community. Which Is the Subject of Our Conference 19

CSDS: Cloud, SOA, Semantic, & Data Science Conference and Pilots 20