Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE June 20,

Overview The Department of the Interior Bureau of Safety and Environmental Enforcement (BSEE) needs Data Science as follows: Data Mining of its Public Web Site; Data Mining of its Private Intranet Content; and Transformation to Data Gathering with Advanced Big Data Sensors and Big Data Processing and Visualization for Real Time Decision Support. The purpose of this pilot is to show how those objectives could be accomplished. 2

DoI BSEE: Web Site Map 3 My Note: 48 Topics

DoI BSEE: MindTouch Research Notes Found Site Map: Copied to MindTouch and Added Structured Headings: Can Go Down 5 Levels Assumes Site Map Includes Everything Public-See Below Populate the Site Map Starting from the Bottom to the Top Identify and Convert PDF to Text-Most But Not All Preserve Images: Done (22 so far) Insert Images: Not Done Yet First Discovery: There are topics (19) to be Mined in the Drop Down Menus that are not in the Site Map and Sidebars. Knowledge Base Index in Excel Spreadsheet with Other Tables: In ProcessExcel Spreadsheet Spreadsheet in Spotfire for Content Analytics and Discovery: In Process MORE TO FOLLOW 4

DoI BSEE: MindTouch Knowledge Base Site Map Semantic CommunitySemantic Community Data Science Data Science for DoI BSEEData ScienceData Science for DoI BSEE 5 My Note: So Far, 231 Topics, So More Structured. Also Extract Tables to Spreadsheet.

DoI BSEE: MindTouch Knowledge Base to Excel Spreadsheet 6 Incident Statistics and Summaries

DoI BSEE: Web Site Drop Down Menus First Discovery: There are topics to be Mined in the Drop Down Menus that are not in the Site Map and Sidebars. 7 My Note: Only 42 Topics

DoI BSEE: MindTouch Knowledge Base Vertical Map 8 Vertical Map My Note: Those Topics (19) with URLs Need to Added to the Knowledge Base

DoI BSEE: Excel Spreadsheet Knowledge Base 9 Excel Spreadsheet My Note: In Process

DoI BSEE: Excel Spreadsheet Data Dictionary 10

DoI BSEE: Excel Spreadsheet Speeches & Presentations as Linked Data 11

DoI BSEE: Spotfire Knowledge Base Cover Page Find 12

DoI BSEE: Spotfire Knowledge Base OCS Incidents & Spills 13

DoI BSEE: Spotfire Knowledge Base Safety Alerts 14

DoI BSEE: Spotfire Knowledge Base Communications 15

DoI BSEE: Spotfire Knowledge Base Master Lists of Projects 16

DoI BSEE: Spotfire Knowledge Base Investigations 17

DoI BSEE: Spotfire Knowledge Base General Information 18

DoI BSEE: Spotfire Knowledge Base Incident Commons 19

Conclusions and Recommendations The Department of the Interior Bureau of Safety and Environmental Enforcement (BSEE) needs Data Science to Use Advanced Big Data Sensors and Big Data Processing and Visualization for Real Time Decision Support. DoI BSEE Web Site Map and Vertical Drop Down Menus Were Data Mined Into a MindTouch Wiki, Excel Spreadsheets, and Spotfire Content Analytics and Visualizations for a Pilot Demo. One Can Do Semantic Searching to Find “Needles in a Haystack” and Create New Relationships in the Knowledge Base. The Result is a Data Science Data Publication That Can Continue to Expand as One Explores the Scope and Depth of the DoI BSEE Content. 20