Presentation is loading. Please wait.

Presentation is loading. Please wait.

Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.

Similar presentations


Presentation on theme: "Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE."— Presentation transcript:

1 Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE June 20, 2015 1

2 Overview The Department of the Interior Bureau of Safety and Environmental Enforcement (BSEE) needs Data Science as follows: Data Mining of its Public Web Site; Data Mining of its Private Intranet Content; and Transformation to Data Gathering with Advanced Big Data Sensors and Big Data Processing and Visualization for Real Time Decision Support. The purpose of this pilot is to show how those objectives could be accomplished. 2

3 DoI BSEE: Web Site Map http://www.bsee.gov/sitemap/ 3 My Note: 48 Topics

4 DoI BSEE: MindTouch Research Notes Found Site Map: http://www.bsee.gov/sitemap/http://www.bsee.gov/sitemap/ Copied to MindTouch and Added Structured Headings: Can Go Down 5 Levels Assumes Site Map Includes Everything Public-See Below Populate the Site Map Starting from the Bottom to the Top Identify and Convert PDF to Text-Most But Not All Preserve Images: Done (22 so far) Insert Images: Not Done Yet First Discovery: There are topics (19) to be Mined in the Drop Down Menus that are not in the Site Map and Sidebars. Knowledge Base Index in Excel Spreadsheet with Other Tables: In ProcessExcel Spreadsheet Spreadsheet in Spotfire for Content Analytics and Discovery: In Process MORE TO FOLLOW 4

5 DoI BSEE: MindTouch Knowledge Base Site Map Semantic CommunitySemantic Community Data Science Data Science for DoI BSEEData ScienceData Science for DoI BSEE 5 My Note: So Far, 231 Topics, So More Structured. Also Extract Tables to Spreadsheet.

6 DoI BSEE: MindTouch Knowledge Base to Excel Spreadsheet 6 Incident Statistics and Summaries

7 DoI BSEE: Web Site Drop Down Menus http://www.bsee.gov/ First Discovery: There are topics to be Mined in the Drop Down Menus that are not in the Site Map and Sidebars. 7 My Note: Only 42 Topics

8 DoI BSEE: MindTouch Knowledge Base Vertical Map 8 Vertical Map My Note: Those Topics (19) with URLs Need to Added to the Knowledge Base

9 DoI BSEE: Excel Spreadsheet Knowledge Base 9 Excel Spreadsheet My Note: In Process

10 DoI BSEE: Excel Spreadsheet Data Dictionary 10

11 DoI BSEE: Excel Spreadsheet Speeches & Presentations as Linked Data 11

12 DoI BSEE: Spotfire Knowledge Base Cover Page Find 12

13 DoI BSEE: Spotfire Knowledge Base OCS Incidents & Spills 13

14 DoI BSEE: Spotfire Knowledge Base Safety Alerts 14

15 DoI BSEE: Spotfire Knowledge Base Communications 15

16 DoI BSEE: Spotfire Knowledge Base Master Lists of Projects 16

17 DoI BSEE: Spotfire Knowledge Base Investigations 17

18 DoI BSEE: Spotfire Knowledge Base General Information 18

19 DoI BSEE: Spotfire Knowledge Base Incident Commons 19

20 Conclusions and Recommendations The Department of the Interior Bureau of Safety and Environmental Enforcement (BSEE) needs Data Science to Use Advanced Big Data Sensors and Big Data Processing and Visualization for Real Time Decision Support. DoI BSEE Web Site Map and Vertical Drop Down Menus Were Data Mined Into a MindTouch Wiki, Excel Spreadsheets, and Spotfire Content Analytics and Visualizations for a Pilot Demo. One Can Do Semantic Searching to Find “Needles in a Haystack” and Create New Relationships in the Knowledge Base. The Result is a Data Science Data Publication That Can Continue to Expand as One Explores the Scope and Depth of the DoI BSEE Content. 20


Download ppt "Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE."

Similar presentations


Ads by Google