Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.

Slides:

Advertisements

Similar presentations

Data Science for Natural Medicines: Dead Doctors Don't Lie Radio

Advertisements

OMB Data Visualization Tool Requirements Analysis: Information Builders Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Data Science for Business: Semantic Verses Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Data Science for Tackling the Challenges of Big Data

Director and Senior Data Scientist/Data Journalist

A Search for Veterans Benefits Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community December 22,

Data Science for MyFamilySearch.org Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community My Personal Family History.

EPA Big Data Analytics: EnviroAtlas Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

U.S. Department of the Interior U.S. Geological Survey U.S. Department of the Interior U.S. Geological Survey Natural Hazards Science – Reducing the World’s.

OMB Data Visualization Tool Requirements Analysis: Logi Analytics Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

My FamilySearch.org Tutorial Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community My Personal Family History Dashboard.

OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi

EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Semantic Data Discovery: Proof of Concept for DHS

Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

3 Round Stones: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

Data Science for USGS Minerals Big Data Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data.

Imagine Everything is Before You: Past, Present, and Future Paper and Demonstration for the 2014 Family History Technology BYU Dr. Brand Niemann.

A Spotfire Demo Gallery with Data Science Dr. Brand Niemann Director and Senior Data Scientist Semantic Community November 13, 2011 DRAFT 1.

U.S. Department of the Interior U.S. Geological Survey U.S. Department of the Interior U.S. Geological Survey British Geological Survey 175th Anniversary.

Semantic Knowledge Bases and Be Informed for the FAA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

GIS Data Science for Collaboration Across Communities: GIScience 2.0 and Beyond Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.

Data Science Publication for NSF Polar Cyberinfrastructure Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.

EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.

Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect.

Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.

Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

Data Science for Energy Outlook 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.

1 Data Integration Community of Practice Meeting September 15, 2009 Science Data Integration.

Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.

Data Science ESIP Publication Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.

Why Doesn't EPA Have a Self- Contained Statistical Unit?: A Tribute to Doug Engelbart Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.

Data Science for USDA Big Data

Data Science for EPA Big Data Analytics: Oregon Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

Data Science for Migration Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Health Datapalooza IV: Child and Adolescent Health Data App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.

Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Harnessing Data to Address Diabetes in the US Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL.

Data Science for HealthCare.gov Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Data Driven Farming: Week 6: Deployment Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Week 6 Deployment.

Data Science for Semantics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Semantics.

Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.

Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.

Data Science for Joint Doctrine Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Joint.

Data Science for FDA RFI Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for Conservation International's Big Ecosystem Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.

NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.

Ecosystems  Climate  Energy and Minerals  Natural Hazards  Environment and Human Health  Water U.S. Department of the Interior U.S. Geological.

Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for EarthCube 2015 Key Documents Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for Homeless Data: Tableau Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.

National Data Science Organizers Lightning Talks From Around the Country Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup.

Facing Tomorrow’s Challenges USGS Natural Hazards Science in the Coming Decade Facing Tomorrow’s Challenges USGS Natural Hazards Science in the Coming.

HealthIT.gov Dashboard: Spotfire not Flash Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

U.S. Department of the Interior U.S. Geological Survey Reston, VA July 20, 2012 U.S. Geological Survey (USGS) Organizational Overview.

Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Spotfire 5 Users Guide Dashboard

Presentation transcript:

Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for USGS Minerals Big Data June 15,

Evolution at the USGS Years ago when I served a detail to the USGS, they were organized into the following divisions: – Geology – Water – Biology – Mapping Now they are organized into the following: – Ecosystems – Climate and Land-Use Change – Natural Hazards – Water – Energy and Minerals, and Environmental Health – Core Science Systems with a focus on Start with Science.Start with Science 2

USGS Mineral Resources Program (MRP) The USGS Mineral Resources Program (MRP) provides scientific information for objective resource assessments and unbiased research results on mineral potential, production, consumption, and environmental effects. The MRP is the sole Federal source for this information. 3

USGS Commodity Statistics and Information 4 Statistics and information on the worldwide supply of, demand for, and flow of minerals and materials essential to the U.S. economy, the national security, and protection of the environment.

Adobe Acrobat Convert From PDF Tool 5

Adobe Acrobat Convert From PDF to Excel 6 My Note: This did not work!

Mineral Resources On-Line Spatial Data: National Geochemical Survey Database 7

Mineral Resources On-Line Spatial Data: Mineral Resources Data System (MRDS) 8 This is “Big Data”

Data Science for USGS Minerals Big Data: MindTouch Knowledge Base Index 9 Data Science for USGS Minerals Big Data My Note: See well-defined URLs in Excel Spreadsheet.

Data Science for USGS Minerals Big Data: MindTouch Knowledge Base Attachments 10 Data Science for USGS Minerals Big Data

Data Science for USGS Minerals Big Data: MindTouch Knowledge Base Find 11 Google Chrome Find: Abrasive My Note: See highlighted hits and real tables! See tables in Excel in next slide! Data Science for USGS Minerals Big Data

Data Science for USGS Minerals Big Data: Excel Knowledge Base Find 12 USGSMinerals.xlsx

Data Science for USGS Minerals Big Data: Spotfire Cover Page 13 Web Player

Data Science for USGS Minerals Big Data: Minerals Commodity Summaries 2015 Tables in Spotfire 14 Web Player

Data Science for USGS Minerals Big Data: MRDS-shp in Spotfire 15 Web Player

Some Conclusions and Recommendations The USGS has evolved to Starting with Science so I started with Data Science for USGS Minerals Big Data. I data mined the USGS Mineral Resources Program (MRP), the USGS Commodity Statistics and Information, and the Mineral Resources On-Line Spatial Data. I converted PDF to MindTouch and Excel Knowledge Bases and used Spotfire for analytics and visualizations. The result is a Data Science Data Publication. The USGS has many more PDF publications and data sets that could be Data Science Data Publications. 16