EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Slides:

Advertisements

Similar presentations

Federal Transparency.gov As Data For the Digital Government Strategy Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Advertisements

Data Science for Natural Medicines: Dead Doctors Don't Lie Radio

Data Science for Business: Semantic Verses Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Data Science for Tackling the Challenges of Big Data

Director and Senior Data Scientist/Data Journalist

Who Tweets the most about Gov20? Dr. Brand Niemann Director and Senior Data Scientist Semantic Community July 5,

Data Act at US Department of Treasury Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Title: Build EPA Apps in the Cloud Dr. Brand Niemann Former US EPA Senior Enterprise Architect and Data Scientist Current Binary Group Senior Enterprise.

A Search for Veterans Benefits Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community December 22,

Data Science for MyFamilySearch.org Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community My Personal Family History.

EPA Big Data Analytics: EnviroAtlas Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

My FamilySearch.org Tutorial Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community My Personal Family History Dashboard.

OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi

Semantic Data Discovery: Proof of Concept for DHS

Linked Data Visualizations for Eurostat Linked Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

A TEDMED Data Reveal: Big and Little Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government.

Imagine Everything is Before You: Past, Present, and Future Paper and Demonstration for the 2014 Family History Technology BYU Dr. Brand Niemann.

A Spotfire Demo Gallery with Data Science Dr. Brand Niemann Director and Senior Data Scientist Semantic Community November 13, 2011 DRAFT 1.

Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

GIS Data Science for Collaboration Across Communities: GIScience 2.0 and Beyond Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.

Xperience 2013 Be Informed 4.2 Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.

Data Science Publication for NSF Polar Cyberinfrastructure Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.

EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.

Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect.

Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.

Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

1 Semanticommunity.info Tutorial Brand Niemann December 7, 2010.

Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.

Data Science ESIP Publication Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.

Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.

Why Doesn't EPA Have a Self- Contained Statistical Unit?: A Tribute to Doug Engelbart Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.

Data Science for USDA Big Data

Data Science for EPA Big Data Analytics: Oregon Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

Data Science for Migration Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.

Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

An Internet of Things: People, Processes, and Products in the Spotfire Cloud Library Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist.

Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Harnessing Data to Address Diabetes in the US Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL.

Data Science for HealthCare.gov Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Data Driven Farming: Week 6: Deployment Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Week 6 Deployment.

OVERVIEW OF OIL & GAS EXPLORATION, DEVELOPMENT and STATE REGULATION OVERVIEW OF OIL & GAS EXPLORATION, DEVELOPMENT and STATE REGULATION February 18, 2012.

Data Science for Semantics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Semantics.

Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.

Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.

Data Science for Joint Doctrine Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Joint.

Data Science for FDA RFI Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for Conservation International's Big Ecosystem Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.

NGA Demo Participant Collaboration Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community

NIEM 3.0 Data Analytics App Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government Blogger.

AOGCC Proposed Regulations regarding Hydraulic Fracturing April 4, 2013 Kara Moriarty, Executive Director.

Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for EarthCube 2015 Key Documents Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for Homeless Data: Tableau Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.

HealthIT.gov Dashboard: Spotfire not Flash Dr. Brand Niemann Director and Senior Data Scientist Semantic Community

Hydraulic Fracturing (Fracking)

Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community

FracFocus- THE National Hydraulic Fracturing Disclosure Registry TCEQ Environmental Trade Fair May 6, 2016.

Spotfire 5 Users Guide Dashboard

Title: Build EPA Apps in the Cloud

Presentation transcript:

EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community April 17,

Announcement The EPA released its peer-reviewed analysis of over two years of data from the FracFocus Chemical Disclosure Registry 1.0. FracFocus is a publicly accessible website, managed by the Ground Water Protection Council (GWPC) and Interstate Oil and Gas Compact Commission, where oil and gas production well operators can disclose information about ingredients used in hydraulic fracturing fluids at individual wells. In March 2015: U.S. Department of the Interior Releases Final Rule to Support Safe, Responsible Hydraulic Fracturing Activities on Public and Tribal Lands. See Press release and Final rule.Press releaseFinal rule 2

EPA's Study of Hydraulic Fracturing for Oil and Gas and Its Potential Impact on Drinking Water Resources At the request of Congress, EPA is conducting a study to better understand any potential impacts of hydraulic fracturing for oil and gas on drinking water resources. The scope of the research includes the full lifespan of water in hydraulic fracturing. EPA's study will look at potential impacts of hydraulic fracturing at each stage of the Hydraulic Fracturing Water Cycle. 3

The Hydraulic Fracturing Water Cycle 4

Data Mining for Data Science Analysis of Hydraulic Fracturing Fluid Data from the FracFocus Chemical Disclosure Registry See Attachments below – Four xlsx files totaling 23 MB Data Management and Quality Assessment Report - See Attachments below – 2 MB PDF and 96 MB ZIP file with Access Database and PDF documentation Project database developed from FracFocus 1.0 disclosures – Same as second item above Selected data tables from the analysis of FracFocus 1.0 – Same as first item above State-level Summaries of FracFocus 1.0 Hydraulic Fracturing Data - See Attachments below – 7 MB PDF Guide and 22 PDF files EPA Analysis of FracFocus Data Fact Sheet - See Attachments below – MB PDF EPA Webinar: Analysis of FracFocus Data - See Slides below – 2 MB PDF 5

Data Science for EPA Fracturing Data: MindTouch Knowledge Base 6 Data Science for EPA Big Data AnalyticsData Science for EPA Big Data Analytics and EPA Fracturing DataEPA Fracturing Data

Data Mining Files and Attachments 7 My Note: See Attachments at Bottom of MindTouch Page PDF to MindTouch to Excel and Excel (Access)to Spotfire

Data Science for EPA Fracturing Data: MindTouch Knowledge Base Find 8 My Note: Use Google Chrome Find For Map Boundary Files Data Science for EPA Big Data AnalyticsData Science for EPA Big Data Analytics and EPA Fracturing DataEPA Fracturing Data

Data Science for EPA Fracturing Data: Spreadsheet Knowledge Base 9 EPABigDataAnalytics.xlsx

Data Science for EPA Fracturing Data: Spotfire Cover Page 10 Web Player

Data Science for EPA Fracturing Data: Spotfire Data Management Tables 11 Web Player

Data Science for EPA Fracturing Data: Spotfire Oil & Gas by County 12 Web Player

Data Science for EPA Fracturing Data: Spotfire Oil & Gas by Well by County 13 Web Player

Data Science for EPA Fracturing Data: Spotfire Disclosures by County 14 Web Player

Data Science for EPA Fracturing Data: Spotfire Ingredients by County 15 Web Player

Conclusions and Recommendations At the request of Congress, EPA is Studying Hydraulic Fracturing for Oil and Gas and Its Potential Impact on Drinking Water Resources at Each Stage of the Hydraulic Fracturing Water Cycle. In March 2015: U.S. Department of the Interior Released the Final Rule to Support Safe, Responsible Hydraulic Fracturing Activities on Public and Tribal Lands. This Rule was based on EPA peer-reviewed analysis of over two years of data from the FracFocus Chemical Disclosure Registry 1.0. EPA is Planning to Stand Up a Big Data Analytics Service and this Data Science for EPA Fracturing Data is an Example of EPA Big Data Analytics. This Data Science Data Product and Publication Includes a Knowledge Base in MindTouch, Excel, and Spotfire and Analytics and Visualizations in Spotfire. Additional Data Science Products and Publications Can be Done on More FracFocus PDF Files and the Access Database and Other EPA Projects. 16