Sensing Our Air: The Quest for Big Data About Our Air Quality and Data Science for EPA EnviroAtlas 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for EPA EnviroAtlas Data Science for EPA Big Data Analytics October 19, 2015
Agenda Get Another Preview of National Data Science Organizers Workshop on November 5-6, 2015, and the Focus on National Data Science Challenges and Hackathons 6:30 p.m. Welcome and Introduction Slides Data Science for EPA EnviroAtlas Part II. Also see Earth Insights from Big Data 6:45 p.m. Invited Presentation EPA Staff: Robin Thottungal (invited) 7:15 p.m. Brief Member Introductions 7:30 p.m. Invited Presentation EPA Staff (continued):EPA Engineer Dr. Gayle Hagler 8:15 p.m. Open Discussion 8:45 p.m. Networking 9:00 p.m. Depart http://www.meetup.com/Federal-Big-Data-Working-Group/events/223605766/
New EPA Chief Data Scientist Robin Thottungal (invited) will be joining as the division director for the Environmental Analysis Division (EAD) within the Office of Information Analysis and Access, and as the chief data scientist. An email from EPA CIO Ann Dunkin, which Federal News Radio obtained, said Thottungal starts later this month after spending most of his career in the private sector. Most recently, Thottungal worked at Deloitte Consulting where he focused on large scale analytics projects for public sector and commercial clients. He also led the global big data community of practice for Deloitte, developing analytical frameworks and go-to market strategy for big data and analytics solutions. Additionally, Thottungal is the vice-chairman for the Institute of Electrical and Electronics Engineers (IEEE) Washington D.C. section as well as the chapter chairman for IEEE Computational and Intelligence society.
Rescheduled From June 29th Meet EPA Engineer Gayle Hagler, Ph.D. http://www2.epa.gov/sciencematters/meet-epa-engineer-gayle-hagler-phd Q & A from EPA Presentation: Sensor Technology State of the Science July 8, 2014 http://www.epa.gov/heasd/airsensortoolbox/sensortechnology_qa.html Air Sensors 2014 https://sites.google.com/site/airsensors2014/agenda Welcome to the Village Green Project: a research effort to discover new ways of measuring air quality and weather conditions in community environments http://villagegreen.airnowtech.org/welcome
Semantic Community Data Science Earth Insights from Big Data Data Science for Conservation International's Big Ecosystem Data Conservation International and HP Vertica teamed for an excellent online presentation (see Slides below) on the deluge of data from the Tropical Ecology Assessment and Monitoring (TEAM) Network. The TEAM is described in a Vimeo video (see 23:52 - 26:18). The presentation also includes a reference (at 16:41).to an article on The Popularity of Data Analysis Software.
Overview Previous: Present: EPA Data Science Products (while at EPA circa 2008-2010) EPA/NASA Climate-Environmental Data Analytics & A Redesigned, Open Data.gov Meetup (May 6, 2014) Data Science for EPA EnviroAtlas (June 6, 2014) Data Science for EPA Big Data Analytics (April 17, 2015) President's Chief Data Scientist and EPA Big Data Analytics Meetup (April 20, 2015) Uncovering Hydraulic Fracturing Trends and Data with TIBCO Spotfire (September 1, 2015) Sensing Our Air: The Quest for Big Data About Our Air Quality (October 19, 2015) Present: Translating Big Data into Big Climate Ideas (April 2015) Joan Aron Comments and Questions
Translating Big Data into Big Climate Ideas By Brian R. Pickard (U.S. EPA, Landscape Ecology Division), Jeremy Baynes (Contributor), Megan Mehaffey (Contributor), Anne C. Neale (Contributor), Solutions Vol. 6, Issue 1, April 2015. In Brief: Climate change has emerged as the significant environmental challenge of the 21st century. Therefore, understanding our changing world has forced researchers from many different fields of science to join together to tackle complicated research questions. The climate change research community now faces the daunting task of disseminating massive amounts of information about possible future climates under differing scenarios to a broad audience. They also need to make the data readily accessible so that it can be used by scientists in other research fields. One potential solution for distribution and communication of the climate scenario information may be through the EnviroAtlas, a new geospatial application developed by the United States Environmental Protection Agency and its partners. This interactive mapping tool allows users to access and explore climate change modeling information in easily understandable formats while providing a range of information on different ecosystem goods and services, or the benefits people receive from nature. By incorporating future scenarios such as land use and climate change within EnviroAtlas, we can evaluate specific components of complex ecosystems within the context of forecasted futures. Linking climate change impacts to ecosystem services, such as clean air and water, allows for opportunities to demonstrate how climate change will impact ecosystems, societies, and human health. http://www.thesolutionsjournal.org/node/237304
Joan Aron Comments and Suggestions 1 I just sent EnviroAtlas a question about finding the climate data discussed in that Solutions article. I could not find climate data. According to the Solutions article, NASA provided climate data to use EnviroAtlas as a platform for disseminating climate data for ecological applications. I'm trying to build on that platform to leverage the NASA and EPA investment for water quality decision-making related to ecosystem function. It would also be nice to connect to other applications like your Precision Farming work. If we can link your agricultural info to EnviroAtlas, that could be interesting since agricultural runoff contributes a lot of pollution and is a focus for pollution control. The characterization of agriculture is also important since USDA covers crops, forests, ranching and CAFOs.
Response from Anne Neale, EnviroAtlas Project Lead, US EPA, RTP, NC Many apologies that you were not able to find the data we described. We are sorry and embarrassed that the data are not available as promised in the article. When we published the article, we felt sure that we would have the data available by the time the article was published. We ran into some unforeseen complications and although we have all the data and software available on our development server, we have not been able to push that to our public facing site yet. We anticipate that the issue will be resolved soon and we can let you know as soon as the data are accessible. On July 22, 2015, the EnviroAtlas team will be hosting an informational meeting in downtown Portland, OR to showcase newly available data. Register here to join us! http://enviroatlas.epa.gov/enviroatlas/Status/index.html
http://enviroatlas.epa.gov/enviroatlas/Datadownload/index.html
Disclaimer 1 The data for this download Esri File GeoDataBase (FGDB) contains many data tables and feature classes. Varying numbers of attributes within each data table were used to map the layers in the EnviroAtlas Interactive Map. We encourage users to evaluate the associated metadata for the tables and feature classes through the EnviroAtlas Interactive Map, the XML files included in this zip file, or the EPA’s Environmental Dataset Gateway (EDG). EnviroAtlas is an interactive web-based decision support tool designed to provide information about ecosystems and the benefits people receive from those ecosystems. This application represents the first peer-reviewed public release. EnviroAtlas will continue to evolve over the coming years with periodic public releases. We welcome and request your feedback on all aspects of the website and tools.
Disclaimer 2 EnviroAtlas is designed for use by government, professional, academic, and community users, as well as members of the public. EnviroAtlas does not require special software, technical expertise, or a scientific background. However, it is the responsibility of the user to read and evaluate dataset limitations, restrictions, and intended use. To the best of our knowledge, the data and information on this website are accurate, but no warranty expressed or implied is made regarding the accuracy or utility of the data for general or scientific purposes, nor shall the act of distribution constitute any such warranty. All modeled geographic data are, by their nature, imperfect and the data provided in this Atlas should not be taken as absolute truth but as the best approximation of that truth based on best available data. For site-specific data, EnviroAtlas data will not replace "boots-on-the-ground measurements" or local knowledge. Neither EPA, EPA contractors, nor any other organizations cooperating with EPA assume any responsibility for damages or other liabilities related to the accuracy, availability, use, or misuse of the information provided on this website. EPA reserves the right to change information at any time without public notice. Any errors or omissions should be reported to the EnviroAtlas Team. We are always happy to hear your feedback and use that feedback for future enhancements. I understand and agree to the terms and conditions of this disclaimer.
National: 34 Files 29.8 MB
The crop acres without pollinator habitat data was developed using the USDA National Agriculture Statistical Service Crop Land Data (http://www.nass.usda.gov/research/cropland/SARS1a.htm)merged with the National Landcover Data 2006 dataset (http://www.mrlc.gov/nlcd2006_data.php). The maximum pollinator flight distance was set based on literature (see J.H. Cane's article 2001 in Ecology and Society "Habitat Fragmentation and Native Bees: a Premature Verdict?"), which set average home range radius of pollinators at 2.8 km. Euclidean distance from each crop pixel was used to select those without nearby habitat then summed by 12 digit HUC.A comprehensive list of metric creation steps is included in the Processing Steps.
Portland: 22 Files 656 MB
Semantic Community Data Science Data Science for EPA EnviroAtlas ADD NEW SLIDES AND GDB and METADATA FILE INVENTORY
Joan Aron Comments and Suggestions 2 I need to have more metadata to understand the net flux of pollutants leaving agricultural fields and the locations where the flux applies. There may be multiple sources of data in the same watershed. I am especially interested in three geographical areas for the examples: Around Coos (Oregon) HUC 17100304 - Tenmile Lakes should be nearby Around Lower Maumee (Ohio) HUC 04100009 - Maumee watershed produces flux of nutrients to Lake Erie at Toledo Around Tensas (Louisiana) HUC 08050003 - near Mississippi River
Response I think I found the best watershed and pollution data: http://nugis.ipni.net/About%20NuGIS/ that I am working with for my precision ag online course. NuGIS is all counties, all watersheds, and all HUC8, but the data is not complete for all parameters.
Coos, Oregon
Oregon
Agenda Get Another Preview of National Data Science Organizers Workshop on November 5-6, 2015, and the Focus on National Data Science Challenges and Hackathons 6:30 p.m. Welcome and Introduction Slides Data Science for EPA EnviroAtlas Part II. Also see Earth Insights from Big Data 6:45 p.m. Invited Presentation EPA Staff: Robin Thottungal (invited) 7:15 p.m. Brief Member Introductions 7:30 p.m. Invited Presentation EPA Staff (continued):EPA Engineer Dr. Gayle Hagler 8:15 p.m. Open Discussion 8:45 p.m. Networking 9:00 p.m. Depart http://www.meetup.com/Federal-Big-Data-Working-Group/events/223605766/