Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.

Slides:



Advertisements
Similar presentations
Data Science for Tackling the Challenges of Big Data
Advertisements

Data Act at US Department of Treasury Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for NSF Polar Cyberinfrastructure & MIT Big Data Course Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
NOAA Science Advisory Board The U.S. Climate Change Science Program Strategic Plan James R. Mahoney, Ph.D. Assistant Secretary of Commerce for Oceans and.
EarthCube Data Science Publications Dr. Joan Aron Dr. Sophia Liu Dr. Brand Niemann May 29, 2015
Data Science for Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
EPA Big Data Analytics: EnviroAtlas Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
My FamilySearch.org Tutorial Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community My Personal Family History Dashboard.
RDA Europe & National initiatives HILARY HANAHOE, TRUST-IT SERVICES, RDA SECRETARIAT & RDA EUROPE PROJECT COORDINATOR -
NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Federal Big Data Working Group Meetup Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Semantic Data Discovery: Proof of Concept for DHS
Transforming Data-Driven Publications and Decision Support Joan L. Aron, Ph.D. Consultant Federal Big Data Working Group COM.BigData 2014.
Data Science for USGS Minerals Big Data Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data.
A TEDMED Data Reveal: Big and Little Dr. Brand Niemann Director and Senior Data Scientist Semantic Community AOL Government.
Imagine Everything is Before You: Past, Present, and Future Paper and Demonstration for the 2014 Family History Technology BYU Dr. Brand Niemann.
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
GIS Data Science for Collaboration Across Communities: GIScience 2.0 and Beyond Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Data Science Publication for NSF Polar Cyberinfrastructure Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Big Data Symposium: Analytics and Applications for Federal Big Data – Bureau of Justice Statistics Dr. Brand Niemann Director and Senior Enterprise Architect.
Big Data Symposium: Analytics and Applications for Federal Big Data - FEMA Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for International Data Week 2016: Concept Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science.
Director and Senior Data Scientist/Data Journalist
Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.
Data Science ESIP Publication Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Data Science for USDA Big Data
Data Science for HealthData.gov Developers & Family Caregivers Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
Data Science for EPA Big Data Analytics: Oregon Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
U.S. Department of the Interior U.S. Geological Survey A vision for a global community Linda Gundersen Director Science Quality and Integrity US Geological.
Data Science for the National Big Data R and D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Open DATA METI: All Content As Big Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for Migration Data Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
SmartGrid and Spotfire Cloud Computing - Similarities in Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
FY13 Accomplishments 1 Update to the Board of Research Data on Information CENDI INCREASING THE IMPACT OF FEDERALLY FUNDED SCIENCE September 23, 2013 Jerry.
National Institute of Standards and Technology Information Technology Laboratory 1 USG Cloud Computing Technology Roadmap Next Steps NIST Mission: To promote.
Data Science for NSF Data Science Workshop 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science NSF.
Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Driven Farming: Week 6: Deployment Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Week 6 Deployment.
Data Science for Semantics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Semantics.
Department of Commerce App Challenge: Big Data Dashboards Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community.
Data Science for Joint Doctrine Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Joint.
Data Science for Conservation International's Big Ecosystem Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
1 Social Business Intelligence from Open Government Data Brand Niemann Senior Enterprise Architect US EPA November 27, 2010 DISCLAIMER: While allowed to.
Government Technology & Innovation Incubator for Big Data Analytics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Defense Strategies Institute Professional Educational Forum Harnessing the Power of Big Data for The Intelligence Community November 17-18, 2015 Mary M.
Climate Change & Genomic Data - Data Science Meetup of Meetups Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
Midwest Big Data Hub Edward Seidel Director, NCSA Founder Prof. of Physics, Prof of Astronomy On behalf of the Midwest Big Data Hub 1 Brian Athey Sarah.
Towards an European Network of Earth Observation Networks (ENEON): Addressing Challenges and Facilitating Collaboration for non-space based Earth Observations.
Data Science for EarthCube 2015 Key Documents Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Fire Emissions Network Sept. 4, 2002 A white paper for the development of a NSF Digital Government Program proposal Stefan Falke Washington University.
Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
National Data Science Organizers Lightning Talks From Around the Country Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup.
HealthIT.gov Dashboard: Spotfire not Flash Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for UN, HDX, OSTP, RDA, etc. July 15 th : Data Science for RDA Climate Change Data Challenge and Meetup Goals: Goal 1: Digital Catalog.
USDA Big Data Science for Precision Farming With FarmLogs
South Big Data Innovation Hub
Data Science for RDA Climate Change Data Challenge and Meetup
First Meetup: Data Science for the Data Act at Treasury
Research Data Alliance/US Briefing for the OA
Presentation transcript:

Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for RDA Climate Change Data Challenge July 15,

Announcements The 6th Plenary RDA hosted in Paris from September 2015, features a special focus on research data for climate change, leveraging on the UN Climate Change Conference (COP21) to be held in Paris in December As a part of this special focus Cap Digital & RDA have created a special Data Challenge designed to connect Climate Change related Data Sets with startups, SMEs and larger organizations with practical application for these data. Please join the NITRD FASTER Community of Practice on July 15, 2015, for an informative presentation and discussion with Dr. Francine Berman, Chair, RDA/US and Edward P. Hamilton Distinguished Professor of Computer Science, Rensselaer Polytechnic Institute. Dr. Fran Berman will describe the Research Data Alliance (RDA) and its community, and give a look ahead at future directions for the RDA. In 2013, the Research Data Alliance (RDA) was formed to build and adopt infrastructure that accelerates data sharing world-wide. Two years later, the organization has attracted nearly 3000 members from over 100 countries and all sectors. The precipitous growth and enthusiasm for the RDA emphasizes the global need for data infrastructure and coordination, and indicates the community’s high expectations that RDA has the potential to meet those needs. 2 See slides and bookletslidesbooklet

3

4

5 Data Science for RDA Climate Change Data Challenge Goals: Goal 1: Digital Catalog Goal 2: Data Audit Goal 3: Individual Data Sets in Spotfire Goal 4: Integration/Applications Goal 5: Meetups/Data Science Publication/MOOCs

6 SpreadsheetSpreadsheet: Digital Catalog

7 Web PlayerWeb Player: Goal 1 Digital Catalog

8 SpreadsheetSpreadsheet: Data Audit

9 Web PlayerWeb Player: Goal 2 Data Audit 1.I could not readily find the actual data sets for 18 of the 64 data sets. 2.The URL for the very important DOE Buildings Data Book does not work (I think this is being revised or removed permanently) of the remaining USCDINASA 40 data sets come from the National Transportation Atlas Database. Why not use all 36 as a more authoritative and consistent data set? 4.Why was a contractor brought in to manage the White House Climate Data Initiative and is now a private consultant on climate data (Climate Data Solutions LLC), listed as the contact person 5.The obvious other data that can be used is the 557 data sets at Data.gov/Climate and the data sets in the President’s National Climate Assessment, which many others and our Meetup have already worked with. 6.I could not find the 3 data sets from Cap Digital (numbers 22-24), the sponsoring organization, and their web site Cannot Be Translated into English.

10 Web PlayerWeb Player: Goal 3 Individual Data Sets in Spotfire Example Data Set 64: USGS Small-scale Dataset - Railroad and Bus Passenger Stations of the United States Shapefile

11

12 SpreadsheetSpreadsheet: National Transportation Atlas Database

13 Data Science for the National Transportation Atlas Database: Inventory Amtrak Stations (ZIP - 69KB) Border Crossing Ports (ZIP - 24KB) Data of dams 50 feet or more in height (ZIP - 799KB) Railroad Grade Crossings (ZIP MB) My Note: Two Shape Files Travel Monitoring Analysis System (ZIP - 1.1MB) Freight Analysis Framework, version 3.4 (ZIP MB) Hazardous Material Routes (ZIP - 8.9MB) Highway Performance Monitoring System (ZIP - 795MB) My Note: Problem Reading Shape File-Contacted BTS National Highway Planning Network (ZIP MB) Railway Network (ZIP MB) Web PlayerWeb Player: : Goal 3 Individual Data Sets in Spotfire-NTAD Inventory

14 Web PlayerWeb Player: Goal 3 Individual Data Sets in Spotfire-NTDA-Amtrak Stations

15

Conclusions and Recommendations Dr. Renata Rawlings-Goss, Big Data AAAS Fellows at NSF:Big Data AAAS Fellows at NSF I am working with OSTP to coordinate a grassroots data science Meetup organizers meeting this fall (November 6-7, 2015). We have currently coordinated conference calls with large data science meetups ( ,000 members) around the country. I think it would be particularly fruitful to have future discussion with you about the role of Federal Big Data Working Group. Your work sounds very connected to what we are thinking of for meetup groups. My Suggestions: Involve the NSF Data Science / Big Data Community in the NSF EarthCube Community. Data Communities need to collaborate with Data Scientists (e.g., our EarthCube Data Science Publications).EarthCube Data Science Publications Have the largest Data Science meetups mine our Meetup content for government data sources (our GitHub and Data Hub), government data problems to work on, and partner with government agencies to co-host Meetups (e.g., our USDA Data Science MOOC).USDA Data Science MOOC Participate in our new collaboration with RDA on Data Science for RDA Climate Change Data Challenge and our Federal Big Data Working Group Meetups!Data Science for RDA Climate Change Data ChallengeFederal Big Data Working Group Meetups 16