Defense Strategies Institute Professional Educational Forum Harnessing the Power of Big Data for The Intelligence Community November 17-18, 2015 Mary M.

Slides:



Advertisements
Similar presentations
Data Science for NSF Polar Cyberinfrastructure & MIT Big Data Course Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
Advertisements

NOAA Science Advisory Board The U.S. Climate Change Science Program Strategic Plan James R. Mahoney, Ph.D. Assistant Secretary of Commerce for Oceans and.
EarthCube Data Science Publications Dr. Joan Aron Dr. Sophia Liu Dr. Brand Niemann May 29, 2015
Data Science for Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Build the Binary Group in the Cloud Brand Niemann Senior Enterprise Architect Binary Group August 5, Updated August 8,
Semantic Interoperability Community of Practice (SICoP) Semantic Web Applications for National Security Conference Hyatt Regency Crystal City, Regency.
Data Science for MyFamilySearch.org and FamilyTree DNA Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
OMB Data Visualization Tool Requirements Analysis: Microsoft Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
NLM-Semantic Medline Data Science Data Publication Commons Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Big Data and Social Media & Web Analytics Innovation Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Big Data Innovation: Semantic Analytics 14 th SOA for eGovernment Conference Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
NIST Scientific Data for Data Science United Nations Open Data / Open Government Conference, April 26-28, Abu Dhabi
Federal Big Data Working Group Meetup Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
EPA Big Data Analytics: Data Science for EPA Fracturing Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Semantic Data Discovery: Proof of Concept for DHS
Cloud: SOA, Semantics, & Data Science Welcome and Overview Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
OMB Data Visualization Tool Requirements Analysis: SAP Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
1 Semantic Cloud Computing & Open Linked Data Pattern Brand Niemann Invited Expert to the NCIOC SCOPE and Services WGs September 22, 2009.
Franca R. Jones Senior Policy Analyst Chemical and Biological Countermeasures National Security and International Affairs Remarks for the Interagency Board.
Data Science for USGS Minerals Big Data Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data.
Information Sharing Begins With Me Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for Agency Initiatives 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
1 Briefing for EPA and OEI Communications Coordinators and Press Officers Brand Niemann US EPA Senior Enterprise Architect and Federal CoP Leader January.
Data Science Publication for NSF Polar Cyberinfrastructure Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Using Data Science as Evidence in Public Policy With Big Data and Elections Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist.
EPA Indicators of Our Health and Environment Updated and Improved Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Federal Big Data Working Group Meetup: The Yosemite Project: A Roadmap for Healthcare Information Interoperability and The New Book: Building Ontologies.
Farm Data Dashboards: USDA and Microsoft Innovation Challenge Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Data Science for RDA Climate Change Data Challenge and Meetup Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Federal Big Data Working Group Meetup Dr. Brand Niemann Director and Senior Data Scientist Semantic Community
Data Science for International Data Week 2016: Concept Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science.
Data Science for DataBay DataBay "Reclaim the Bay" Innovation Challenge: August 1-3, 2014, Smithsonian Environmental Research Center, 647 Contees Wharf.
Data Science for USGS Minerals Big Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Data Science for EPA & USGS Fracturing & Fracking­­­­­ Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data.
Data Science for DTIC Data Ecosystem Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
The 2012 EuroStat Regional Yearbook for Semantic Interoperability Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic.
Why Doesn't EPA Have a Self- Contained Statistical Unit?: A Tribute to Doug Engelbart Dr. Brand Niemann Director and Senior Data Scientist Semantic Community.
Data Science for USDA Big Data
Data Science for HealthData.gov Developers & Family Caregivers Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
1 The Federal Shared Youth Vision Partnership A Federal Partnership between the Corporation for National community Service;
Data Science for the National Big Data R and D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
FY13 Accomplishments 1 Update to the Board of Research Data on Information CENDI INCREASING THE IMPACT OF FEDERALLY FUNDED SCIENCE September 23, 2013 Jerry.
Data Science for NSF Data Science Workshop 2015 Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science NSF.
Research on US Federal Government Handling of Data Dr. Brand Niemann Director and Senior Enterprise Architect – Data Scientist Semantic Community
Data Science for the NOAA Chief Data Officer Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
A Case Study for Effective Collaboration for Health St. Clair County, Illinois Mark Peters Director of Community Health St. Clair County Health Department.
Data Driven Farming: Week 6: Deployment Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Week 6 Deployment.
Data Science for Semantics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Semantics.
Data Science for DoI BSEE Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for DoI BSEE.
Data Science for Joint Doctrine Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science for Joint.
Emergency Management Training and Education System Protection and National Preparedness National Preparedness Directorate National Training and Education.
1 Tutorial for the EAWG: Solution Architecture for 2010 Brand Niemann Senior Enterprise Architect U.S. EPA January 28, 2010.
1 Social Business Intelligence from Open Government Data Brand Niemann Senior Enterprise Architect US EPA November 27, 2010 DISCLAIMER: While allowed to.
Government Technology & Innovation Incubator for Big Data Analytics Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
Data Science for NIST Big Data Framework Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Climate Change & Genomic Data - Data Science Meetup of Meetups Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community.
CENDI Update to the Board of Research Data and Information Bonnie C. Carroll Executive Director CENDI Secretariat.
Data Science for EarthCube 2015 Key Documents Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for Global Ebola Response Data Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community Data Science Data Science.
Earth Observation Summit 2003 NOAA Science Advisory Board Gregory W. Withee Assistant Administrator for Satellite and Information Services March 18, 2003.
National Data Science Organizers Lightning Talks From Around the Country Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup.
Semantic Interoperability for the Office of the National Coordinator for Health Information Technology Brand Niemann and the Health Information Technology.
Data Science and Semantic Insights for DoD Joint Doctrine Meetup Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup Director.
Expedition Workshop Strategic Leadership For Networking and Information Technology Education September 16, 2008 Chris Greer Director, NCO.
Data Science for the National Big Data R&D Initiative Dr. Brand Niemann Director and Senior Data Scientist/Data Journalist Semantic Community
Data Science for UN, HDX, OSTP, RDA, etc. July 15 th : Data Science for RDA Climate Change Data Challenge and Meetup Goals: Goal 1: Digital Catalog.
Data Science for RDA Climate Change Data Challenge and Meetup
First Meetup: Data Science for the Data Act at Treasury
Presentation transcript:

Defense Strategies Institute Professional Educational Forum Harnessing the Power of Big Data for The Intelligence Community November 17-18, 2015 Mary M. Gates Learning Center, Alexandria, VA National Priorities for Big Data Dr. Brand Niemann Founder and Co-Organizer Federal Big Data Working Group Meetup Director and Senior Data Scientist/Data Journalist Semantic Community Federal Big Data Working Group Meetup Data Science November 17,

Summary The White House Office of Science and Technology Policy (OSTP) and the National Science Foundation (NSF) convened a National Data Science Organizers Workshop, November 5-6,2015, to discuss: 1. Data Science for the Nation: National Priorities, Impacts of Big Data Science on National Priorities, and Using Meetups to Explore National Challenges, 2. Exposing Data; 3. Coordination and Support of Data Science Meetups; and 4: The National Priority Challenge. The results of this workshop will be summarized along with highlights from the Federal Big Data Working Group Meetup, for which the presenter is the Founder and Co- Organizer. Examples of what the Federal Big Data Working Group Meetup has done from present to provide big data science tutorials and Massive Open Online Courses (MOOCs), curated government datasets, and citizen science and crowdsourcing in support of the White House Open Science and Innovation: Of the People, By the People, For the People, as part of the President's 2013 Second Open Government National Action Plan. 2

3

Agenda Day 1: November 5, 2015: 12:00pm – 1:00pm Lunch with the Big Data Regional Innovation Hubs Leaders (limited seating) 2:00pm – 2:30pm Opening Keynote: What are the National Priorities? by Thomas Kalil 2:30pm – 3:30pm Session 1: Leadership Panel on Data Science Innovation and Collaboration 3:30pm – 5:00pm Grassroots Data Science Across the Nation with Lightning Talks 5:00pm – 5:15pm Support of grassroots data science, crowd sourcing, and challenges 6:00pm – 8:00pm PUBLIC: Data Drinks: National Data Community Happy Hour! Day 2: November 6, 2015: 8:00am – 10:00am Session 2: Exposing Data 10:30am – 11:30am Session 3: Coordination and Support of Data Science Meetups 12:30pm – 1:30pm Lunch Keynote: Data Science in the Government by D.J. Patil 1:30pm – 5:30pm Session 4: The National Priority Challenge 5:45pm – 6:00pm Closing Remarks 4

Speakers Thomas Kalil, Deputy Director for Policy for the White House Office of Science and Technology Policy and Senior Advisor for Science, Technology and Innovation for the National Economic Council Opening Keynote: What are the National Priorities? by Thomas Kalil Chaitan Baru, Senior Advisor for Data Science, National Science Foundation Session 3: Coordination and Support of Data Science Meetups Dr. D.J. Patil, U.S. Chief Data Scientist and Deputy Chief Technology Officer at the White House Office of Science and Technology Policy Lunch Keynote: Data Science in the Government by D.J. Patil 5

Purpose and Organizers National Data Science Organizers is a network of individuals who promote data science professionalism in their communities across the nation Applications of data science to address major economic or societal challenges Questions that meetups could explore The Obama Administration has already launched a series of initiatives related to Big Data and open data About The Organizers Institutional Support National Science Foundation University of Chicago Data Science for Social Good Steering Committee: Representatives from: District Data Labs, DC2, Big Data Utah, NSF, Boston Predictive Analytics, SF Data Mining, NIH/NLM/NCBI, University of Chicago, etc

Key Points Data science for the nation: Impacts of big data science on National priorities Data science for tackling the challenges of big data Developing people, processes, and products for the Federal Government Online Data Science Collaboration and Competition Kaggle DevPost (Formerly Challenge Post) 7

Because I am a Data Scientist and Data Journalist Who we are? What we do? Where we do it? When we do it? Why we do it? How we do it? Specific example: Data Science for the Map of Federal Crowdsourcing and Citizen Science Projects for the NDSO Challenge 8 Poynter: A Global Leader in Journalism: 6 questions that can help journalists find a focus, tell better stories6 questions that can help journalists find a focus, tell better stories

Who we are?: Definitions Federal: Supports the Federal Big Data Initiative, but not endorsed by the Federal Government or its Agencies; Big Data: Supports the Federal Digital Government Strategy which is "treating all content as data", so big data = all your content; Working Group: Data Science Teams composed of Federal Government and Non-Federal Government experts producing big data products; and Meetup: The world's largest network of local groups to revitalize local community and help people around the world self-organize like MOOCs (Massive Open On-line Courses) now endorsed by the White House 9

What we do?: October 19 th Meetup This Meetup was organized for: Robin Thottungal, Chief Data EPA, and Division Director, EAD, OIAA, OEI, Robin Thottungal Greg Godbout, Chief Technology Officer, Environmental Protection Agency, and former Executive Director and Co-Founder of 18F, and Greg Godbout Jay Benforado, Director, National Center for Environmental Innovation at EPA, and Co-Chair, Federal Community of Practice for Crowdsourcing and Citizen ScienceFederal Community of Practice for Crowdsourcing and Citizen Science for the National Data Science Organizers Workshop on November 5-6, 2015, as an example of:National Data Science Organizers Workshop data science for curated data sets, user-centric digital services focused on the interaction between government and the people and businesses it serves, and a Federal Community of Practice on Crowdsourcing and Citizen Science of Big Data that meets bi-monthly to share lessons learned and develop best practices for designing, implementing, and evaluating crowdsourcing and citizen science initiatives. 10 See Recording and Agenda:

Where we do it?: Locations Xcelerate Solutions 8405 Greensboro Dr., Suite 930, McLean 22102, VA National Science Foundation 4201 Wilson Blvd, Arlington, VA Eastern Foundry 2011 Crystal Drive, 4th Floor, Arlington 22202, VA Marriott Wardman Park 2600 Woodley Road NW, 20008, Washington, DC Conferences, Workshops, etc. 11

When we do it?: Meetup Calendar Schedule September 28 th, Climate Change & Genomic Data - Data Science Meetup of Meetups October 5th, Data Science for EPA & USGS Fracturing & Fracking Data (Dr. Sophia Liu, USGS and USGS Staff). See July 13 th Meetup: Data Science for USGS Minerals Big DataData Science for USGS Minerals Big Data October 19th, Sensing Our Air: The Quest for Big Data About Our Air Quality (EPA’s New Chief Data Scientist, Robin A Thottungal, Invited)Robin A Thottungal November 2 nd, Data Science for Random Forests: TIBCO Enterprise Runtime for R. See June 1 st Meetup: Data Science for Homeless Data: QlikView. Tableau, & Spotfire BakeoffData Science for Homeless Data: QlikView. Tableau, & Spotfire Bakeoff November 5-6 th, OSTP/NSF Data Science Meetup of Meetups, Ballston, VA November 16 th, Data Science for the DataAct Datathon December 7 th, Data Science for DoD Joint Doctrine January 4 th, 2016, Data Science for Semantics: MarkLogic and Cray Graph Appliance Update February 1st, 2016, Data Science for Census American Community Survey 12

Why we do it?: Use Federal Big Data Examples and Technology Federal Big Data Examples: White House Climate Change and Precision Medicine NIH Genomic EPA Air Quality USGS Water Quality Department of Commerce Census Treasury DataAct DoD Joint Doctrine Major Big Data Technologies: TIBCO Enterprise Runtime for R (TERR) MarkLogic Semantics Cray Graph Appliance 13

How we do it?: Like the NIH Data Commons FAIR Principles: Findable Accessible Interoperable Reusable Cloud: Data Software Results Federal Science Policy: OSTP Public Access to Scientific Data Memo (February 2013) New Program: Big-Data-to- Knowledge (2013) New Position: Associate Director of Data Science (2014) Digital Enterprise (2015): Data Commons Metadata Open APIs Digital Objects Containers A NIH – Semantic Medline Data Science Data Publication Commons 14

How we do it?: OSTP/NSF National Data Science Organizers Workshop Week of November 2 nd : NSF Data Science/Big Data Principal Investigators (About 300) NSF Data Hubs (4) Organizers of Largest Data Science/Big Data Meetups (About 65) Pipeline for Return on Investment: PIs put their data, tools and research results in the Data Hubs Data Hubs provide those data, tools, and research results to the world, but especially to the Data Science/Big Data Meetups Data Science/Big Data Meetups collaborate with PIs and Data Hubs to increase usage and feedback 15

How we do it?: We Already Do This! Semantic Community: Provides a Community Sandbox that is like a GitHub, Data Hub, Data Commons, etc. Metadata (MindTouch) Open APIs (MIndTouch) Digital Objects (MindTouch) Containers (Spotfire) Organize the Federal Big Data Working Group Meetup Support Agencies and Programs in Crowdsourcing Their Data Sets Mentor Data Scientists (Tutorials and MOOCs) and Entrepreneurs (Eastern Foundry) Federal Big Data Working Group Meetup: Federal: Supports the Federal Big Data Initiative, but not endorsed by the Federal Government or its Agencies; Big Data: Supports the Federal Digital Government Strategy which is "treating all content as data", so big data = all your content; Working Group: Data Science Teams composed of Federal Government and Non- Federal Government experts producing big data products; and Meetup: The world's largest network of local groups to revitalize local community and help people around the world self- organize like MOOCs (Massive Open On-line Classes) now embraced by the White House. 16

How we do it?: Data Mining - Science - Questions - Publication Process Data Mining Process: Business Understanding Data Understanding Data Preparation Modeling Evaluation Deployment Data Science Process: Data Preparation Data Ecosystem Data Story Data Science Questions: How was the data collected? Where is the data stored? What are the data results? and Why should we believe the data results? Data Science Data Publication: Knowledge Base Spreadsheet Index Web & PDF Tables to Spreadsheet Data Browser Dynamically Linked Adjacent Visualizations 17

How we do it?: Collaboration for Data Science Win-Wins USDA Open Government Data Training, Innovation Competition, and Online Course in Data-Driven Farming: _Farming_Business#Story _Farming_Business#Story Many Curated Government Data Sets and Data Science Products: Pick an Agency and/or a Data Set and Look for a Meetup on That: Mentor Startups Partnership with Eastern Foundry: Group/events/ / Group/events/ / 18

Specific Example: Data Science for the Map of Federal Crowdsourcing and Citizen Science Projects for the NDSO Challenge The National Data Science Organizers (NSDO) are looking for a set of meta- design categories for each challenge model so teams can find, gather, and share data. The Federal Crowdsourcing and Citizen Science Toolkit provides both a set of meta-design categories and agency partners to help teams find, gather, and share data. The Map of Federal Crowdsourcing and Citizen Science Projects has been converted to a data set of 102 projects that can be used by the NDSO teams for the upcoming OSTP/NSF NSDO Workshop, November 5-6, 2015, and for going forward for the rest of This work also demonstrates a simple data science project for a hackathon challenge that shows how this map was created in Excel and visualized in Spotfire.

CCSInventory.xlsx

Spotfire Imports Boundary Files Spotfire Geocodes Data

NOAA has the most projects: 26 Web Player

Goal: International network of citizen science data

31

32

33

34

35

36