A Proposed Short Course on Data Stewardship Scott Hausman Deputy Director NOAA’s National Climatic Data Center Preparing Scientists to Steward Their Data

Introduction Background –NESDIS Workforce Development –NCDC-ESIP-CICS Collaboration Purpose –Forum on Short Course Concept Overview –Challenge: NOAA Perspective –Proposal: Short Course –Discussion: Your Thoughts –Conclusion: Way Ahead 21/6/ ESIP Federation Winter Meeting NESDIS

Challenge: NOAA Perspective 31/6/ ESIP Federation Winter Meeting To accomplish it’s mission and vision, NOAA needs data! VISION: An informed society that uses a comprehensive understanding of the role of the oceans, coasts, and atmosphere in the global ecosystem to make the best social and economic decisions MISSION: To understand and predict changes in Earth’s environment and conserve and manage coastal and marine resources to meet our Nation’s economic, social, and environmental needs CORE VALUES: People, Integrity, Excellence, Teamwork, and Ingenuity Science, Service, and Stewardship

Challenge: NOAA Perspective Environmental Data Management at NOAA, NRC Report, 2007 Environmental Data Management at NOAA, NRC Report, 2007 Data Access & Archive Requirements Working Group (DAARWG) Data Access & Archive Requirements Working Group (DAARWG) Environmental Data Management Committee (EDMC) Established Environmental Data Management Committee (EDMC) Established Global Earth Observation – Integrated Data Environment (GEO-IDE) Global Earth Observation – Integrated Data Environment (GEO-IDE) Comprehensive Large Array-data Stewardship System (CLASS) Comprehensive Large Array-data Stewardship System (CLASS) Data Stewardship is a Top Priority 41/6/ ESIP Federation Winter Meeting Definition of Data Stewardship: “Maintaining the science integrity and long term utility of scientific records.” John Jensen, NOAA/NESDIS/NCDC Definition of Data Stewardship: “Maintaining the science integrity and long term utility of scientific records.” John Jensen, NOAA/NESDIS/NCDC Data Management

Challenge: NOAA Perspective NPOESS/GOES-R NPOESS/GOES-R National Mesonet National Mesonet Network of Networks Network of Networks –Private Sector –Local/State Mesonets –USIEOS/IOOS –GEOSS Phased Array Radar Phased Array Radar Next Generation of Satellites Next Generation of Satellites Explosion of Data Sources 51/6/ ESIP Federation Winter Meeting

Challenge: NOAA Perspective 61/6/ ESIP Federation Winter Meeting Projected Growth in Data Volume (reanalysis)

Challenge: NOAA Perspective Rescue of Physical Records 71/6/ ESIP Federation Winter Meeting Over 10 terabytes of climate data now digitized ‣ 54 million weather and environmental images online ‣ Hundreds of millions of records digitized now online ‣ International data access and rescue activities ‣ 84 current NOAA climate/environmental rescue projects July 1 st, 1842 hourly weather data from Washington, DC, imaged and digitized through the CDMP Program Imaged Records Example: Glacial Pairs – Muir Glacier, Alaska

Challenge: NOAA Perspective Workforce Limitations 81/6/ ESIP Federation Winter Meeting Data Stewardship Many of our data managers are geophysical scientists or IT professionals.

Proposal: Short Course Short Course on Data Stewardship When: Summer 2011, 1-2 Weeks Where: Asheville, NC (NCDC) Potential Curriculum –Stewardship Responsibilities –Metadata Concepts –Format Standards –OASIS Reference Model –Applications and Tools –Archives –Lab Exercises 91/6/ ESIP Federation Winter Meeting

Proposal: Short Course Continuum of Data Stewardship Responsibilities 101/6/ ESIP Federation Winter Meeting Collection Collection –Observing System Design –Instrument History Data Processing Data Processing –Software Version Control –Format Standards Users Users –Reporting Errors –Linking Results to Source Data

Proposal: Short Course Stewardship as the Art & Science of Data Management 111/6/ ESIP Federation Winter Meeting ART Stewarding Ethics SCIENCE Data Admin Standards

Proposal: Short Course Theory –Lifecycle Management –OAIS RM –Ethics Interoperability –File Format Standards –Naming Conventions –Metadata Standards Config Management Preservation –Provenance –Context –Fixity –Reference –Retention Security and Integrity Access and Discovery Traceability 121/6/ ESIP Federation Winter Meeting Basic Concepts

Discussion Forum –Should there be an area of focus? –What topics should be included? –What materials already exists? –Who should teach? –Who should attend? –When during the year should the course be held? –How long should the course be? Questions to Consider 131/6/ ESIP Federation Winter Meeting

Conclusion: Way Ahead Timeline 141/6/ ESIP Federation Winter Meeting February 2010 Establish Working Group June 2010 Define Course July 2010 Send Invitations to Prospective Instructors October 2010 Publicize Event February 2011 Registration Deadline April 2011 Course Materials Due June 2011 Short Course

Scott Hausman Deputy Director NOAA’s National Climatic Data Center 151 Patton Avenue, Room 557 Asheville, NC /6/ ESIP Federation Winter Meeting Thank you for sharing your insights!