Data Services Branch U.S. Department of the Interior U.S. Geological Survey Douglas Binnie USGS EROS Center.

Slides:



Advertisements
Similar presentations
ASIAES Project Overview Satellite Image Network for Natural Hazard Management in ASEAN+3 region Pakorn Apaphant Geo-Informatics and Space Technology Development.
Advertisements

U.S. Department of the Interior U.S. Geological Survey Agency Report, WGISS #22 September 15, 2006 Lyndon R. Oleson U.S. Geological Survey Center for Earth.
International Charter ‘Space and Major Disasters’
LANDSAT Program Update Tim Newman Coordinator, USGS Land Remote Sensing Program National Geospatial Advisory Committee December 3, 2014.
Landsat Point of Contact USGS Bruce Quirk NGAC Kass Green NGAC Meeting, October 5, 2011.
SDCG-6 Oslo, Norway October 22-24, 2014 SDCG/USGS: Landsat 7 & 8 SDCG-6 Session 5: Roles and Responsibilities Data flows from CEOS agencies.
GOES Direct Services. Topics  Direct Broadcast Services  GOES Data Collection Services  Search and Rescue.
590 Lipoa Parkway, Suite 259 Kihei, Maui, Hawaii (Fax) Pacific Disaster Center.
University of Waterloo Library : Geospatial and Map Resources Earth 231.
1 Cooperative Institute for Research in the Atmosphere CIRA Colorado State University An Overview Prepared by: Mary McInnis-Efaw Department Manager, CIRA.
Mike Smorul Saurabh Channan Digital Preservation and Archiving at the Institute for Advanced Computer Studies University of Maryland, College Park.
RAP: Tools and Technology National Preparedness Goal: Whole Community Geospatial Support 06 December 2011.
Item 12: Data Democracy 2009 Progress Pakorn Apaphant November 4 th, The 23 rd CEOS Plenary, Phuket, Thailand I November 3-5, 2009.
CEOS - NSLRSDA Footprint Server John Faundeen U.S. Geological Survey October Ottawa, Ontario, Canada.
International Charter Space and Major Disasters Charter Executive Secretariat June 01, 2012 History, Operations and Activations.
International Charter Space and Major Disasters 2011 NOAA Satellite Direct Readout Conference Miami, Florida April 4, 2011 Monitoring and Management Support.
The U.S. Climate Change Science Program Dr. James R. Mahoney Assistant Secretary for Oceans and Atmosphere Director, Climate Change Science Program.
Introduction of International Scientific Data Service Platform Scientific Data Center Computer Network Information Center,CAS Lin Qinghui 2011/10/27 1.
A Profile of the Workforce at the USGS EROS DATA CENTER
Interagency Remote Sensing Coordination Cell Office of Intelligence and Analysis UNCLASSIFIED//FOR OFFICIAL USE ONLY 15JUL2011.
U.S. Department of the Interior U.S. Geological Survey USGS Records Management Program: Initiatives, Opportunities, and Assistance Administration and Enterprise.
The West Virginia GIS Program: A Decade of Progress, A Future of Promise Craig A. Neidig WV State GIS Coordinator WV Geological & Economic Survey Chairman,
U.S. Department of the Interior U.S. Geological Survey Land Processes DAAC Update MODIS-VIIRS Science Team Meeting January 26-28, 2010 Dave Meyer LP DAAC.
U.S. Department of the Interior U.S. Geological Survey Landsat Program Update October 2005 Presented By: U.S. Geological Survey, Center for EROS Sioux.
, Data for Disaster Planning, Response, Management and Awareness ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
Sources of Free Imagery Glenn Bethel Dec 2, 2008.
, Increasing Discoverability and Accessibility of NASA Atmospheric Science Data Center (ASDC) Data Products with GIS Technology ASDC Introduction The Atmospheric.
, Implementing GIS for Expanded Data Accessibility and Discoverability ASDC Introduction The Atmospheric Science Data Center (ASDC) at NASA Langley Research.
National Boundaries Group Update to Coordination Group Laura Waggoner, US Census Bureau and Robert Pierce, US Geological Survey, Co-Chairs March 18, 2014.
USGS Report U.S. Department of the Interior U.S. Geological Survey Kristi Kline USGS EROS Center.
U.S. Department of the Interior U.S. Geological Survey USGS/EROS Emergency Operations Joint NASA/USDA Forest Service Wildfire Recovery Initiative Workshop.
NARA INITIATIVES ON GEOSPATIAL DATA RECORDS FGDC Coordination Group Meeting, May 3, 2005 Ken Thibodeau, Director Electronic Records Archives Program Management.
U.S. Department of the Interior U.S. Geological Survey Diving into the Data Pool with DAAC2Disk Kelly Lemig ERT, Inc., contractor to the U.S. Geological.
National Agriculture Imagery Program NAIP Informational Meeting July 19, 2006 Washington DC Jim Mauck U.S. Geological Survey, 511 National Center,
The Global Land Cover Facility Presentation for WGISS-25 February 26, 2008 University of Maryland, Department of Geography.
National Wildland Fire Weather Needs Assessment National Wildland Fire Weather Needs Assessment Mr. Mike Babcock Senior Staff Meteorologist, OFCM CCAMS.
Support for GOES Data Collection System Presentation to the Advisory Committee on Water Information by Charles Kazimir, Chairperson of the Satellite Telemetry.
U.S. Department of the Interior U.S. Geological Survey Access to MODIS Land Data Products Through the Land Processes DAAC John Dwyer and Carolyn Gacke,
1 Global Systems Division (GSD) Earth System Research Laboratory (ESRL) NextGen Weather Data Cube Chris MacDermaid October, 2010.
Welcome - Introduction to SDMI & Goals for the Workshop.
National Academy of Public Administration: Getting Results Intergovernmental Collaboration in G eospatial One Stop John Moeller Staff Director Federal.
U.S. Department of the Interior U.S. Geological Survey Topographic Data Update IGOL: Rome September 13-15, 2004 Doug Muchoney USGS.
Users/Historical Data Working Group Update to Coordination Group Butch Lazorchak Library of Congress Chair, U/HDWG September 9, 2014 Coordination.
U.S. Department of the Interior U.S. Geological Survey USGS Geospatial Liaisons - Supporting NHD Stewardship NHD Workshop April 14, 2009.
National Digital Orthoimagery Program (NDOP) Update to Coordination Group Chair: Anne O’Connor Census February 18, 2014 Coordination.
1 Attachment A USGS EROS Data Center U.S. Geological Survey Department of the Interior EROS Data Center.
1 U.S. Department of the Interior U.S. Geological Survey June 22, 2009 Landsat Data Gap Readiness Plan Briefing to Landsat Science Team Rochester, New.
U.S. Department of the Interior U.S. Geological Survey Entering A New Landsat Era – The Future is Now Tom Loveland U.S. Geological Survey Earth Resources.
U.S. Department of the Interior U.S. Geological Survey U.S. Geological Survey Scientific Records Appraisal Tool Presented at the Ensuring the Long-Term.
Breakout # 1 – Data Collecting and Making It Available Data definition “ Any information that [environmental] researchers need to accomplish their tasks”
WGISS and GEO Activities Kathy Fontaine NASA March 13, 2007 eGY Boulder, CO.
Cartographic Users Advisory Council The National Spatial Data Infrastructure and the Geospatial One Stop E-Gov Initiative May 3, 2002 John Moeller Staff.
“40 Years of Service to Our Planet” U.S. Department of the Interior U.S. Geological Survey Douglas Binnie/Rynn Lamb USGS EROS Center.
U.S. Geological Survey CEOS U.S.Gelogical Survey – Agency Report ) The Committee on Earth Observation Satellites Data and Access Subgroups May 2002.
U.S. Department of the Interior U.S. Geological Survey John Faundeen October 9, 2011 Future Directions in Data Preservation ^ and Current.
Attachment C The National Satellite Land Remote Sensing Data Archive in the Department of the Interior The National Satellite Land Remote Sensing Data.
National Digital Orthoimagery Program (NDOP) Update to Coordination Group Chair: Chris Barnard Department of Homeland Security
Science Review Panel Meeting Biosphere 2, Tucson, AZ - January 4-5, 2011 Vegetation Phenology and Vegetation Index Products from Multiple Long Term Satellite.
NDGA Workshop September 2005 U.S. Department of the Interior U.S. Geological Survey USGS National Geospatial Digital Archive activities.
U.S. Department of the Interior U.S. Geological Survey Archiving Geospatial Data John Faundeen, Archivist Presentation to Map & Geographic Information.
International Charter Space and Major Disasters Charter Executive Secretariat June 01, 2012 History, Operations and Activations.
LP DAAC Overview – Land Processes Distributed Active Archive Center Chris Doescher LP DAAC Project Manager (605) Chris Torbert.
CEOS Working Group on Information System and Services (WGISS) Data Access Infrastructure and Interoperability Standards Andrew Mitchell - NASA Goddard.
2017/18 SANSA Annual Performance Plan
Charter Executive Secretariat April 8, 2016
VegDRI History, Current Status, and Related Activities
Landsat Program The World’s Most Sophisticated Optical Observatories of the Earth The World’s Model for International Collaboration in Earth Observation.
Technology Exploration Cloud Hosting at USGS
An Asia Pacific Natural Hazards and Vulnerabilities Atlas
Presentation transcript:

Data Services Branch U.S. Department of the Interior U.S. Geological Survey Douglas Binnie USGS EROS Center

Mission Area Data Acquisition, Archiving and Access Ensure that scientists, decision makers, and the public have ready access to land change information and to safeguard and expand the national archive of remotely sensed land data. Preserve and distribute the centers data and information products Manage the NASA EOS/DAAC requirements Operate existing user interfaces and develop future information access methodologies Manage hazards and disaster response activities Operate user services and application assistance support in concert with the other branch's Support the development, implementation, and operation continuum thru direct coordination with science based personnel

Data Services Branch Chief D. Binnie Long Term Archive Project Manager R. Longhenry Spatial Data Warehouse Manager C. Rusanowski Acting LS Access and Dist. O&M Sentinel 2 K. Kline LP DAAC Manager C. Doescher LP DAAC Scientist 1 - Vacant Term 1 - Vacant Perm (AB Staff) LP DAAC Operations Manager C. Torbert Emergency Operations Project Manager R. Longhenry Emergency Ops Liaison B.Jones Data Management Specialist R. Saleh Computer Scientist C. Rusanowski FMO Staff Support L. DeBoer Emergency Ops Liaison Vacant Administration Support N. Vandenbussche Data Services Branch Organization Customer Engagement R. Lamb

EROS Consolidated Report on Data Managed All Projects with Detail – Monthly/Cumulative

EROS Consolidated Report on Data Distributed All Projects with Detail – Monthly/Cumulative

DSB - Functions Data Ingest Data Management Data Processing Mass Storage System Backup Data Discovery Data Access Bulk Download

Data Management Film Archives to Present. 24 Major Collections. Multiple film formats/sizes. Multiple Agencies Digital Archives to Present. 1 to 2 Terabytes / Day. Static and Active Collections. Expanding to contain film archives Over 8 Petabytes 59,000 rolls of film 14.4 million images

Aerial Photography Collections U.S. Geological Survey Photography National High Altitude Photography National Aerial Photography Program Space Acquired Photography Other U.S. Federal Aerial Photography Side-Looking Airborne Radar High Resolution Orthorectified Present National Agriculture Imagery Program Present Cartographic - Topographic Collections Digital Line Graphs 1:24,000* 1:100,000 Digital Elevation Models 7.5 o 15’Alaska 2 Arc Second** 1:250,000 Digital Raster Graphics 1:24,000 1:100,000 1:250,000 Digital Orthophoto Quads National Atlas National Elevation Database SRTM Satellite Collections Declass 1 (Corona) 1960 – 1972 Declass 2 (KH-7, KH-9) 1963 – 1980 SPOT Pan/Multispectral 1986 – 1998 Landsat MSS 1972 – 1992 Landsat Thematic Mapper 1982 – Present Landsat 7 ETM – Present Landsat 8 OLI/TIRS Present EOS/MODIS 2000 – Present EOS/ASTER 2000 – Present AVHRR LAC/HRPT 1986 – Present EO – Present SIR-C 1994 Commercial Data Purchases 2002 – Present Data Holdings Collection Diversity Aerial Cartographic Topographic Satellite Digital and film archive media Static and growing collections

Robotic Tape Library System Utilizes an StorageTek SL8500 tape library systems Currently holds approximately 8 PB with 85 PB capacity Media are periodically updated as new technology becomes available Implementation of hierarchical store management enables distribution directly from the archive Utilizes varying “tiers” of disk (SATA/SAS/Solid State) that are used as a front end cache to the tape

Robotic Tape Library System

Data Archiving Data is managed and preserved using 3 copies: nearline, offline, and offsite Offsite copies are stored NARA’s Kansas City facility Multiple media types are utilized to ensure long term readability Currently using LTO-6 and T10k-D tapes Media are periodically updated as tapes technology advances. Records management schedules are worked with NARA

Film Scanning Produce on-demand high-resolution scanned products from the historical film archive based on customer requests. 25, 14 and 7 micron $30/file - Internet delivery All Declass scanned images put on-line for future access Archive scanning of not-standard film sizes Chip film - TM, MSS, RBV Declass, Large Format Camera Phoenix V Systematically scan USGS archive to 25 micron Web enabled at no-charge over the internet Nine Phoenix V scanners operational (3 more planned) Designed, built and integrated on-site 24 X 5 operations Initial focus on vinegar syndrome (4 yrs) 14,000 frames scanned per week on average Currently, over 2.5 million images scanned Leica Scanner

New Work – Sentinel 2 Activities  European Space Agency (ESA) Sentinel-2 consist of two satellites (one launched in June the other planned for next year), providing global land imagery comprising 13 spectral bands with a swath width of 290km.  Satellite orbit is approximately 800km with coverage repeat cycle of ten days at the equator, and six days at mid-latitudes.  With two satellites coverage cycle is doubled.  Mission lifecycle is designed for 7.5 years with consumables for 12 years.

Baseline Requirements 1) Products distributed world-wide, without restriction, at no cost to users. 2) Product equivalent to the Landsat L1T product (implies the S2 L1C product). 3) S2 and Landsat products available via coincident searching (implies the same interface). 4) Data ingest of S2 L1C data requires no additional processing. 5) Data archived in the US (driven by the Purpose, above). 6) Data ingest at EROS via network from Europe (assume no downlink at EROS). 7) Imagery acquired covers global land and coastal areas (current Landsat practice). 8) Scalability and multi-mission capability

Sentinel 2 (cont’d)  We plan to distribute the L1C product as processed by ESA that is analogous to Landsat L1T.  L1C product is ortho-rectified 100x100km 2 tiles with datasize of 500MB.  NASA Ames will retrieve L1C data to create Surface Reflectance (SR) product to be archived and made available for distribution.

Sentinel 2 (cont’d)  This estimate is for the data archive and distribution of Sentinel-2 L1C and Surface Reflectance products.  Total data archive 6.4TB per day  L1C data archive of 3.2TB per day  SR data archive of 3.2TB per day  Total data distribution of 9.6TB per day  L1C data retrieval by NASA Ames of 3.2TB per day  L1C data retrieval by Canada Centre for Remote Sensing (CCRS) of 3.2TB per day  L1C and SR public data distribution of 3.2TB per day

Current Status Implementation of Sentinel 2 Archive and Distribution FY15 Equipment has been received and is on line but we are still working minor configuration issues Initial Bandwidth data transfer test have been done but awaiting access to the international data hub for increased bandwidth Received test acquisition and have developed initial ingest script, we know this was preliminary, more ingest scripting is anticipated Planning the Characterization effort for implementation of Tier 2 priorities in FY16 17

Sentinel Network Connectivity

Support of NGP and Other Agencies Support data access and distribution requirements of the National Geospatial Program‘s National Map Historically supported the production, archiving and distribution of LiDAR and elevation information. This has moved to the NGTOC in Rolla. Continue to maintain a historic archive of LIDAR data. Currently support Orthoimagery and Landcover distribution. NGP Orthoimagery ingest will stop in FY16 and the distribution of Orthoimagery will discontinue in the FY18 time frame. Landcover distribution is planned to move to the public cloud

Support of NGP and Other Agencies Provides data, access and distribution services thru service level agreements to multiple federal agencies including: National Geospatial-Intelligence Agency (NGA) Federal Emergency Management Agency’s (FEMA) Flood Insurance Rate Map (FIRM) Program USDA Forest Service (Fire and Aviation Management) USFS/USACE/USGS WRD - GOES National Guard Bureau – GIIEP NIFC – Greenness Mapping with AVHRR BLM – Archival Film Scanning NRCS – Color Imagery Scanning

Liaison Activities Provide 24x7 on-call support and coordination for satellite and aerial image access, acquisition and delivery. Provide USGS representation and operational support to the International Charter Space and Major Disasters. Assist in requirements development, content definition, and usability testing for USGS emergency response systems. Emergency Operations Support Assure appropriate data is ingested and available. Operate and maintain the Emergency Operations Portal web pages including establishment of event presence. Emergency Operations

 Fiscal Year 2014  Number of Events: 77  Domestic: 35  International: 42  Fiscal Year 2015 (As of Sept 12)  Number of HDDS Events (total): 79  Domestic: 42 – includes more events as several storms and fires were grouped under a single HDDS event. 42 HDDS events = 72 actual events  International: 37  FY2015 events included: Active western U.S. fire season (CA, OR, WA, ID, MT, AK) Animas River / Gold King Mine Spill (CO) Ebola Crisis in West Africa Earthquake and Landslides in Nepal Sustained image collections for Kilauea, Mount Sinabung, and Cotopaxi Volcanoes – HVO, VDAP EO Event Support

Image Access and Delivery  Federal Government  Bureau of Indian Affairs (BIA)  Bureau of Land Management (BLM)  Center for Disease Control (CDC)  Department of Health and Human Services (HHS)  Department of Homeland Security (DHS)  Department of Interior (DOI)  Environmental Protection Agency (EPA)  Federal Emergency Management Agency (FEMA)  National Aeronautics and Space Administration (NASA)  National Geospatial Intelligence Agency (NGA)  National Guard Bureau (NGB)  National Park Service (NPS)  National Oceanic and Atmospheric Administration (NOAA)  National Transportation and Safety Board (NTSB) Federal Stakeholders  National Weather Service (NWS)  US Air Force (USAF)  US Army  US Army Corps of Engineers (USACE)  US Navy  US Northern Command (NORTHCOM)  US Department of Agriculture (USDA)  US Forest Service (USFS)  USGS (e.g. Earthquake Hazards, Water Science Centers, Volcano Hazards)  State Department  US Agency for International Development  Office of Foreign Disaster Assistance  Department of Veterans Affairs

Data Contributors  International Charter Space and Major Disasters  Civil Air Patrol (CAP)  Federal Emergency Management Agency (FEMA)  National Geospatial-Intelligence Agency (NGA)  National Oceanic and Atmospheric Administration (NOAA)  National Aeronautics and Space Administration (NASA)  State and Local Offices  US Army Corps of Engineers (USACE)  US Department of Agriculture (USDA)  US Geological Survey (USGS)  US Department of Homeland Security (DHS)  US National Guard (USNG)  US Department of Defense  Commercial entities

An International agreement among participating Agencies to provide space-based data and information in support of relief efforts during emergencies caused by major disasters. Member of the International Charter The Charter’s capacities can be activated through a single access point which is available 24 hours, seven days a week. Space agencies contribute Priority satellite tasking Archive Retrievals Organisation of map production

Natural events Man-made events Earthquakes Oil spills FiresIndustrial accidents Floods Ice jams Landslides Tsunamis Ocean storms Volcanic eruptions Disaster Types Supported The Charter supports large, often sudden events with high impact in terms of lives, infrastructure, and/or environment. (slow-onset disasters, such as droughts, are not covered by the Charter)

Charter Members CSA Canada NOAAUSGSUSA CONAE Argentina CNES France Europe ESA EUMETSAT ISROIndia JAXAJapan CNSAChina KARIKorea ROSCOSMOSRussia INPE Brasil UKSA/DMCUK DLRGermany

Land Processes Distributed Active Archive Center (LP DAAC)

Funded by NASA per interagency MOU First went operational in 1994 Supports two types of instruments and three missions ASTER MODIS Other community type data sets (NASA proposals) South Dakota State U. – Web Enabled Landsat Data (WELD) U. of Maryland - Global Forest Cover Change (GFCC) U. of Arizona – Vegetation Index and Phenology (VIP) Jet Propulsion Laboratory - NASA Digital Elevation Model Uses integrated set of NASA and USGS systems NASA systems are owned and Configuration Managed by NASA USGS, USGS contractor, and NASA contractor staff maintain the equipment Data ingested and distributed via USGS networks NASA pushes hard for technology advancement 2.5 PB of disk, all data is on spinning disk Data will eventually transition to USGS in the 2020 timeframe

Dataset level information provided to multiple government catalog services Data.gov USGS Science Data Catalog Metadata information populated automatically from the Earth Explorer user interface Key collections tagged as FGDC National Geospatial Data Assets (NGDA) Government Catalog Interaction

User Management and Demographics User registration required for data downloads Includes Earth Explorer, HDDS, GloVis, Landsat Look, and CIDR user interfaces Login/Registration enables the creation of detailed metrics and demographic reports Agency/Affiliation Detail on data usage Tracking of downloads by dataset and user type Login requirements also allow for data rights management Licensed commercial imagery Preliminary data

Accessing Data EarthExplorer  Global Visualization Viewer  LandsatLook  NASA ECHO  Hazards Data Dist. System 

Discussion topics Customer Services Expanding Customer Services (Tier 2 Activities) Need to increase Level of effort. New Products, Product changes (Landsat Sentinel2, LCMAP) Increase our Web work, Documentation - Training and Outreach Data Management Support for Science Adherence to 4 USGS Instructional Memorandum Policy By October 2016 All Research data needs to have data management plans, appropriate metadata, and be released to the pubic at the time of publication. Recommend putting in place the service organization to support this within DSB. Establish a Landsat (LSDS) User Working group which is in addition to the Landsat Science Panel.

Discussion topics Declassified Data Sets transferred from NGA to NARA. LRS Requirement for Periodic Archiving/Production distribution Reports from EROS Customer Satisfaction Survey

Questions