CEOS Data Cube Initiative

Slides:



Advertisements
Similar presentations
CEOS Plenary Meeting Lucca, Italy November 8-9, 2011 CEOS Systems Engineering Office (SEO) Annual Report Brian Killough NASA Agenda Item #18.
Advertisements

CEOS Data Cube Concept and Prototype Project Plans
Element 2: Country-specific Space Data Services
Update on CEOS Support to GFOI S. Briggs, S. Ward ESA, GFOI Office SIT Workshop Agenda Item #9 CARB-3/4/5 CEOS SIT Technical Workshop EUMETSAT, Darmstadt,
Brian Killough / NASA, CEOS SEO SDCG-8 Session 7, Agenda Items 26 and 27 GFOI Space Data Services SDCG-8 DLR, Bonn, Germany September 23 rd -25 th 2015.
CEOS Data Cube Open Source Software Status Brian Killough CEOS Systems Engineering Office (SEO) WGISS-40 Harwell, Oxfordshire, UK September 30, 2015 (remote.
Committee on Earth Observation Satellites Brian Killough & Kim Holloway, CEOS SEO Plenary Agenda Item # th CEOS Plenary Kyoto, Japan 6 November 2015.
GFOI Space Data Services 3-year Work Plan Brian Killough NASA LaRC, CEOS SEO Presented at SDCG-6 Oslo, Norway October 22-24, 2014.
SDCG-6 Oslo, Norway October 22-24, 2014 Element 2: Space Data Services Oct 2014 Stephen Ward, SDCG EXEC for Australia.
Brian Killough / NASA, CEOS SEO SDCG-9, Session 5 Agenda Items 14 and 15 GFOI Space Data Services.
CEOS Data Cubes A new need for Capacity Building Brian Killough CEOS Systems Engineering Office (SEO) WGCapD-5 Meeting March 30 – April 1, 2016.
SEO Report to WGISS Brian Killough CEOS Systems Engineering Office (SEO) WGISS-41 Meeting March 14-18, 2016.
SDCG-6 Oslo, Norway October 22-24, 2014 GFOI SPACE DATA COMPONENT Accessing and Analysing Space Data GFOI Open Forum,
CEOS Data Cubes A briefing for the GEO Secretariat Brian Killough CEOS Systems Engineering Office (SEO) April 1, 2016.
Brian Killough / NASA, CEOS SEO SDCG-10, Session 5 Agenda Items 32 and 33 GFOI Space Data Services.
Incoming Themes for 2017 Frank Kelly, USGS
Analysis Ready Data LSI-VC – Adam Lewis Co-chair
USGS EROS LCMAP System Status Briefing for CEOS
Innovations for EO Data Earth Observation Research and Innovation Centre Mark Amo-Boateng, Ph.D EORIC, Sunyani, Ghana 13th-15th June, 2017 Sunyani, Ghana.
SESSION 7: Business Wrap-up & Review
Land Cover Side Event: A new path forward for generating products
CEOS Data Cube Report Agenda Item #7 September 13, 2017
SEO Capacity Building Agenda #15 Brian Killough
Colombia Data Cube Brian Killough CEOS Systems Engineering Office (SEO) WGISS-43 Meeting April 4, 2017.
CEOS on site Participation at GEO-XII and Ministerial Summit
CEOS Data Cube (CDC) and FDA Pilot Outcomes
Data Interoperability Summary
Geoscience Australia – data cube progress
FDA in 2017 A CEOS Chair Theme
Future Data Architectures (FDA) Pilot Project Summary
SEO Report Brian Killough and Kim Holloway CEOS SEO 30th CEOS Plenary
SEO Report to WGISS Brian Killough CEOS Systems Engineering Office (SEO) WGISS-42 Meeting September 19, 2016.
Space Data Services Session 2: Space Data Country Outreach and Delivery Agenda Item #3 Brian Killough CEOS Systems Engineering Office (SEO) February 25,
AOGEOSS Task 11. Develop Regional GEOSS Data set.
SDCG Support to Colombia
GFOI Status & Issues CEOS Lead & SDCG EXEC SIT-31 Agenda Item 5
USGS Status Frank Kelly, USGS EROS CEOS Plenary 2017 Agenda Item #4.14
FDA context Steven Hosford On behalf of FDA Co-chairs
Status Report on ARD Usage
Committee on Earth Observation Satellites
Potential Landsat Contributions
Land Imagery Data Architectures
Open Data Cubes Cloud Services Experiences and Lessons Learned
Analysis ready data: definition document
SDCG REPORT TO SIT TW 2016 Oxford, September, 2016.
SEO Report Brian Killough NASA, CEOS Systems Engineering Office
ARD Needs and Plans for Thematic Pilots
FDA Objectives and Implementation Planning
CEOS Chair Priorities for 2017
Open Data Cube Pilots Joint SDCG/GEOGLAM/LSI-VC Meeting
International Financing Institutions (IFI) Engagement
CEOS Analysis Ready Data for Land (CARD4L) Framework Recap
Proposed 2019 CEOS chair initiative
Committee on Earth Observation Satellites
Capacity Building at GA
Data Cubes Brian Killough, NASA, CEOS SEO
GEO-XIII Plenary St. Petersburg Russian Federation
SESSION 2: GLOBAL DATA FLOWS STUDY
WGISS Working Group for Information Systems & Services
GFOI Space Data Services
SEO Report to WGISS Brian Killough CEOS Systems Engineering Office (SEO) WGISS-46 Meeting October 22, 2018.
Engagement with GEO Kerry Ann Sawyer, NOAA, CEOS SIT Chair Team
Data Cubes and FDA Pilot Status Report
SEO Report Brian Killough, NASA, CEOS SEO CEOS Plenary 2018
Status Report on the Open Data Cube and the use of ARD
GEO-Amazon Cloud Credit Program and a Prototype Sentinel Data Pipeline
SEO Report to WGISS-47 Brian Killough
Open Data Cube Demo and FDA Interfaces
CEOS strategy for GFOI Phase 2
SEO Report to WGISS-48 Brian Killough
Presentation transcript:

CEOS Data Cube Initiative Committee on Earth Observation Satellites CEOS Data Cube Initiative Brian Killough NASA, CEOS Systems Engineering Office CEOS Plenary 2016 Agenda Item 5.3 Brisbane, Australia 1-2 November 2016

The Latest Trends Free and open data Growing data volumes Improved computing technologies Open source software Pre-processed products

What are Data Cubes? Data Cube = Time-series multi-dimensional (space, time, data type) stack of spatially aligned pixels ready for analysis Proven concept by Geoscience Australia (GA) and the Australian Space Agency (CSIRO) and planned for the future USGS Landsat archive. Analysis Ready Data (ARD) ... Dependent on processed products to reduce processing burden on users Open source software approach allows free access, promotes expanded capabilities, and increases data usage. Unique features: exploits time series, increases data interoperability, and supports many new applications. TIME Data Cubes are one example of a Future Data Architecture

Data Cube Work Plan Provides a reference for internal and external Data Cube activities as there is great interest in Data Cubes and Future Data Architectures (FDA) Provides a reference for CEOS agency contributions and discussion by CEOS leadership regarding coordination to ensure outcomes The majority of the work is managed and funded by the SEO and GA with significant contributions by CSIRO. The plan utilizes elements of the Australian AGDC development and is consistent with the USGS LCMAP plans. The document captures expected outcomes and planned tasks. Version 1.0 released at SIT-WS (Sept 2016) Version 1.1 released at Plenary (Oct 2016)

Work Plan Tasks The Work Plan includes a new task summary that summarizes the responsible groups and the status and schedule for each task. The tasks are grouped into 5 major categories ... (1) Core Technology, (2) Data Preparation and Formatting, (3) Prototypes, (4) User Requirements and Engagement, and (5) Capacity Building. Here are some highlights ... Core Technology ... Amazon demo (next charts), GIS integration (ArcGIS, QGIS), Change Detection (CCDC, BFAST) Data Preparation ... Working on Data Cube ingestors for Sentinels, SRTM/ASTER, SPOT-5, ALOS-PALSAR and climate data Prototypes ... Colombia and Switzerland in progress. Others proposed or in planning: FDA pilot, Asia Cube, Balkans, Disasters Landslide Pilot User Engagement ... FAO Forest Division and SEPAL tool integration Capacity Building ... ALOS-PALSAR training manual completed, World Bank (Lake Chad, Tonga, Togo), SERVIR training in Jan 2017

Amazon Cloud Demo Data Cubes 5 total cubes with 10+ years each Colombia: La Paya National Park and Meta River (RAPP region) Kenya: Western region (forests) and Lake Baringo Cameroon: Southern Lake Chad User Interface Features User-selected spatial region and time Analysis capability for custom cloud-free mosaics, WOFS water detection, Total Suspended Matter (TSM) water quality, and Fractional Cover (coming soon). Outputs in GEOTIFF and time series GIF animations This is the first “hands-on” global demo of the Data Cube to show its potential for rapid time series data applications

Lake Chad, Cameroon, Africa 10-year Time Series Results The WOFS product shows the percent of observations detected as water over the full time series Purple/Blue: Frequent water Green/Yellow: Infrequent water and/or flood events World Bank has shown extreme interest in these results as they have a large water management project in that region. An expansion of the dataset to the full lake is planned.

Lake Chad, Cameroon, Africa 10-year Time Series Results The severe drought in 2008 is evident in the Lake Chad time series results. The overall 10-year trend is a loss of 1.4 hectares per day for this analysis region Lake Chad is a source of livelihood to 30 million people. The shrinking lake has had a substantial impact on the local populations, as entire communities have switched from a fishing-lifestyle to one of farming and agriculture. Local communities that once ringed the shores of the lake are now isolated villages — miles from water — and these populations have literally begun farming the now-dry lake bottom. As of 2015, there are plans are in the works to divert water from the Congo River to the River Chari, which flows into Lake Chad, and revitalize the lake.

Total Suspended Matter (TSM) Water Quality Total Suspended Matter (TSM) Lake Baringo, Kenya 2006 to 2015 (10 years) Lake Chad, Cameroon, Africa 2006 to 2015 (10 years) The results show the average TSM (mg/L) over the time series for persistant water. TSM is closely related to turbidity which is an indicator of water condition for drinking or fisheries Purple/Blue: Lower levels of suspended matter Red/Yellow/Green: Higher levels of suspended matter Lake Baringo (left) is commonly turbid with high sediment and high average TSM levels. Lake Chad (right) has higher TSM in the central portion of the lake but lower levels in the southern portion.

Lake Baringo, Kenya Time Series Animation Sedimentation is considered to be the main environmental threat to Lake Baringo. It is reducing the depth and surface area of the lake and destroying aquatic life. Rain does not always increase turbidity and TSM. Erosion from rainfall commonly causes higher TSM with more suspended matter, but increased rain may lead to lower water temperature and increased volume sufficient to dillute sediment and reduce algal growth. This effect is seen with increased rains and lake volume in 2013 and 2014 Sedimentation is considered to be the main environmental threat to Lake Baringo. It is reducing the depth and surface area of the lake and destroying aquatic life. Rain does not always increase turbidity and TSM. Commonly, erosion from rainfall causes higher TSM with more suspended matter, but increased rain may lead to lower water temperature and increased volume sufficient to dillute sediment and reduce algal growth. TSM animation (2006 to 2015): Higher TSM before 2013, then rains in 2013 lower the TSM before rising again in 2014-2015.

Plenary Decisions CEOS Plenary Decisions NONE ... The 3-year CEOS Data Cube Work Plan is provided “for information only”. This plan will continue to evolve. Updated released are expected at SIT-32 and the 2017 CEOS Plenary. Other Information The CEOS Data Cube initiative was endorsed at the recent CEOS SIT Workshop. The activity is led by the SEO, GA, and CSIRO and will continue as a “Future Data Architecture” task through 2017. Proposed Action: CEOS Data Cube team to prepare a governance plan for management of a consolidated open source repository by SIT-32. This will lay the foundation for fostering and growing a larger community of contributors to the CEOS Data Cube effort.