Sustained Coordinated Processing of Environmental Satellite Data for Climate Monitoring Sustained Co-ordinated Processing Of Environmental Satellite Data For Climate Monitoring (SCOPE-CM) Overview and Next Steps John Bates, Chair SCOPE-CM Executive Panel

WMO’s SCOPE-CM initiative: goals and structure Aim: to address the requirements of GCOS in a cost-effective, coordinated manner, capitalising upon the existing expertise and infrastructures. Objective: continuous and sustained provision of high-quality Essential Climate Variables satellite products (Climate Data Records) on a global scale Structure: The SCOPE-CM Network will be: » Based on activities of existing initiatives (GOS, GCOS and GSICS) » Build upon existing operational infrastructures » Serve users and other organisations (e.g. WMO Regional Climate Centres RCC, National Weather Services)

Satellite & In Situ Observations Satellite & In Situ Observations Sustained Climate Information Flow Emerging International Architecture Satellite data Environmental Data Records Long-term Information Preservation Interim Climate Data Records (ICDRs) Essential Climate Variables Climate Information Records Short scale physical phenomena monitoring Operational Climate Monitoring supporting Climate Services Longer term climate variability & climate change analysis Adaptation + mitigation planning (decision making) Sustained Applications Major model-based Reanalysis Near Real Time Re-calibration Inter-calibration Reprocessing Observing system performance Monitoring and automated corrections Data conversion User Services Archives Inter-calibration Sustained Coordinated Processing Thematical Climate Data Records (TCDRs) Fundamental Climate Data Records (FCDRs)

WMO’s SCOPE-CM initiative: goals and structure Phase 1 Participants of the SCOPE-CM Network Operational Satellite operators: – NOAA – JMA – CMA – EUMETSAT (Central Facilities and CM SAF) Stakeholder – WMO Space Programme – GCOS – CEOS – CGMS/GSICS

WMO’s SCOPE-CM initiative: Phasing establish initial network and structure agreement on principles and standards first pilot projects on selected subjects assessment of the current capabilities establishment of feedback mechanisms Phase I establishment of structures for sustainable generation of FCDRs and TCDRs generation of first SCOPE-CM products increased coverage of products in terms of ECVs, time and spatial dimension fostering extension of the network full deployment of the sustained system of product generation products review and quality control continuous product improvement Phase II Phase III

SCOPE-CM Pilot Projects SensorsParameters and topicsLeadContributors 1AVHRRClouds and Aerosols 2SSM/IWater vapour, clouds, precipitation 3GEOSurface albedo, clouds and aerosols 4GEOWinds and clear sky radiances 5GEOUpper tropospheric humidity

Present status and future plan EUMETSAT -MFG AMV and CSR reprocessing (end 2010) - MSG AMV and All Sky Radiance (ASR) reprocessing (end 2011) NOAA - Make existing record (1982-present) of reprocessed AVHRR AMVs available to SCOPE-CM community - Define plans for a pilot project aimed at demonstrating the utility and benefits of reprocessed AMVs - GOES AMV reprocessing per pilot project (mid 2011) - Development of reprocessing capability ( ) - GOES AMV and CSR reprocessing (2015) - MODIS AMV reprocessing (2015) JMA -GMS/MTSAT AMV and CSR reprocessing is in progress to meet Japanese 55-year Reanalysis project (JRA-55) schedule (end 2010) -Webpage showing the status of JMA’s reprocessing is available CMA -CMA is interested in FY-2 AMV reprocessing -FY-2 archive intercalibration reprocessing has just started

GEWEX RADIATION PANEL WORKING GROUP ON DATA MANAGEMENT AND ANALYSIS Formed in 2004 by combining existing GRP Data Project Working Groups that date to 1980s Purpose: Coordinate next data product revision and re-processing to increase physical consistency and to produce joint data product Original Working Groups Differed in Nature –ISCCP: Data Processing Center Representatives –GPCP: Science Team & Data Processing Group –GACP & SRB: Data Processing Team –SeaFlux & LandFlux: Science Study Group Representative

GEWEX RADIATION PANEL WORKING GROUP ON DATA MANAGEMENT AND ANALYSIS Added Data Product Assessment WG Leaders for Precipitation, Radiation, Clouds (and Aerosols) Accumulated Functions –Monitor Data Exchanges and Resolve Problems –Radiance Calibration –Ancillary Data Acquisition & Evaluation –Review Scientific Developments for Retrieval Methods –Develop/Evaluate Analysis Methods & Revise Products –Assess Data Product Quality

Proposal to Transition Some GRP WGDM Functions to SCOPE-CM - Rationale SCOPE-CM is moving into Phase 2 – Ongoing pilot projects and new projects require sustained provision of data, calibration, and processing from operational environmental satellite SCOPE-CM is an appropriate mechanism for sustaining some important GRP WGDM functions Other GRP WGDM functions should remain within international research bodies and/or be part of shared responsibilities SCOPE Presentation Template - SCOPE CM 10

Satellites –2 SMS –13 GOES –8 Meteosat –5 GMS –2 MTS –2 FY Current Geostationary Quilt 2 GOESs GOES, Meteosat, GMS 2 GOES, Meteosat, GMS 2 GOES, 2 Meteosats,GMS, FY

ISCCP Data Sharing Historically Satellite Processing Centers ISCCP Central Archive (NCDC) Global Processing Center JMA CMA EUMETSAT NOAA INP (Brazil) GISS/CCNY B3 (All satellites) Products (C/D Data) B2 GOES-11,12,13 Meteosat-7,9 MTS-1,2 FY2 NOAA-7,8,9,10,11, 12,14,15,16,17 B1 GOES-11,12,13 Meteosat-7,9 MTS-1,2 FY2

ISCCP Data Sharing After transition Satellite Processing Centers ISCCP Central Archive (NCDC) ISCCP Development JMA EUMETSAT NOAA CMA INP (Brazil) Others? GISS/CCNY B1 GOES-11,12,13 Meteosat-7,9 MTS-1,2 FY-2E ISCCP Cloud NCDC Code Improvements B1 & AVHRR New ISCCP Products HX – Pixel-level, not mapped,3-h (DX) HG – 0.1° global, remapped, 3-h H1 – 1° gridded global 3-h (D1) H2 – 1° gridded global monthly (3-h) (D2) H3 – 1° gridded global monthly mean (D3) New ISCCP Products HX – Pixel-level, not mapped,3-h (DX) HG – 0.1° global, remapped, 3-h H1 – 1° gridded global 3-h (D1) H2 – 1° gridded global monthly (3-h) (D2) H3 – 1° gridded global monthly mean (D3) For Archive For Analysis

Early Results from B1 processing ISCCP B1 IR RadianceISCCP Clear sky IR RadianceISCCP Cloud Mask B3 (32 km) B1 (10 km)

GRP WGDM Accumulated Functions Radiance Calibration –Who currently is involved? –Who should be involved going forward? –What major issues are involved? –What international bodies should be involved and provide leadership? SCOPE Presentation Template - SCOPE CM 15

SCOPE-CM initial structure Current Members: Operational Agencies: NOAA, EUMETSAT, JMA, CMA (USGS) = operators of operational (meteorological) satellites Executive Panel as the only established formal structure so far. Pilot Projects: groups at different level of integration and nature of cooperation. Some pilot projects grouped by sensors, some by targeted ECV CDR

SCOPE-CM transition towards Phase 2: Questions and issues Increasing interest from other organisations: Universities, ESA, GEWEX,.... University groups to join SCOPE-CM? How? What are the conditions to become member? What shall be the difference between a SCOPE- CM activity and any other type of project? What shall be the difference and the relation to other initiatives, projects e.g. WMO GFCM, CEOS Climate Working Group, ESA CCI, GMES Climate,....

A Proposal for the SCOPE-CM in its next phase Two “spheres”: SCOPE-CM Sustained Structures SSS SCOPE-CM Projects Sphere (research, science)

A Proposal for the SCOPE-CM in its next phase Two “spheres”: SCOPE-CM Sustained Structures SSS SCOPE-CM Projects Sphere (research, science) – Teams from the operational agencies – Working together on: FCDRs, standards, inter-calibration, reprocessing methodologies, archive issues, data distribution, documentation,.... – Permanent groups and resources (e.g. sustained funding, staff, etc...) – Group by sensor / sensor types

A Proposal for the SCOPE-CM in its next phase Two “spheres”: SCOPE-CM Sustained Structures SSS SCOPE-CM Projects Sphere (research, science) – Teams from universities, research labs, (space agencies) – Working together on: algorithms, science, applications, initial CDR processing,.... – Non-Permanent groups and resources (project funding)

SCOPE-CM Generic CDR life cycle SCOPE-CM Pilot Project SCOPE-CM CDR generation project Independent CDR assessment (e.g. GEWEX RP) Consolidated Retrievals/Methods Feasibility for sustained generation Consolidated Retrievals/Methods Feasibility for sustained generation Pre-released CDRs Pre-released CDRs Accepted CDR

SCOPE-CM Generic CDR life cycle SCOPE-CM Pilot Project SCOPE-CM CDR generation project Independent CDR assessment Consolidated Retrievals/Methods Feasibility for sustained generation Consolidated Retrievals/Methods Feasibility for sustained generation Pre-released CDRs Pre-released CDRs Accepted CDR Identification of CDRs reaching maturity for R2O transition Initiated by external groups, SCOPE-CM, or GRP etc. Lead by PI, consortium consist of external groups and SCOPE-CM partners (from the relevant SSS) Criteria: e.g. CDR targeted, that need coordination of SCOPE-CM partners Proposals to be accepted by the Executive Panel Assessment of requirements, scientific relevance and feasibility Determination of processing requirements, schedules, dependencies Agreement of methods and principles (inter-calibration, validation, etc.) Main outcome: Pilot project report, ATBD (for TCDRs and FCDRs) for implementation

SCOPE-CM Generic CDR life cycle SCOPE-CM Pilot Project SCOPE-CM CDR generation project ( ≙ transition step) CDR assessment Pre released CDRs Pre released CDRs Accepted CDR Joint Lead by PI and SSS representative (=“transition manager”), consortium consist of external groups and SCOPE-CM partners (SSS) Proposals for a CDR project (pre-agreed with SSS) to be accepted by the Executive Panel CDR generation at SSS Validation Review Processes “Pre-”Release of a CDR with unique reference (DOI) Main outcome: CDR, Documentation (Validation Report, Product User Manual,..), Dissemination/Publication Consolidated Retrievals/Methods Feasibility for sustained generation Consolidated Retrievals/Methods Feasibility for sustained generation

Consolidated Retrievals/Methods Feasibility for sustained generation Consolidated Retrievals/Methods Feasibility for sustained generation SCOPE-CM Generic CDR life cycle CDR assessment CDRs Accepted CDR Independent assessment of Pre-released CDR (following internationally agreed assessment procedure supervised by GRP) Capturing user feedback and assessment of CDR impact in applications Main outcome: Assessment Report – (To be reviewed by e.g. GRP and/or GCOS panels AOPC, OOPC, TOPC) (Release) Endorsement ? Confirmation or Rejection SCOPE-CM CDR generation project ( ≙ transition step) SCOPE-CM Pilot Project

Way forward General agreement on the concept for SCOPE-CM Phase 2 in the Executive Panel (including the stakeholders WMO Space Programme, GCOS, CGMS, CEOS, GEWEX) Draft Implementation proposal for SCOPE-CM Phase 2 –including the achievements and accomplishments of Phase 1 –Takes into account developments e.g. WMO/COES Climate Space Infrastructure, GCOS IP update, WMO GFCS,... Review by SEP Review and approval by WMO

SCOPE-CM Phase 2 Proposed Organizational Chart SCOPE-CM Executive Panel (SEP) S-Center Project Development Partnerships S-Center Continuous Projects Working Group on Data Management Other International Coordination? SCOPE Presentation Template - SCOPE CM 26 SCOPE-CM Executive Panel GCOSWMOCEOS

Questions to Consider for SCOPE-CM and GRP (a) continued involvement of the science community to diagnose new problems as they arise (b) periodic assessments and procedures to make sure the data are still relevant (c) periodic research announcement for more formal product improvement efforts (d) Tracking of progress in a quantifiable manner.