FY2010 Metrics Reporting Review Greg Hunolt, SGT ES-DSWG / MPARWG October, 2010

Agenda FY2010 Metrics Reporting Status Reporting to NASA HQ Impact Metrics Observations Outlook for FY2011

FY2010 Metrics Reporting Status: Products & Services Metrics 1. MEaSUREs Projects – 30 active projects: 16 projects are now distributing products, –7 are REASoN continuations, 9 are new projects, –11 projects have begun public distribution, 5 limited distribution. –Of those 11, 9 projects are now reporting metrics. 2 projects may have begun distribution in September 12 projects expected to begin distribution in FY2011

FY2010 Metrics Reporting Status: Products & Services Metrics, Cont. 2. ACCESS Projects – 3 Sets, ACCESS-05, ACCESS-07 ACCESS-09 ACCESS-05 Projects: –16 projects at start,14 have completed. –2 projects continue to report post nominal completion; they may continue into FY2011. ACCESS-07 Projects: –10 projects at start, 8 had FY2010 completion dates, 3 in FY2011; –Sporadic metrics reports from 4 projects, initial reports from 4 projects; –2 projects expected to start reporting, others may post-completion? ACCESS-09 Projects: –11 projects at start, completion dates in FY2012; –Initial reports received from 9 projects, –3 projects may have begun reporting in September, the rest expected to begin reporting in FY2011.

FY2010 Metrics Reporting Status: Products & Services Metrics, Cont. 3. REASoN Projects: –42 REASoNs at program start; –7 REASoNs transitioned to MEaSUREs projects, –29 REASoNs were completed by end of FY2009, –So 6 REASoNs were active during FY2010. –Of those 6 active projects, all reported metrics. –2 REASoNs completed and stopped reporting during FY2010. –1 REASoN remains with nominal completion date in FY2011. –3 REASoN’s may continue “voluntary” reporting in FY2011. Greg will be doing 4 th quarter / end-of-year review, and contacting all projects next week.

Reporting to NASA Headquarters Reportees are Martha Maiden for MEaSUREs projects and Steve Berrick for ACCESS projects. Martha Maiden (last MPARWG) asked for: Impact Metrics (now using quad-chart format), Aggregate Statistics derived from reported metrics, Highlights for particular projects. So: –Projects are requested to provide Impact Metrics to Rama who forwards selected Impact Metrics to Martha (example follows). –Greg began in June to produce monthly report on aggregate statistics and a project highlight in quad-chart format, draft to Rama, who forwards final version to Martha (examples follow). –Projects can suggest highlights to Greg using E-books, supplemental comments, . –Steve Berrick’s requirements to be discussed later.

MEaSUREs – April - June 2010 Making Earth System data records for Use in Research Environments MEaSUREs Support NASA Earth Science: Metrics Summary (All Reporting MEaSUREs): Program Progress / Status: During 3 rd Quarter of FY2010, average of: 349 product types available 29,478 distinct users per month 3,073,133 products delivered per month 8.7 TB volume distributed per month Projects create Earth System Data Records (ESDRs) – each a unified and coherent time series of observations of a given Earth system parameter; ESDR’s are critical to: Understanding Earth System Processes; Assessing variability, long term trends, and change in the Earth System; Provide input and validation means to Earth System modeling. 30 Active MEaSUREs Projects – most currently developing new ESDRs. 12 Projects now distributing products, 7 are REASoN continuations, 5 are new projects distributing early versions of new products, on a limited basis for evaluation. 8 more projects expected to begin distributing initial products for evaluation during FY2010, and 10 during FY2011. GPS Explorer permits exploration of ESDR products derived from verified and validated GPS time series P.I. Frank Webb - Solid Earth Science ESDR System Provided first long-term surface deformation ESDRs for understanding earthquakes and tectonic motion, and access via the GPS Explorer. August 16, 2010 A MEaSUREs Project Highlight for the Quarter:

MEaSUREs – July 2010 Making Earth System data records for Use in Research Environments MEaSUREs Support NASA Earth Science: Metrics Summary (All Reporting MEaSUREs): Program Progress / Status: During May – July 2010, average of: 356 product types available 31,687 distinct users per month 3,407,454 products delivered per month 6,768,529 GPS locations delivered / mo TB volume distributed per month Projects create Earth System Data Records (ESDRs) – each a unified and coherent time series of observations of a given Earth system parameter; ESDR’s are critical to: Understanding Earth System Processes; Assessing variability, long term trends, and change in the Earth System; Provide input and validation means to Earth System modeling. 30 Active MEaSUREs Projects – most currently developing new ESDRs. 16 Projects now distributing products, 7 are REASoN continuations, 9 are new projects distributing early versions of new products, on a limited basis for evaluation. 2 more projects expected to begin distributing initial products for evaluation during FY2010, and 12 during FY2011. Global map of monthly PAR at the ocean surface (Feb 2010) from SeaWiFS and MODIS/Aqua data. P.I. Robert Frouin - Photosynthetically Available Radiation (PAR) at the Ocean Surface First Level 2 and Level 3 PAR products now available. Goal is 12 year time series from SeaWiFS and Terra/Aqua MODIS. September 14, 2010 A MEaSUREs Project Highlight for the Quarter:

New Impact Metrics Format and Process NASA HQ has approved the quad-chart format for Impact Metrics recommended by the MPARWG. Template and example of a quad-chart format Impact Metric (next chart) are on the ESDSWG / MPARWG website at Impact Metrics are no longer reported via the MCT. The new Impact Metric Process is: –Projects send in quad chart Impact Metrics to E-Books, indicating proprietary / non-proprietary; –Rama will forward selected Impact Metrics to NASA HQ, Martha Maiden or Steve Berrick. –Impact Metrics marked non-proprietary will be posted to the new Gallery on the community systems website.

CLIMODE Project Depends on DISCOVER SSTs Helped cruised scientists forecast changes in the Gulf Stream path and thereby reduce ship fuel use; 6 CLIMODE cruises supported since November 2005 DISCOVER – P.I.: Frank Wentz, Remote Sensing Systems Impacts of DISCOVER Data on CLIMODE Project Relevance to NASA Goals Daily SST data are distributed to cruise scientists to help determine ship course and instrument deployment 6 CLIMODE cruises supported since November 2005 Helped scientists forecast changes in the Gulf Stream path and thereby reduce fuel use Helped scientists adapt measurement strategies in response to changes in the Gulf Stream pat MEaSUREs – for passive microwave ocean products TMI and AMSR-E satellite data are blended to produce a diurnally-corrected microwave optimally-interpolated (MW OI) SST product CLIMODE web site: Example of plots made by the project: DISCOVER web site: earth.org/ CLIMODE cruise track overlaid on DISCOVER Sea Surface Temps Jan 24, 2006 CLIMODE (CLIvar MOde water Dynamic Experiment) NSF funded project to improve understanding of the air-sea exchange and cross-frontal mixing in the wintertime Gulf Stream. Further Information Contributes to improved understanding of ocean physics which will aid in improving climate models Increases our understanding of the role of oceans and atmosphere in the climate system and improves our predictive capability Science Application This work applies to weather and disaster management application areas

Observations and Looking Ahead to FY2011 FY2010 was a transition year – as will be FY2011. –New MEaSUREs are beginning distribution, usually on a limited basis, all 30 will be distributing and should be reporting metrics in the coming year. –ACCESS-09 projects are developing, all 11 should begin metrics reporting in the coming year. –Very few REASoN’s and ACCESS-05 projects are left, in some cases capabilities they developed have been picked up by DAACs. –Most ACCESS-07 projects are completing. Some “mixed” reporting will begin in FY2011, as some projects transition product archiving and distribution to a DAAC. –Some dynamic metrics (i.e. distinct users, products delivered, volume delivered) will be derived from the EMS. –Projects will continue to use the MCT to enter and as needed update more “static” metrics.

Observations and Outlook for FY2011, Continued The Service and Project-Defined Metrics continue to be successful (to the extent that they were used) in helping projects to portray their activity. Use by MEaSUREs could be encouraged. –Using Service metrics allows a project to distinguish its services from its products; –Using Project-Defined metrics allows a project to define metrics that make sense in the project’s own context. Greg will continue to provide background / offer assistance with the metrics. Jody Garner and Randy Barth will continue to help projects with passwords, etc., and making sure they can access the reporting tool. Next week, Greg will begin a 4 th quarter, “year end” review of the metrics reports for months through September, and will contact all of the projects.