Download presentation
Presentation is loading. Please wait.
Published byAmanda Harrell Modified over 9 years ago
1
1 Accomplishments
2
2 Overview of Accomplishments Sustaining the Production Earth System Grid Serving the current needs of the climate modeling community Three operational portals with 16,000 registered users have delivered > 0.7 PB of data to date Developing and Deploying the Next Generation Earth System Grid Addressing the future needs of the climate modeling community Scaling out and extending the capabilities of the Earth System Grid Meeting needs and timeline for CMIP5/AR5
3
3 Sustaining the Production Earth System Grid The production ESG has become the source for model data for the world- wide climate modeling community Over 16,000 users from more than 500 sites The ESG-CET team currently operates three distinct ESG installations, serving different collections of data WCRP CMIP3 portal Main ESG portal (CCSM, POP, CISM, CLM, NARCCAP, PCM) C-LAMP portal ESG usage: over 500 sites worldwide
4
4 WCRP CMIP3 Portal World Climate Research Program (WCRP) Coupled Model Intercomparison Project, Phase 3 (CMIP3) Results from 12 sets of numerical experiments performed using 23 different global coupled ocean- atmosphere models Input to Intergovernmental Panel on Climate Change (IPCC) 4 th Assessment Report (AR4) Over 300 peer reviewed papers derived from this collection went into AR4 Nobel Peace Prize 2007 Portal located at LLNL Program for Climate Model Data Intercomparison (PCMDI)
5
5 WCRP CMIP3 Portal Statistics Data holdings: 35 TB 74,000 files 12 experiments 23 models 13 countries 3,000+ registered analysis projects (users) ~500 scientific papers to date Downloads to date: 0.6+ PB 1.8M+ files Avg ~500 GB/day
6
6 Main ESG Portal Hosts data collections for many of our key collaborators Community Climate System Model (CCSM) Parallel Climate Model (PCM) Parallel Ocean Program (POP) Community Sea Ice Model (CSIM) Community Land Model (CLM) North American Regional Climate Change Assessment Project (NARCCAP) Distribution point for models, data processing tools Portal located at NCAR, data nodes at LANL, NCAR, NERSC, ORNL
7
7 Main ESG Portal Statistics Data holdings: 198 TB 1,032,000 files 6+ years of joint DOE/NSF climate modeling experiments Recently added 6- hourly CCSM datasets 13,000 registered users Downloads to date: 100 TB 2,400 downloads of CCSM code & input datasets
8
8 C-LAMP Portal Carbon-Land Model Intercomparison Project (C-LAMP) Evaluation of biogeochemical models A sub-project of the SciDAC CCSM project, using computational resource of the ORNL LCF Computational Climate End Station (CCES) Portal located at ORNL Currently used by working group, plan to open up to public soon Data holdings: 149 GB 1,575 files
9
9 Developing and Deploying the Next Generation Earth System Grid Climate community plans (CMIP5) drive ESG to a new scale of operation CMIP5 also gives us an aggressive timeline Initial ESG-CET focus on addressing core needs for… New software architecture Extending data model Federation mechanisms for users, (meta)data Future work on… Analysis and visualization services Extending to WG2 (impacts) and WG3 (mitigation) user communities
10
10 Gateway Web Application The next-generation gateway has been extensively revised… Provides a better user experience for searching and browsing Global federation of metadata, user authentication Richer metadata model
11
11 New Data Node with Greatly Expanded Capabilities Next-generation data nodes provide much more capability than current production system Data publication and metadata harvesting Server-side processing capabilities based on LAS, Ferret, CDAT Data delivery Integrated with security infrastructure
12
12 New Security Architecture for Single Sign-On Across Federation Single sign-on (SSO) for both web and rich client access OpenID for web SSO MyProxy (PKI) for rich client SSO Federation of many sites, some already having their own user bases Web services for user attributes retrieval
13
13 ESG Domain Model and Architecture for Federation Comprehensive domain object model, including Scientific metadata Location metadata Access Control metadata Metrics metadata Collaboration with Curator, MetaFor projects on… Ontologies (being integrated into ESG search & browse) Hierarchical grid specifications Metadata for atmospheric dynamical cores Extract search & discovery metadata, share through OAI- PMH for federation
14
14 BeStMan: New Tool for Accessing Deep Storage Storage Resource Manager (SRM) spec. developed by Open Grid Forum BeStMan is Berkley implementation of SRM standard, in collaboration with SciDAC SDM Center Provides end-to-end management of complex data movements Many files, large files Data Mover Lite (DML) GUI client Manages data movement for production ESG Basis for next-generation bulk data movement solution
15
15 Outreach, Presentations and Publications Representing ESG’s work and perspective to the world- wide climate, computer science, and SciDAC communities… 14 papers 30 presentations 8 posters 21 other outreach activities
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.