1 Community Modeling in the Atmospheric Sciences Stan Solomon High Altitude Observatory National Center for Atmospheric Research SHINE Meeting Whistler,

Slides:



Advertisements
Similar presentations
Weather Research & Forecasting: A General Overview
Advertisements

The CTCN Services UNEP – March 5th, 2014, Nairobi, Kenya.
The NCAR TIE-GCM: Model Description, Development, and Validation
EInfrastructures (Internet and Grids) US Resource Centers Perspective: implementation and execution challenges Alan Blatecky Executive Director SDSC.
July 11 th, 2005 Software Engineering with Reusable Components RiSE’s Seminars Sametinger’s book :: Chapters 16, 17 and 18 Fred Durão.
Chapter 6: Design of Expert Systems
1 WRF Development Test Center A NOAA Perspective WRF ExOB Meeting U.S. Naval Observatory, Washington, D.C. 28 April 2006 Fred Toepfer NOAA Environmental.
© 2012 National Ecological Observatory Network, Inc. ALL RIGHTS RESERVED. THE DATA ASSIMILATION RESEARCH TESTBED (DART) FOR ECOLOGICAL FORECASTING Andy.
Jordan G. Powers Mesoscale and Microscale Meteorology Division NCAR Earth System Laboratory National Center for Atmospheric Research Space Weather Workshop.
SE-02 CONFIGURATION MANAGEMENT Today we talk about Software Configuration Management (SCM for short): - What? - Why? - How?
Computing in Atmospheric Sciences Workshop: 2003 Challenges of Cyberinfrastructure Alan Blatecky Executive Director San Diego Supercomputer Center.
CXC Implementing 2007 NRC Portals of the Universe Report Chandra X-ray Center Recommended Best Practices Roger Brissenden and Belinda Wilkes 25 April 2012.
Reorganization at NCAR Presentation to the UCAR Board of Trustees February 25, 2004.
Providing Access to Your Data Matthew Mayernik National Center for Atmospheric Research Version 1.0 Review Date.
18:15:32Service Oriented Cyberinfrastructure Lab, Grid Deployments Saul Rioja Link to presentation on wiki.
CCSM Software Engineering Coordination Plan Tony Craig SEWG Meeting Feb 14-15, 2002 NCAR.
Effective User Services for High Performance Computing A White Paper by the TeraGrid Science Advisory Board May 2009.
Providing Access to Your Data: Rights Robert R. Downs, PhD NASA Socioeconomic Data and Applications Center (SEDAC) Center for International Earth Science.
NE II NOAA Environmental Software Infrastructure and Interoperability Program Cecelia DeLuca Sylvia Murphy V. Balaji GO-ESSP August 13, 2009 Germany NE.
+ Best Practices in Regional Climate Modeling Dr. Michel d. S. Mesquita Bjerknes Centre for Climate Research, Uni Research
1 Addressing Critical Skills Shortages at the NWS Environmental Modeling Center S. Lord and EMC Staff OFCM Workshop 23 April 2009.
Navigation and Ancillary Information Facility NIF SPICE Introduction January 2008.
Semantic Cyberinfrastructure for Knowledge and Information Discovery (SCiKID) Proposal Principle Investigator: Eric Rozell Tetherless World Constellation.
Altitude (km) January Global AverageTemperature (K) Pressure (hPa) With O( 3 P) Cooling WACCM-X The Whole Atmosphere Community Climate Model – eXtended.
ExOB Discussions on Development Test Center WRF ExOB Meeting U.S. Naval Observatory, Washington, D.C. 28 April 2006.
Semantically-Enabled Science Data Integration (SESDI) and The Virtual Solar-Terrestrial Observatory (VSTO) Semantically-enabled (large-scale) Scientific.
Providing Access to Your Data Matthew Mayernik National Center for Atmospheric Research Copyright 2012 Matthew Mayernik. Version 1.0 October 2012 Section:
Data Publication and Quality Control Procedure for CMIP5 / IPCC-AR5 Data WDC Climate / DKRZ:
NanoHUB.org and HUBzero™ Platform for Reproducible Computational Experiments Michael McLennan Director and Chief Architect, Hub Technology Group and George.
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
Geosciences - Observations (Bob Wilhelmson) The geosciences in NSF’s world consists of atmospheric science, ocean science, and earth science Many of the.
National Center for Supercomputing Applications Barbara S. Minsker, Ph.D. Associate Professor National Center for Supercomputing Applications and Department.
Jamie Hall (ILL). SciencePAD Persistent Identifiers Workshop PANData Software Catalogue January 30th 2013 Jamie Hall Developer IT Services, Institut Laue-Langevin.
INTO THE NEW YEAR January 3, Objectives Reaffirm principles –China’s interest in exploring ESIP structure prompted review of ESIP evolution (more.
3/30/04 16:14 1 Lessons Learned CERES Data Management Presented to GIST 21 “If the 3 laws of climate are calibrate, calibrate, calibrate, then the 3 laws.
3 rd Annual WRF Users Workshop Promote closer ties between research and operations Develop an advanced mesoscale forecast and assimilation system   Design.
Thermospheric General Circulation Models (TGCM’s) Brief History of Software Development Current State of the Codes Software Challenges and Development.
What is CDR? – A Few Examples Water Resources in a Changing Climate – Idaho Climate Change Large CD consortia — not the case that everyone works on everything.
- Vendredi 27 mars PRODIGUER un nœud de distribution des données CMIP5 GIEC/IPCC Sébastien Denvil Pôle de Modélisation, IPSL.
1 Critical Water Information for Floods to Droughts NOAA’s Hydrology Program January 4, 2006 Responsive to Natural Disasters Forecasts for Hazard Risk.
1 Olga King Jet Propulsion Laboratory Office Of Export Compliance April 27, 2011.
Assessment of Technology Options 1 Naomi Radke, seecon international GmbH.
INFORMATION AND NETWORKING Jack Fitzgerald UNFCCC Workshop on the Preparation of National Communications from Non-Annex I Parties Manila, Philippines 26.
NCAR Realignment. Reasons for Considering Realignment National Science Board call for a review of how ATM supports the field in the 21 st Century UCAR.
Responsible Data Use: Copyright and Data Matthew Mayernik National Center for Atmospheric Research Version 1.0 Review Date.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
U.S. Grid Projects and Involvement in EGEE Ian Foster Argonne National Laboratory University of Chicago EGEE-LHC Town Meeting,
Copyright and Data Matthew Mayernik National Center for Atmospheric Research Section: Responsible Data Use Version 1.0 October 2012 Copyright 2012 Matthew.
And How Do I Use It? Trudy Griebenow Library Media Specialist.
Preliminary Findings Baseline Assessment of Scientists’ Data Sharing Practices Carol Tenopir, University of Tennessee
R&D Annual Report SLaM Board, Sept 2004 Graham Thornicroft Gill Dale.
Integrating Cyberinfrastructure Technologies Mark C. Sheehan, Ph.D. ECAR Fellow EDUCAUSE Live! December 18, 2008 © 2008 EDUCAUSE. All rights reserved.
LIGO-G M Managing LIGO: Lessons for a Collaboratory Gary Sanders LIGO/Caltech NEES Awardees Meeting NSF, December 19, 2001.
StratusLab is co-funded by the European Community’s Seventh Framework Programme (Capacities) Grant Agreement INFSO-RI StratusLab Sustainability.
โอเพนซอร์สและการคิดแบบ โอเพนซอร์ส ธวัชชัย เอี่ยมไพโรจน์
Forging New, Non-Traditional Partnerships among Physicists, Teachers and Students Marjorie Bardeen, Fermilab quarknet.i2u2.org.
Challenges of open science
Open Source Software An innovation for teaching and learning with the use of technology.
Community Science Updates
Quarterly Meeting Focus
Associate Director for Research, Education and Marine Operations
2 8 thousands hundreds tens ones
improve the efficiency, collaborative potential, and
Design and Implementation
SPICE Introduction October 2007.
GFDL Climate Model Status and Plans for Product Generation
Systems Engineering for Mission-Driven Modeling
NOTICE! These materials are prepared only for the students enrolled in the course Distributed Software Development (DSD) at the Department of Computer.
Presentation transcript:

1 Community Modeling in the Atmospheric Sciences Stan Solomon High Altitude Observatory National Center for Atmospheric Research SHINE Meeting Whistler, BC 30 July 2007

2 Why Consider Community Models for Solar/Terrestrial Physics? Continuing analogy with the weather and climate modeling field Examples of successful shared code models in solar and astrophysics (e.g., FLASH, CHIANTI) Several open-source efforts in applications software and operating systems (e.g., GNU, Linux) Increasing agency pressure E.g., language in NASA Living with a Star Strategic Capabilities AO: “...all source code must be delivered...for unrestricted use by NASA.” This is pretty strong; not clear if it will be implemented In short, there are signs that parts of the research world are headed in this general direction, and disciplines need to consider carefully the options and choices.

3 What is a Community Model? Presupposes that there is a Community In this context, presume that it is a Community of scientific researchers Necessary that more than one institution is involved Implies some degree of support for users But there is considerable deviation about the mean here Range spans from “you can have it but you’re on your own” to a full-time staff devoted to helping users Implies that tools (e.g., source code) will be shared among the Community In the atmospheric sciences, the concept of a community model often implies that there is participation from the general community in the development, testing, improvement, and goals of the endeavor.

4 Software Distribution There are several software distribution paradigms: Proprietary Distribute only executable software or special-purpose hardware May or may not involve fees Open Source License Many types, ranging from very restrictive to completely unrestrictive May or may not involve fees Public Domain Completely unrestrictive May include disclaimers for protection There are also several physical distribution methods: Physical media On-line, but restricted using registration, accounts, or etc. On-line, wide open

5 How About the Support Problem? Many people I’ve talked to about Community Models are OK with the general concept but don’t want to spend their life answering dumb questions from novice users. It’s possible to start small, as a “community model with lower-case c” with the intent to integrate more support as resources permit. e.g., the Whole Atmosphere Community Climate Model It only seems possible to fully support a big-deal Community Model in the context of a stable long-term grant, a Government lab, or a FFRDC. Supercomputing resources also nice to have

6 A Few Examples from the Atmospheric Sciences Community Climate System Model (CCSM) Weather Research Forecast Model (WRF) Whole Atmosphere Community Climate Model (WACCM) Thermosphere-Ionosphere-Electrodynamics General Circulation Model (TIE-GCM)

7 The Community Climate System Model (CCSM) Large, active community involved in global climate simulations Central nucleus of full-time scientists, software engineers, support personnel Working groups, formal recommendations, change procedures, version control Major annual meeting Coding standards Documentation standards “Matrix” of license agreements

8 Weather Research Forecast Mode (WRF) High-resolution meteorology model designed and constructed by a medium-sized group at NCAR M 3 Can utilize sophisticated data assimilation techniques Openly available to anyone Commonly ported to local systems and adapted for specific uses Global terrestrial versions, global Mars version, other creative uses Limited support for users, but documentation and generalization is good Possibly the most successful model ever, with thousands of downloads and hundreds of installations

9 Whole Atmosphere Community Climate Model (WACCM) A single-code synthesis of CAM3, MOZART, and the TIME-GCM Currently extends from the surface to ~150 km altitude; goal is to cover the entire 0 – 500 km range including the thermosphere and ionosphere Small group of in-house developers and several more hangers-on Moderate-sized community involved in model use or model development Coding standards, version control, etc. Occasional working groups, meetings, and conferences Documentation is coming along Code available on the web (generally a version behind)

10 Thermosphere-Ionosphere-Electrodynamics General Circulation Model (TIE-GCM) Developed by Ray Roble, Bob Dickinson, Art Richmond, et al. Modest community using model or model results Small group of in-house developers and visitors Version control, cross- platform release (v. 1.8) Code base much improved Actually have a user manual now No formal distribution arrangement, but anyone who wants the code can have it

11 Does This Paradigm Work? In the US, the atmospheric sciences are blessed/cursed by a large federally- funded research and development center that can lead and coordinate these activities. The university community has mixed feelings about this, because it both provides services and consumes financial resources. There is no question that participation, collaboration, and education are facilitated by a Community Modeling approach. There is also no question that there are pitfalls, ranging from misuse or misinterpretation of results, to lack of appropriate credit, citation, or acknowledgement....but these have close analogies with isses in observational data distribution.

12 My Personal Experience with Numerical Models GLOW Model Started out as essentially a public domain model Based in part on code or equations that I got from other people Papers: 17 (+ many others) Citations: ~ three hundred Grants: 12 (incl. co-i’s & indirect) Worst thing that ever happened:...the undergrad class assignment Best thing that ever happened...grad student talk at AGU Monte Carlo Auroral Model Started out as private code that I never intended to share with others Some ideas came from the literature, but the code is 100% mine Papers: 4 (2 first author + 2 co-author) Citations: ~ three dozen Grants: 2 Worst thing that ever happened:...didn’t get second grant renewed Best thing that ever happened...finally gave code away Basic “lesson learned” from the last 20 years: Be specific about your expectations.