DTC HWRF Task AOP2009 & AOP2010 10/01/2009 Ligia Bernardet.

Slides:



Advertisements
Similar presentations
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Advertisements

Unveiling ProjectWise V8 XM Edition. ProjectWise V8 XM Edition An integrated system of collaboration servers that enable your AEC project teams, your.
Hui Shao Developmental Testbed Center GSI: Code Management and Transitions between Research and Operations 2011 Summer Community GSI Tutorial, June 29-July.
Notes by Ligia Bernardet Recommendations from breakout group 2 Session 2 (Thu, 10/25/2012) Our group.
NCEP/EMC Operational Hurricane Weather Research and Forecast (HWRF) Modeling System 1 Vijay Tallapragada JCSDA-HFIP Workshop on Satellite Data Assimilation.
DTC AOP GSI October 1, FY09 Funding Resource/Tasks AFWA (February January 2010): – GSI code management and support (1.1FTE)
Demonstration Testbed for the Evaluation of Experimental Models for Tropical Cyclone Forecasting in Support of the NOAA Hurricane Forecast Improvement.
1 WRF Development Test Center A NOAA Perspective WRF ExOB Meeting U.S. Naval Observatory, Washington, D.C. 28 April 2006 Fred Toepfer NOAA Environmental.
VisIt Software Engineering Infrastructure and Release Process LLNL-PRES Lawrence Livermore National Laboratory, P. O. Box 808, Livermore,
Ligia Bernardet 09 January 2012 HFIP Ensemble Team meeting GSI-hybrid code management: what can we learn from learn from HWRF?
1 Short term plan to assist 2011 HWRF implementation HFIP Stream 1 Regional Hurricane Model Diagnostics Planning Meeting, 11/08/2010.
1 CMPT 275 Software Engineering Revision Control.
EMC’s Offsite Computing Update HPC RAC 05 January 2012.
Tolman, May 7, 2015MAPP Webinar, 1/14 Transition to operations at EMC What works and what does not work Hendrik L. Tolman Director, Environmental Modeling.
Version control Using Git 1Version control, using Git.
Progress Towards a High- Resolution HWRF Samuel Trahan, Vijay Tallapragada (EMC/NCEP/NOAA) S.G. Gopalakrishnan and X. Zhang (HRD/AOML/NOAA)
Bill Kuo DTC: Overview and AOP Outlines The DTC Management Structure The expected outcome of the DTC Management Board (MB) meeting DTC 2009 budget.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
Bill Kuo Developmental Testbed Center: Overview, Status and Future Direction.
CCSM Software Engineering Coordination Plan Tony Craig SEWG Meeting Feb 14-15, 2002 NCAR.
Bill Kuo Summary of DTC EC Meeting 26 th August 2010.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Future support of EGI services Tiziana Ferrari/EGI.eu Future support of EGI.
EMI INFSO-RI EMI SA2 Report Quality Assurance Alberto Aimar (CERN) SA2 WP Leader.
Model testing, community code support, and transfer between research and operations: The Tropical Cyclone Modeling Testbed (TCMT) and the Developmental.
EMI INFSO-RI EMI Quality Assurance Processes (PS ) Alberto Aimar (CERN) CERN IT-GT-SL Section Leader EMI SA2 QA Activity Leader.
I.Boulder Community GSI Code Repository II.GSI Regression Test Suite III.GSI Code Release IV.GSI Community Support V.Collaborative Efforts.
1 Software Development Configuration management. \ 2 Software Configuration  Items that comprise all information produced as part of the software development.
64’th IHC, March William Lapenta,Naomi Surgi and Stephen Lord Environmental Modeling Center NOAA/NWS/NCEP Linking The HFIP Community With NCEP/EMC.
Bill Kuo DTC Management Board Meeting 17 th March 2011.
Version control Using Git Version control, using Git1.
CONNECT Roadmap Draft version as of February 4 th,
The LCG SPI project in LCG Phase II CHEP’06, Mumbai, India Feb. 14, 2006 Andreas Pfeiffer -- for the SPI team
A Public Release of WRF Portal Jeff Smith and Mark Govett June 24, 2008.
General Policy on Paper Writing by the Atmos Group Draft for discussion (May 3, 2015) (Phil Rasch and Shaocheng Xie) The following procedures are made.
CESM/ESMF Progress Report Mariana Vertenstein NCAR Earth System Laboratory CESM Software Engineering Group (CSEG) NCAR is sponsored by the National Science.
Overview on the Work of WG 6 Reference Version and Implementation WG Coordinator: Ulrich Schättler.
Summary of EMC-DTC Meeting June 18, DTC AOP 2010 Tasks to be continued from 2009: – WRF-NMM + WPP community support (Jamie Wolff) – Reference configurations.
Ligia Bernardet, S. Bao, C. Harrop, D. Stark, T. Brown, and L. Carson Technology Transfer in Tropical Cyclone Numerical Modeling – The Role of the DTC.
Donald Stark National Center for Atmospheric Research (NCAR) The Developmental Testbed Center (DTC) 15 January, 2014 Building the HWRF Components.
Hurricane Forecast Improvement Project (HFIP): Where do we stand after 3 years? Bob Gall – HFIP Development Manager Fred Toepfer—HFIP Project manager Frank.
1 11/25/2015 Developmental Testbed Center (DTC) Bob Gall June 2004.
WG 6 and Support Activities Overview Status Report Reference Version and Implementation WG Coordinator and Project Leader: Ulrich Schättler.
WG 6 and Support Activities Plans for the next Year.
1 Report: JAG/OCM Operational Community Modeling COPC Meeting AFWA, Omaha, NB 2 May, 2007.
Ligia Bernardet 1, V. Tallapragada 2, Y. Kwon 3, S. Trahan 3, Q. Liu 2, Z. Zhang 3, X. Zhang 4, S. Gopalakrishnan 2, R. Yablonsky 5, B. Thomas 5, T. Marchok.
Community Codes Free and shared resource Ongoing distributed development by both research and operational communities – Maintained under version control.
1 National Environmental Modeling System (NEMS) Status M. Iredell and EMC Staff.
Lecture 13.  Failure mode: when team understands requirements but is unable to meet them.  To ensure that you are building the right system Continually.
Toward GSI Community Code Louisa Nance, Ming Hu, Hui Shao, Laurie Carson, Hans Huang.
Curator: Gap Analysis (from a schema perspective) Rocky Dunlap Spencer Rugaber Georgia Tech.
1 Building Supportive and Synergistic Processes: Service Level Agreements Operational Processes Performance Measures Climate Service Meeting Feb 16-17,
DTC Overview Bill Kuo September 25, Outlines DTC Charter DTC Management Structure DTC Budget DTC AOP 2010 Processes Proposed new tasks for 2010.
1 NCEP’s Climate Forecast System as a National Model “Where America’s Climate, Weather and Ocean Services Begin” 32 nd Climate Diagnostics and Prediction.
DET Module 1 Ensemble Configuration Linda Wharton 1, Paula McCaslin 1, Tara Jensen 2 1 NOAA/GSD, Boulder, CO 2 NCAR/RAL, Boulder, CO 3/8/2016.
The NOAA Environmental Modeling System at NCEP Mark Iredell and the NEMS group NOAA/NWS/NCEP Environmental Modeling Center June 12, 2014.
Building PetaScale Applications and Tools on the TeraGrid Workshop December 11-12, 2007 Scott Lathrop and Sergiu Sanielevici.
Fostering Collaboration Between Operational NWP and Academic Communities Isaac Ginis University of Rhode Island 61 st Interdepartmental Hurricane Conference,
Bill Kuo 1, Steve Koch 2, Barb Brown 1, Louisa Nance 1 Developmental Testbed Center 1. National Center for Atmospheric Research 2. Earth System Research.
Project Management Approach
Developmental Testbed Center: Governance highlights
Software Project Configuration Management
Chapter 18 Maintaining Information Systems
UNIFIED GLOBAL COUPLED SYSTEM (UGCS) FOR WEATHER AND CLIMATE PREDICTION Saha-UMAC-09Aug2016.
Version control, using Git
Building a Distributed Earth System Model Community
Applied Software Implementation & Testing
Mariana Vertenstein CCSM Software Engineering Group NCAR
Course: Module: Lesson # & Name Instructional Material 1 of 32 Lesson Delivery Mode: Lesson Duration: Document Name: 1. Professional Diploma in ERP Systems.
Metadata Development in the Earth System Curator
Presentation transcript:

DTC HWRF Task AOP2009 & AOP /01/2009 Ligia Bernardet

AOP I DTC HWRF Team – 1.4 FTE Ligia – Task Lead 30% Shaowu – Scientist 90% Louisa – Planning and coordination 5% Laurie – Software Engineer Support – 10% Chris Harrop – 5% Main Goal Port, test, and prepare the NCEP Hurricane WRF (HWRF) modeling system for support to the community

AOP II 1. Code Management – An agreement on HWRF code management will be drafted between EMC and DTC. The goal of this agreement is to create a framework that supports exchange between the operational and research communities. ✓ – A plan for community support of POM coupler will be drafted with URI. ✓ – A plan for community support of GFDL Vortex Tracker will be drafted with GFDL. ✓ 2.Atmospheric Model – Atmospheric HWRF will be included in a branch ( ✓ )of the WRF repository, tested, and added to the trunk ( ✗ ) of the WRF repository (v3.1.1+), making HWRF a compile-time and run-time configuration of WRF. These capabilities include HWRF dynamics, including vortex-tracking moving nest Ability to run in coupled mode HWRF physics schemes Support for binary I/O Model restart

AOP III 3. Pre-processing – The Domain Wizard capability will be extended to support the HWRF domain configuration. ✓ 4.Additional HWRF components – The non-WRF components of HWRF (initialization, coupler and POM ocean model) will be ported to and tested on the ESRL and NCAR DTC computer platforms. ✓ More tests will be done. 5.Testing – A hierarchy of tests will be developed and performed to ensure that the HWRF configuration is not unintentionally modified and to asses the performance of the HWRF configuration. These tests include: Sanity checks to be performed using the branch code before it is moved to the trunk, first just with the WRF model and then incorporating the coupler, ocean, and vortex initialization components. ✓ Regression tests to be run before and after HWRF capabilities are added to the repository. ✗ Large test (approximately 250 cases) using repository code to verify if HWRF configuration from the repository gives results comparable to operational version, so that operational code for 2010 hurricane season can be drawn from repository. Underway.

AOP IV 6. WRF for Hurricanes Tutorial to occur in FY2010 – Planning will be conducted jointly with external collaborators (NCAR MMM, GFDL, AOML, URI) ✓ 7.Begin preparations for HWRF community support: – Scientific documentation ✓ – Users’ Guide ✓ – Helpdesk – Online Tutorial – Test cases

AOP Remarks Plan counted with participation of 1 Software Engineer. Don (50%) will help. EMC HWRF Team has put considerable effort into this Task. While this was expected in the first year of the project, it is anticipated that their participation will taper off in FY Propose increasing Ligia’s participation (concentrated until February) to perform additional tasks of: – Editing Users’ and scientific documentation. Since these documents will have contribution from multiple sources, an editor will be needed. – Assisting in preparation of classroom exercises. The increase in Ligia’s time and SE time is not really an “increased effort” but a necessity to fill gaps and meet deadlines. Proposed FY 2010 DTC HWRF Team – 2.05 FTE Ligia – Task Lead 40% Shaowu – Scientist 100% Laurie – Software Engineer– 10% Chris - Software Engineer– 5% Don – Software Engineer - 50%

AOP 2010: Scenario 1 First Quarter Participate in the preparation and result-evaluation of the Big R2O test. Complete tests of the ported POM-TC model to assure that the HWRF ocean component has been ported successfully to wjet and Bluefire. Prepare Vortex Initialization (VI) code for community distribution. Setup code repositories for tracker, coupler, POM, and VI. Merge the HWRF repository branch to the WRF repository trunk. Work on HWRF technical and scientific documentations. Plan Tutorial. Second Quarter Plan Tutorial. Finalize the HWRF documentations. Prepare tutorial materials and lectures. Deliver the WRF for Hurricanes. Provide HWRF user support by updating technical documentation (Users' Guide), developing and maintaining HWRF website, helpdesk, and test cases. Conduct monthly repository testing. *** could take longer!

AOP 2010: Scenario 1 Third Quarter Provide HWRF user support. Begin work collaboratively AOML to include a high-resolution movable grid-nesting algorithm capability (three telescopic domains) in the WRF-NMM system. Begin the work bringing HYCOM to DTC. Conduct monthly repository testing Fourth Quarter Provide HWRF user support. Finalize inclusion of a high-resolution movable grid-nesting algorithm capability (three telescopic domains) in the WRF-NMM system. Continue HYCOM effort. Conduct monthly repository testing

AOP 2010: Scenario 2 Incorporate support of MPI binary IO to WPP V3. (0.05 FTE SE) Clean up of GFDL Tracker code. (0.1 FTE SE) Clean up ocean initialization code. (0.1 FTE) Develop a HWRF coupled system infrastructure at the DTC (scripts, automation, collection of data) using the GSD workflow manager framework. (0.25 FTE SE) (Mike Page) Extend community HWRF capabilities to other basins and to realtime runs and creating new canned cases. Also expand HWRF support to more compilers and platforms. (1 FTE split SE/scientist) Extend testing capability to reproduce EMC’s. (0.5 FTE) Accelerate implementation of 3 rd nest in HWRF to Q3. (0.25 FTE) Complete transition of HYCOM to DTC supported code. (1 FTE split SE/scientist) Create hurricane Reference Configurations. Use the Big R2O Test to create a baseline of performance. Test system with variations in… (1 FTE for 4 RC) – Horizontal resolution (3 rd nest) – Vertical resolution – Physics – Initialization – Etc TBD