Summary of G3 work to date

Slides:



Advertisements
Similar presentations
TortoiseSVN By Group 1 Team B. Installing TortoiseSVN.
Advertisements

Part 5: Rose and shared repositories
By Steven Campbell and Erik Boone.  Sharing projects by putting them into a central repository.  Checking out copies of projects from the repository.
Version Control. What is Version Control? Manages file sharing for Concurrent Development Keeps track of changes with Version Control SubVersion (SVN)
European Organization for Nuclear Research Source Control Management Service (Subversion) Brice Copy, Michel Bornand EN-ICE 13 May 2009.
The Project AH Computing. Functional Requirements  What the product must do!  Examples attractive welcome screen all options available as clickable.
Version Control with Subversion. What is Version Control Good For? Maintaining project/file history - so you don’t have to worry about it Managing collaboration.
Subversion. What is Subversion? A Version Control System A successor to CVS and SourceSafe Essentially gives you a tracked, shared file system.
Sumedha Rubasinghe October,2009 Introduction to Programming Tools.
SKA/KAT SPIN Presentation Software Engineering (!?) Robert Crida.
Created by: Maria Abrahms Modified Date: Classification: How to get it done Contributing to OpenStack.
Subversion (SVN) Tutorial for CS421 Dan Fleck Spring 2010.
End HomeWelcome! The Software Development Process.
Object-Oriented Software Engineering Using UNIX groups and Subversion Estimated Time: minutes “Unix is user-friendly. It's just very selective about.
…using Git/Tortoise Git
Object-Oriented Analysis & Design Subversion. Contents  Configuration management  The repository  Versioning  Tags  Branches  Subversion 2.
(Sub)Version Control. 2 Keep large teams working on the same code Back up your work so you don't lose it all Compare changes to previous versions Revert.
Subversion in the Sur lab A tool for organizing and sharing analysis code.
Computer Science and Engineering The Ohio State University  Widely used, especially in the opensource community, to track all changes to a project and.
CVS – concurrent versions system Network Management Workshop intERlab at AIT Thailand March 11-15, 2008.
Version Control with SVN Images from TortoiseSVN documentation
CVS – concurrent versions system AROC Guatemala July 19-23, 2010 Guatemala City, Guatemala.
SWGData and Software Access - 1 UCB, Nov 15/16, 2006 THEMIS SCIENCE WORKING TEAM MEETING Data and Software Access Ken Bromund GST Inc., at NASA/GSFC.
When collaborating, it is important to manage changes in the models. For example: –To create or edit a submodel E.g. Habitat suitability is replaced with.
Sabriansyah R.A Version Control. The Repository Subversion adalah sistem tersentralisasi untuk informasi sharing Repository adalah pusat penyimpanan data.
12 CVS Mauro Jaskelioff (originally by Gail Hopkins)
Part 4: FCM and the UM University of Reading, December 2015.
Version Control and SVN ECE 297. Why Do We Need Version Control?
Subversion (SVN) Tutorial for CS421 Dan Fleck Spring 2010.
CVS repositories, and how to set them up for using CCPN.
Source Control Repositories for Enabling Team Working Doncho Minkov Telerik Corporation
© CGI Group Inc. User Guide Subversion client TortoiseSVN.
NALINI S. NAUTIYAL SYSTEM SOFTWARE DIVISION Subversion.
1 Ivan Marsic Rutgers University LECTURE 2: Software Configuration Management.
1 Subversion Kate Hedstrom April Version Control Software System for managing source files –For groups of people working on the same code –When.
Git A distributed version control system Powerpoint credited to University of PA And modified by Pepper 28-Jun-16.
SWIM Project Meeting, Bloomington, IN September 2006 Working with the SWIM Code Repository David E. Bernholdt Oak Ridge National Laboratory
L1Calo DBs: Status and Plans ● Overview of L1Calo databases ● Present status ● Plans Murrough Landon 20 November 2006.
Software Configuration Management -Subversion- RTLAB YuJin Park.
TRELLO. WHAT IS TRELLO!? Trello is a project management tool that makes collaboration easy. This visual list tool can do so much more, whether you're.
ACCESS NWP Suite Design
AI How to: System Update and Additional Software
Discussion #11 11/21/16.
Performance Data Collection and Reporting (PDCR)
Archiving and Document Transfer Utilities
CVS : Add new file Team -6 October 28, 2004.
SVN intro (review).
LECTURE 2: Software Configuration Management
Discussion 11 Final Project / Git.
Version control, using Git
CSE 303 Concepts and Tools for Software Development
Online Database Status
Building the UM within Rose/Cylc
CVS revisions UML diagram
Subversion.
Concurrent Version Control
ACCESS NWP Version Releases
Version Control System
LECTURE 3: Software Configuration Management
User Guide Subversion client TortoiseSVN
Concurrent Version System (CVS)
UM Practical Exercises
Git Best Practices Jay Patel Git Best Practices.
Presented by : Chirag Dani & Dhaval Shah
Introduction to the Rose suite
Performing Database Recovery
Concurrent Versions System
Daily Batch Process for Demand Forecasting
SPL – PS1 Introduction to C++.
Presentation transcript:

Summary of G3 work to date Fabrizio Baordo Jin Lee Susan Rennie

Working, not fully resolved Not working, in progress Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above Working Working, not fully resolved Not working, in progress Not started/tested

Overview Only running update suite to start with Primary suite u-aa116 developed by everyone Based on PS36 prototype mi-ae510 (at u-aa115) OPS/VAR/Surf 32 VAR from trunk (@112 or later) OPS from Xiao's branch for now Surf patched version from Imtiaz UM 10.1

Common Development approach From rosie go: 1) Checkout suite  to create your local working copy of u-aa116 2) Copy Suite  to create your suite (new trunk under share repository + local working copy), e.g. u-aaNNN The approach can be simplified as follows: Development and testing within your suite (u-aaNNN) Discuss/Review/Approval of changes in your suite (u-aaNNN) with other team members Commit changes back to u-aa116 and notify other member that an update of the control suite is available At any time of the development phase: u-aa116 (trunk, control) "svn merge" to bring your changes into the control suite "svn merge" to bring changes from other developers into your suite u-aaXXX (trunk) All testing done considering 1 basedate (YYYYMMDDHH) as a fixed reference (install_cold) to run 1 full assimilation cycle (OPS/VAR/SURF/UM)

Suite-level changes Use a site variable "bom" to identify local changes In suite*rc, insert extra bufr tasks (get bufr, bufr2odb replacing metdb2odb) via if {site} clause Create new apps with suffix "_bom" for any tasks with changes Comment out UK computing directives, add in PBS directives. Add pre-scripting (modules etc.) to set up UM runtime environment

Install cold: Not all components available yet Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above Install cold: Not all components available yet e.g. control files. Aim is to use JASMIN mirror on raijin, if archived on JASMIN. Otherwise put in MOSRS? Install start data: UK cold start files can be copied from MASS via JASMIN and archived locally. Manually at present. Install ostia: Can get UK versions from MASS via JASMIN. Alternatives, get files archived on JASMIN or use our own. ENGL cold start files need to be sourced similarly.

Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above Surf tasks Issue with reading very large ASCAT files. A source code change is necessary. We don’t have the latest Jules input files, so the Surf EKF has only ¼ of perturbations in suite. Otherwise runs okay.

Reconfiguration and forecast run ok Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above UM tasks Reconfiguration and forecast run ok Specification of ulimit in suite required. Upgrade recon wrapper script from later suite (u-aa437) as it is portable

CreateODB program testing in progress Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above New task to get bufr files from local archive, install in suite with appropriate renames. May require further updates to cover filename variations. OPS tasks BGE tasks run ok CreateODB program testing in progress Bufr files require changes (Tan helping) Most ob types don’t work straight off. Process tasks expected to work with min changes Stem tests being created

ODBCreate task Status From Xiao's branch: https://code.metoffice.gov.uk/svn/ops/main/branches/dev/yixiao/r175_bom_nci/ Fabrizio's branch merged with Susan's https://code.metoffice.gov.uk/svn/ops/main/branches/dev/fabriziobaordo/r272_ops_at_bom https://code.metoffice.gov.uk/svn/ops/main/branches/dev/susanrennie/r379_nci_stemtests/ Fabrizio's r272_ops_at_bom contains the updated version of roses-stem tasks for ODBCreate tasks: Susan: rose-stem/app/ops_createbufrdirodb_nci_aircraftsonde_global rose-stem/app/ops_createbufrdirodb_nci_gpsro_global rose-stem/app/ops_createbufrdirodb_nci_mtsatclear_global rose-stem/app/ops_createbufrdirodb_nci_satwind_global rose-stem/app/ops_createbufrdirodb_nci_surface_global Fabrizio: rose-stem/app/ops_createbufrdirodb_nci_atms_global rose-stem/app/ops_createbufrdirodb_nci_iasi_global rose-stem/app/ops_createbufrdirodb_nci_airs_global rose-stem/app/ops_createbufrdirodb_nci_atovs_global

Tested using UKMO varobs and cx files, with own UM files. Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above VAR tasks Tested using UKMO varobs and cx files, with own UM files. Ran with no issues.

Looking at using moo commands in suite to run own archiving Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above Archiving Not started Looking at using moo commands in suite to run own archiving

Not started. Discussion needed. Mergeback ODB and ODB2 archiving Install start data UM fcst cold Surf smow Recon cold Surf seaice/sst Install cold Install ostia OPS BGE UM recon LS screen UM recon ls n216 UM recon LS n108 VAR anal n216 VAR anal n108 OPS BGE screen OPS BUFR to ODB OPS process Get BUFR OPS process screen VAR anal screen Surf EKF Surf UM JULES Surf JULES Surf ASCAT EKF Build UM Prep build UM UM fcst ARCHIVE ODB to ODB2 Process Analysis (mergeback ODB) VER Cycle tasks as above VER/verification Not started. Discussion needed. Mergeback ODB and ODB2 archiving Expect OPS parts to work easily.

Conclusion All discussions are linked to MOSRS/roses-u ticket #1 in the Ticket Summary. Tables of tasks to do are in the summary too. Suite portability is a major discussion point. Looking forward: upgrade to u-aa437 and see also nesting suite u-aa425 to see how UKMO is developing their suites.