On Advanced Scientific Understanding, Model Componentisation and Coupling in GENIE Sofia Panagiotidi, Eleftheria Katsiri and John Darlington.

Slides:



Advertisements
Similar presentations
Earth System Curator Spanning the Gap Between Models and Datasets.
Advertisements

Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech.
Experience of the SRB in support of collaborative grid computing Martin Dove University of Cambridge.
Problem-Solving Environments: The Next Level in Software Integration David W. Walker Cardiff University.
UvA, Amsterdam June 2007WS-VLAM Introduction presentation WS-VLAM Requirements list known as the WS-VLAM wishlist System and Network Engineering group.
FREMA: e-Learning Framework Reference Model for Assessment Design Patterns for Wrapping Similar Legacy Systems with Common Service Interfaces Yvonne Howard.
1 Geophysical Fluid Dynamics Laboratory Review June 30 - July 2, 2009.
A Virtual Laboratory for Global Biodiversity Analysis.
A Semantic Workflow Mechanism to Realise Experimental Goals and Constraints Edoardo Pignotti, Peter Edwards, Alun Preece, Nick Gotts and Gary Polhill School.
TPAC Digital Library Talk Overview Presenter:Glenn Hyland Tasmanian Partnership for Advanced Computing & Australian Antarctic Division Outline: TPAC Overview.
Metadata Creation with the Earth System Modeling Framework Ryan O’Kuinghttons – NESII/CIRES/NOAA Kathy Saint – NESII/CSG July 22, 2014.
Some Thoughts on HPC in Natural Language Engineering Steven Bird University of Melbourne & University of Pennsylvania.
ICENI Overview & Grid Scheduling Laurie Young London e-Science Centre Department of Computing, Imperial College.
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
Service-enabling Legacy Applications for the GENIE Project Sofia Panagiotidi, Jeremy Cohen, John Darlington, Marko Krznarić and Eleftheria Katsiri.
Computational Design of the CCSM Next Generation Coupler Tom Bettge Tony Craig Brian Kauffman National Center for Atmospheric Research Boulder, Colorado.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
4/2/03I-1 © 2001 T. Horton CS 494 Object-Oriented Analysis & Design Software Architecture and Design Readings: Ambler, Chap. 7 (Sections to start.
©Ian Sommerville 2000 Software Engineering, 6th edition. Chapter 10Slide 1 Architectural Design l Establishing the overall structure of a software system.
Ohio State University Department of Computer Science and Engineering 1 Cyberinfrastructure for Coastal Forecasting and Change Analysis Gagan Agrawal Hakan.
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
University of Palestine software engineering department Testing of Software Systems Testing throughout the software life cycle instructor: Tasneem Darwish.
ESMF Code Generation Rocky Dunlap Spencer Rugaber Leo Mark Georgia Tech College of Computing.
NeSC, Nov 2003 Bristol Regional e-Science Centre: progress and plans Mark Birkinshaw University of Bristol.
Using ICENI to run parameter sweep applications across multiple Grid resources Murtaza Gulamali Stephen McGough, Steven Newhouse, John Darlington London.
Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK.
The use of modeling frameworks to facilitate interoperability Cecelia DeLuca/NCAR (ESMF) Bill Putman/NASA GSFC (MAPL) David Neckels/NCAR.
STRATEGIC ICT SUMMIT FEBRUARY 3 – 4, 2009 Name: Dr Kenji Takeda Organisation: School of Engineering Sciences, University of Southampton Contact Information:
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Earth System Modeling Framework Status Cecelia DeLuca NOAA Cooperative Institute for Research in Environmental Sciences University of Colorado, Boulder.
Regional Models in CCSM CCSM/POP/ROMS: Regional Nesting and Coupling Jon Wolfe (CSEG) Mariana Vertenstein (CSEG) Don Stark (ESMF)
“Grids and eScience” Mark Hayes Technical Director - Cambridge eScience Centre GEFD Summer School 2003.
The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.
1 Earth System Modeling Framework Documenting and comparing models using Earth System Curator Sylvia Murphy: Julien Chastang:
1 PRogramme for Integrated earth System Modelling (PRISM) An Infrastructure Project for Climate Research in Europe.
1. 2 Preface In the time since the 1986 edition of this book, the world of compiler design has changed significantly 3.
Towards development of a Regional Arctic Climate System Model --- Coupling WRF with the Variable Infiltration Capacity land model via a flux coupler Chunmei.
11 CORE Architecture Mauro Bruno, Monica Scannapieco, Carlo Vaccari, Giulia Vaste Antonino Virgillito, Diego Zardetto (Istat)
ESMF Code Generation with Cupid Update and Demo October 2009 Rocky Dunlap Spencer Rugaber Leo Mark Georgia Tech College of Computing.
Scientific Workflow systems: Summary and Opportunities for SEEK and e-Science.
NCEP ESMF GFS Global Spectral Forecast Model Weiyu Yang, Mike Young and Joe Sela ESMF Community Meeting MIT, Cambridge, MA July 21, 2005.
Utility Computing: Security & Trust Issues Dr Steven Newhouse Technical Director London e-Science Centre Department of Computing, Imperial College London.
Page 1© Crown copyright 2004 FLUME Marco Christoforou, Rupert Ford, Steve Mullerworth, Graham Riley, Allyn Treshansky, et. al. 19 October 2007.
Earth System Curator and Model Metadata Discovery and Display for CMIP5 Sylvia Murphy and Cecelia Deluca (NOAA/CIRES) Hannah Wilcox (NCAR/CISL) Metafor.
Perspectives in Computational Earth System Science an oceanographer’s view Aike Beckmann Division of Geophysics, Department of Physical Sciences
Page 1 PACS GRITS 17 June 2011 Herschel Data Analysis Guerilla Style: Keeping flexibility in a system with long development cycles Bernhard Schulz NASA.
An update on BFG, The Bespoke Framework Generator Graham Riley (& Rupert Ford, STFC) Coupling Workshop Boulder, Colorado - February 20 th -22 nd.
Performance guided scheduling in GENIE through ICENI
Page 1© Crown copyright 2005 Met Office plans for sea ice model development within a flexible modelling framework Helene Banks Martin Best, Ann Keen and.
Virtual Lab AMsterdam VLAMsterdam Abstract Machine Toolbox A.S.Z. Belloum, Z.W. Hendrikse, E.C. Kaletas, H. Afsarmanesh and L.O. Hertzberger Computer Architecture.
O AK R IDGE N ATIONAL L ABORATORY U.S. D EPARTMENT OF E NERGY Data Requirements for Climate and Carbon Research John Drake, Climate Dynamics Group Computer.
A TIME-GCM CAM Multi-executable Coupled Model Using ESMF and InterComm Robert Oehmke, Michael Wiltberger, Alan Sussman, Wenbin Wang, and Norman Lo.
1 Chapter : Architecture & User Interface Design.
Metadata Development in the Earth System Curator Spanning the Gap Between Models and Datasets Rocky Dunlap, Georgia Tech 5 th GO-ESSP Community Meeting.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
The Earth System Curator Metadata Infrastructure for Climate Modeling Rocky Dunlap Georgia Tech.
Experiences and Decisions in Met Office coupled ESM Development
Towards development of a Regional Arctic Climate System Model ---
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
D. Lunt (1), A. Yool (2), R.Marsh(2), P.Valdes(1) , and the GENIE team
Distribution and components
SDM workshop Strawman report History and Progress and Goal.
FUJIN: a parallel framework for meteorological models
Transient simulations of the last 30,000 years, within the GENIE earth-system framework D.J. Lunt (1) M.Williamson (2) A. Price (3) P.J. Valdes (1)
Systems Engineering for Mission-Driven Modeling
Dr. Bhavani Thuraisingham The University of Texas at Dallas
AGENT FRAMEWORK By- Arpan Biswas Rahul Gupta.
Metadata Development in the Earth System Curator
Function-oriented Design
Presentation transcript:

On Advanced Scientific Understanding, Model Componentisation and Coupling in GENIE Sofia Panagiotidi, Eleftheria Katsiri and John Darlington

1 Motivation Reverse engineer GENIE to inform research on component coupling frameworks:  Analysis of a monolithic piece of code such as GENIE.  Extraction of interface and model coupling semantics.  Development of methods for capturing such semantics and validating the development.  Methods to express at higher-levels co- ordination structure.

Goals  A flexible coupling framework where components can be individually developed and coupled together.  The coupling needs to be correct, intelligent and without undue programming effort.  In synch with existing efforts: (GCF, Iceni I, Apples AMWAT, Reality Grid), but a system of the size and complexity of Genie requires a supporting semantic framework. 2

3 What is GENIE?  Grid ENabled Integrated Earth system model.  Investigate long term changes to the Earth’s climate (i.e. global warming) by integrating numerical models of the Earth system.  e-Science aims:  Flexibly couple together state-of-the-art components to form unified Earth System Model (ESM).  Execute resultant ESM on a Grid infrastructure.  Share resultant data produced by simulation runs.  Provide high-level open access to the system, creating and supporting virtual organisation of Earth System modellers.

4 GENIE model framework 3D atmosphere 3D ocean 2D sea ice Atmospheric CO 2 2D land surface Land biogeochemistry Ocean biogeochemisty Ocean sediments 3D ice sheets

Previous Work  Separation of the code into pieces - Layered representation of the application.  Wrapping GENIE as ICENI binary component.  Delivery of Web-based System (portal) to allow a virtual organisation of environmental scientists to create and manage simulations at a high-level.  Submission of multiple sweep experiments to the portal, exploiting multiple resources over a Condor pool.  Implementation of database management system to allow scientists to share, access and visualise data produced by simulation runs. 5

Currently in GENIE  genie.F is a glorified metafile containing if-then-else statements.  Fortran routines act as “wrappers”, IN/OUT annotation.  Life cycle phases scattered, i.e. igcm_adiab.F and initialise_atmos.F.  Shared memory, file based I/O.  Complex semantics (e.g. grid interpolations).  Hard-coded time steps. 6

7 OLOGEN Ontology for GENIE:  Classes  Relations

Entities (1) OLOGEN Class Hierarchy:  Abstractions - What is the abstraction granularity?  Component  Module (atmosphere, land, ocean etc)  Model (IGCM, c-Goldstein, etc)  Wrapper ∶  Routine  Function (…)  Interface  Data Flow Type (IN, OUT, INOUT, Control)  Model Scope (Common, Model-Specific)  Binding (Late, Current)  Layer (Local, Wrapper) ∶ 8 is part of

Entities (2) 8

10 Relations

11 Higher-order Functions Co-ordination forms  The Wrap Skeleton  The Thread Coupler Skeleton  Distribution Model  Same-host  Distributed  Parallel

12 The Wrap Skeleton Wrap( c,list of wrapper input interfaces, list of wrapper output interfaces, list of local input interfaces, list of local output interfaces, list of control interfaces)=C

13 The Thread Coupler Skeleton [SCL, Darlington93] IterFor koverall { IterFor n step A IterFor m step B where step A = threadA.execute threadB.notify(interfaceB) step B = threadB.execute threadA.notify(interfaceA) }

Nested Coupling igcm_land_surflux pass results 3 pass lowest level values to ocean & land igcm3_adiab flag_land not igcm_ocean_surflux igcm_ocean_blaye r flag_goldsteinocean and flag_goldsteinseaice not check_fluxe s_surf_l flag_checkfluxes_surf not igcm_land _blayer genie_land_surflux igcm3_diab pass results 2 land_niter_tim katmos_int ocean_niter_tim 14

15 Conclusions  Use of reverse engineering approach to research on component coupling frameworks:  Analysis of a monolithic piece of code such as GENIE.  Extraction of interface and model coupling semantics.  Development of OLOGEN, an ontology for capturing such semantics and validating the development.  Co-ordination via functional skeletons.

16 Acknowledgments  We would like to thank Andrew Price, Dan Lunt, Gethin Williams, Ian Rutt, Andrew Yool, Neil Edwards, Tim Lenton and John Shepherd for their assistance and guidance.  Acknowledgments also go to the GENIE investigators: Prof. Paul Valdes (Reading), Prof. John Shepherd (SOC, Southampton), Prof. Andrew Watson (UEA), Prof. Melvyn Cannell (CEH Edinburgh), Dr. Anthony Payne (Bristol), Prof. Richard Harding (CEH Wallingford), Prof. Simon Cox (SReSC) and Prof. John Darlington (LeSC).  Reference: [SCL, Darlington93] J. Darlington, Y. Guo, H. W. To, and J. Yang. Functional skeletons for parallel coordination. In Seif Haridi, Khayri Ali, and Peter Magnussin, editors, Euro-Par'95 Parallel Processing, pages Springer-Verlag, August 1995.