The CISM Code Infrastructure Bob Weigel The CISM Knowledge Transfer Short Course AFWA Omaha, November 2-3, 2005.

Slides:



Advertisements
Similar presentations
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VI December 5, 2002 John Readey
Advertisements

Integrated Frameworks for Earth and Space Weather Simulation Timothy Killeen and Cecelia DeLuca National Center for Atmospheric Research, Boulder, Colorado.
A General Cone Model Approach to Heliospheric CMEs and SEP Modeling Magnetogram-based quiet corona and solar wind model The SEPs are modeled as a passive.
Coupling the RCM to LFM Frank Toffoletto (Rice) and John Lyon (Dartmouth)
Tucson MURI SEP Workshop March 2003 Janet Luhmann and the Solar CISM Modeling Team Solar and Interplanetary Modeling.
13 July 2004 STC Directors VideoConference W. Jeffrey Hughes, Director What is Space Weather? The Center for Integrated Space Weather Modeling –Research.
Installing and Running CISM _ DX and Overview of OpenDX The CISM Knowledge Transfer Short Course AFWA Omaha, November 2-3, 2005 Bob Weigel The CISM Knowledge.
CISM solar wind metrics M.J. Owens and the CISM Validation and Metrics Team Boston University, Boston MA Abstract. The Center for Space-Weather Modeling.
Java Programming, 3e Concepts and Techniques Chapter 1 An Introduction to Java and Program Design.
© , Michael Aivazis DANSE Software Issues Michael Aivazis California Institute of Technology DANSE Software Workshop September 3-8, 2003.
Expanded Observatory support (redundancy, verification) CME (Empirical) propagation (Cone Model) (ICME strength and arrival time) Electrodynamics model.
Flexible Control of Data Transfer between Parallel Programs Joe Shang-chieh Wu Alan Sussman Department of Computer Science University of Maryland, USA.
2003 GEM Workshop 25 June, 2003 W. Jeffrey Hughes for the Center for Integrated Space Weather Modeling Team Modeling the Sun-Earth Connection.
The CISM Model & Data Explorer CISM _ DX M. Gehmeyr, R.S. Weigel (CU/LASP), and M.J. Wiltberger (NCAR/HAO) Abstract The CISM Model & Data Explorer, CISM.
CISM Advisory Council Meeting 4 March Ionosphere-Thermosphere Modeling Tim Killeen, Stan Solomon, and the CISM Ionosphere-Thermosphere Team.
GridSphere for GridLab A Grid Application Server Development Framework By Michael Paul Russell Dept Computer Science University.
CLIMATE SCIENTISTS’ BIG CHALLENGE: REPRODUCIBILITY USING BIG DATA Kyo Lee, Chris Mattmann, and RCMES team Jet Propulsion Laboratory (JPL), Caltech.
Grid Specification MM RCM TIM MIC CHART LEGEND Source of Numerical Data Magnetospheric Model Ring-Current Model Thermosphere-Ionosphere Model M-I Coupler.
July 14, 2005 Shine 2005 Coupling Frameworks in Solar-Terrestrial Research Chuck Goodrich Boston University.
The “cone model” was originally developed by Zhao et al. ~10 (?) years ago in order to interpret the times of arrival of ICME ejecta following SOHO LASCO.
Overview of CISM Magnetosphere Research Mary Hudson 1, Anthony Chan 2, Scot Elkington 3, Brian Kress 1, William Lotko 1, Paul Melanson 1, David Murr 1,
Data Explorer. 2 What is OpenDX  Open source visualization package Based upon IBM’s Data eXplorer Object oriented language  Explore data through visual.
Unidata TDS Workshop THREDDS Data Server Overview October 2014.
Java Programming, 2E Introductory Concepts and Techniques Chapter 1 An Introduction to Java and Program Design.
The The IUGONET Project and Its Contribution to the VarSITI Program Akiyo Yatagai 1, Toshihiko Iyemori 2, Yoshimasa Tanaka 3, *Atsuki Shinbori 4, Shuji.
GroundsOpsStaff (Last Updated 9/9/2010) A Grounds Operations and Staffing Computer Application Based on APPA Operational Guidelines for Grounds Management.
AS Computing Software definitions.
Metadata for the Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) using the Earth System Modeling Framework (ESMF) Peter Bosler University.
1 Producing Rich Internet Applications with an Open Source Platform Martin Cadirola Ecotronics.
At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.
[The Virtual Radiation Belt Observatory] Bob Weigel (George Mason University) Software: Eric Kihn (NOAA/NGDC, ViRBO Web and API) Mikhail Zhizhin (RFO,
Unidata TDS Workshop TDS Overview – Part I XX-XX October 2014.
Development of ORBIT Data Generation and Exploration Routines G. Shelburne K. Indireshkumar E. Feibush.
Initial Results from the Integration of Earth and Space Frameworks Cecelia DeLuca/NCAR, Alan Sussman/University of Maryland, Gabor Toth/University of Michigan.
CISM Advisory Council Meeting 4 March 2003 CISM Vision:
August 2003 At A Glance VMOC-CE is an application framework that facilitates real- time, remote cooperative work among geographically dispersed mission.
Unidata TDS Workshop THREDDS Data Server Overview
AFRL/CISM Collaborations
ARGONNE NATIONAL LABORATORY Climate Modeling on the Jazz Linux Cluster at ANL John Taylor Mathematics and Computer Science & Environmental Research Divisions.
The Community Coordinated Modeling Center: A Brief Overview NASA Goddard Space Flight Center Lika Guhathakurta
240-Current Research Easily Extensible Systems, Octave, Input Formats, SOA.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
User Working Group 2013 Data Access Mechanisms – Status 12 March 2013
6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.
Towards real-time Space Weather forecasts using CMIT: Geomagnetic variations and regional K indexes George Millward …with help from: Michael Gehmeyr (LASP),
BOĞAZİÇİ UNIVERSITY DEPARTMENT OF MANAGEMENT INFORMATION SYSTEMS MATLAB AS A DATA MINING ENVIRONMENT.
2003 Site Visit 29/30 May, 2003 CISM Vision: To understand our changing Sun and its effects on the solar system, life, and society.
Connections to Other Packages The Cactus Team Albert Einstein Institute
GLite build and integration system Building and Packaging Robert HARAKALY
Visualization in Problem Solving Environments Amit Goel Department of Computer Science Virginia Tech June 14, 1999.
Application Software System Software.
CSEM Experience with Community Modeling Tamas Gombosi.
ESMF,WRF and ROMS. Purposes Not a tutorial Not a tutorial Educational and conceptual Educational and conceptual Relation to our work Relation to our work.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
July 19, 2004Joint Techs – Columbus, OH Network Performance Advisor Tanya M. Brethour NLANR/DAST.
A TIME-GCM CAM Multi-executable Coupled Model Using ESMF and InterComm Robert Oehmke, Michael Wiltberger, Alan Sussman, Wenbin Wang, and Norman Lo.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
HPC University Requirements Analysis Team Training Analysis Summary Meeting at PSC September Mary Ann Leung, Ph.D.
Building Preservation Environments with Data Grid Technology Reagan W. Moore Presenter: Praveen Namburi.
Federal Land Manager Environmental Database (FED) Overview and Update June 6, 2011 Shawn McClure.
Get Data to Computation eudat.eu/b2stage B2STAGE How to shift large amounts of data Version 4 February 2016 This work is licensed under the.
MET4750 Techniques for Earth System Modeling MET 5990 Techniques for Earth System Modeling and Research (
GEM Student Tutorial: GGCM Modeling (MHD Backbone)
CST 1101 Problem Solving Using Computers
Software for scientific calculations
Introduction to .NET Framework Ch2 – Deitel’s Book
Initial Adaptation of the Advanced Regional Prediction System to the Alliance Environmental Hydrology Workbench Dan Weber, Henry Neeman, Joe Garfield and.
Notes from the Data Assimilation Workshop
Federal Land Manager Environmental Database (FED)
Chapter 2: The Linux System Part 1
Presentation transcript:

The CISM Code Infrastructure Bob Weigel The CISM Knowledge Transfer Short Course AFWA Omaha, November 2-3, 2005

Outline Sun to Earth Numerical Modeling –Model Overview –Pairwise Couplings Coronal and Heliosphere Model Coupling Magnetosphere and Thermosphere-Ionosphere Coupling Magnetosphere and Inner Magnetosphere Model Coupling The CISM Forecast Model Visualization Products

CISM Heliospheric Models (CORHEL 1.0) Solar Corona Model Magnetohydrodynamics Around a Sphere (MAS) Linker et al., 1999; Mikic et al., 1999; Riley et al., 2001 Solar Wind Model (ENLIL - Sumerian wind deity) Odstrcil and Pizzo, 1999; Odstrcil et al., 2002

CISM Geospace Models (LTR 1.0) Magnetosphere Model Lyon-Fedder-Mobarry (LFM) Fedder and Lyon, 1995; Lyon et al., 1998; 2004 Thermosphere/Ionosphere Model Thermosphere-Ionosphere Nested Grid (TING) Roble et al., 1988; Wang et al., 1999 Rice Convection Model (RCM) Wolf and Spiro, 1987; Toffoletto et al., 2004

Numerical Model Chain (CISM 1.0) Solar Corona Model (MAS) Solar Wind Model (ENLIL) Magnetosphere Model (LFM) Thermosphere/Ionosphere Model (TING) Inner Magnetosphere Model (RCM) Magnetosphere- Ionosphere Coupler B, V, , p B, V, , T J ||, , T , , F  P,  H  B, , p , p ,  P,  H

CISM Numerical Code Coupling Framework Need to develop programming paradigm which allows for efficient coupling of models and is flexible enough to allow adding new physics and models –efficient transmission of information among codes –interpolation of data between grids –translation of physical variables between codes –control mechanisms to synchronize execution and interaction between codes –minimal modifications to existing code base Intercomm – University of Maryland – A. Sussman –Solution to the MxN problem in coupling parallel codes –Will address the control issues Overture - LLNL – B. Henshaw & D. Quinlan –C++ framework for solving differential equations on overset grids –Used to handle interpolation between model grids

Framework Example Overture grid functions identify regions of overlap between models as well an interpolatant Intercomm creates data descriptor to determine how to move data in regions of overlap between coupler and models A & B Applied Intercomm library to test case based upon splitting 2 fluid MHD simulation Overture application being developed to replace coupling infrastructure in CMIT

(From Baker et al., 2004)) The Forecast Model Concept

a community-developed set of data, models, and data and model explorers CISM _ DX

Needed to create a visualization and data analysis tool which could be used by validation team as well as model developers –Used Open DX and Octave as a basis Import modules currently implemented –MAS, ENLIL, LFM, TING, and WSA –RCM and TIEGCM are under development Also includes and extensive collection of observations and tools for calculating metrics and skill scores KT thrust is developing ‘push button’ installation process –includes examples and documentation –Available for download from User group with mailing list and ‘network’ archive

CISM _ DX Lead Developers Michael Wiltberger – NCAR/HAO Michael Gehmeyr - CU/LASP and NOAA/SEC Bob Weigel - CU/LASP

Fabio Acero Scot Elkington Tim Guild Elly Huang John Lyon Bob McPherron Asher Pembroke Marius Schamschula Dimitris Vassiliadis Logo by Susanna Lamey CISM _ DX Contributors

What A collection of analysis and visualization tools by scientists, that use, or can be compiled with, Open Source Software on multiple operating systems. The tools are integrated. CISM-DX is a software package that contains –Extensions to Octave and OpenDX for import and analysis of numerical and measurement data –Extensive suite of networks and programs for both novice and expert users –Extensive set of time series data in a common format

What We take a large body of data and programs, in many formats and languages, and write high-level interfaces, tutorials, and expert-use demos for their use.

Integrated? It is not a web page with a list packages in source code format. These exist. It is not a web page for obtaining a restricted set of information. It is not a set of libraries that is called by a Java or other front- end (examples: VisBARD, IDV, SSC 3D Orbit Viewer, AFGeospace). Although it could be. It is a set of source codes, pre-compiled for several operating systems, usage examples, educational tutorials, and programs that integrate the codes written in different languages. What calls the library (or the “front-end”) depends on the community - the library is separated from the GUI – the libraries are integrated so that the GUI can easily change!

50.m files compatible with Octave/Matlab 30 C/Fortran codes wrapped with OpenDX or Octave 50.net files for visualization in OpenDX 1000 years (~1 GB compressed) of time series 1-minute resolution 2.pro files for IDL 10.pl files for data file manipulation with Perl Code distributed with CISM _ DX

Datasets distributed with CISM_DX Numerous data sets from across the community where collected moved on uniformly spaced time grids and stored in HDF files –Provides the user with essential data quickly so they can move onto doing science with having to learn new data formats Dataset includes –Satellite Observations ACE,WIND,GEOTAIL,GOES –Ground Magnetometer WDC, FMI –Indices AE, Dst, Ap, F10.7, aa, am

Why Space physics needs a tool for visualizing and analyzing numerical and empirical models as well as observational data –Must support all levels of users from novice to expert –Must be inexpensive –Should draw upon the previous work and knowledge of the space physics community

Why continued It has been successful in CISM –In allowing scientists to have access to Sun-Earth analysis programs without having to learn specialized data formats and data sets –In getting students working with expert tools –In speeding up model transition into operations The number of data formats and programming languages scale with time. Integration can often be more important than optimization (of data formats, download speed, etc.) Without a framework, this bottom-up approach is the best alternative (and some may say better).

Give researchers and students a useful tool and a mechanism and framework for improving upon it. Our approach: The CISM _ DX contribution framework

Ideally all contributions would be in Octave, OpenDX, C, Fortran 77, Perl, … anything that has cross-platform support and can be executed, compiled, or wrapped with Open Source Software. However, there are many useful IDL and Matlab-specific codes that we would consider adding (especially graphics tools). They may not be as well-integrated as the other programs, but will still find use. 1.User develops tool using software in the CISM _ DX package. 2.Submits a contribution package 3.Package is review and suggestions for improvement are made 4.Final package is posted to CISM _ DX web site and announced on list. 5.Developers meet to decide what and how parts of contribution can be integrated in a future CISM _ DX release.

Web page: _ DX OSX and Windows XP versions in August. Source code and pre-compiled binaries available for version Version 0.5 expected in the end of June.