_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community.

Slides:



Advertisements
Similar presentations
DataTools Models Data, models and tools: Dealing with any complex hydraulic engineering problem invariable use is made of: data, models and tools.
Advertisements

_____________________________________________________________________CMAS User Support MCNC - EMC__________________________________________Community Modeling.
The NCAR Command Language (NCL) and the NetCDF Data Format Research Tools Presentation Matthew Janiga 10/30/2012.
Why python? Automate processes Batch programming Faster Open source Easy recognition of errors Good for data management What is python? Scripting programming.
Automated Instrumentation and Monitoring System (AIMS)
NetCDF An Effective Way to Store and Retrieve Scientific Datasets Jianwei Li 02/11/2002.
GEOGRAPHIC INFORMATION SYSTEM GIS are tools that allow for the processing of spatial data into information, generally information tied explicitly to, and.
1 CMPT 275 Software Engineering Revision Control.
Source Control Repositories for Enabling Team Working Svetlin Nakov Telerik Corporation
Version 4 for Windows NEX T. Welcome to SphinxSurvey Version 4,4, the integrated solution for all your survey needs... Question list Questionnaire Design.
ESRM 250 & CFR 520: Introduction to GIS © Phil Hurvitz, KEEP THIS TEXT BOX this slide includes some ESRI fonts. when you save this presentation,
SubVersioN – the new Central Service at DESY by Marian Gawron.
Deploying Dynamics Applications Thomas Hansen – Director, appSolutions a|s
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch October 8, 2008.
Version Control with Subversion. What is Version Control Good For? Maintaining project/file history - so you don’t have to worry about it Managing collaboration.
FALL 2005CSI 4118 – UNIVERSITY OF OTTAWA1 Part 4 Web technologies: HTTP, CGI, PHP,Java applets)
OCLC Online Computer Library Center CONTENTdm Migration Training Craig Yamashita Vice President, Technology and Product Development DiMeMa, Inc. July 2005.
CompuCell Software Current capabilities and Research Plan Rajiv Chaturvedi Jesús A. Izaguirre With Patrick M. Virtue.
EARTH SCIENCE MARKUP LANGUAGE “Define Once Use Anywhere” INFORMATION TECHNOLOGY AND SYSTEMS CENTER UNIVERSITY OF ALABAMA IN HUNTSVILLE.
Carolina Environmental Program UNC Chapel Hill The Analysis Engine – A New Tool for Model Evaluation, Sensitivity and Uncertainty Analysis, and more… Alison.
Chapter Four UNIX File Processing. 2 Lesson A Extracting Information from Files.
CVM-H v11.1 Release in a Nutshell Distribution of a new version of CVM-H that includes: Vs30-based arbitrary precision GTL Extended Region using 1D background.
CHAPTER FOUR COMPUTER SOFTWARE.
A Metadata Based Approach For Supporting Subsetting Queries Over Parallel HDF5 Datasets Vignesh Santhanagopalan Graduate Student Department Of CSE.
Components of Database Management System
Cloud Distributed Computing Platform 2 Content of this lecture is primarily from the book “Hadoop, The Definite Guide 2/e)
GMT: The Generic Mapping Tools Paul Wessel, Walter H.F. Smith and the GMT team.
Development of ORBIT Data Generation and Exploration Routines G. Shelburne K. Indireshkumar E. Feibush.
Informix IDS Administration with the New Server Studio 4.0 By Lester Knutsen My experience with the beta of Server Studio and the new Informix database.
CFR 250/590 Introduction to GIS, Autumn 1999 Data Conversion & Export © Phil Hurvitz, data_export.ppt 1 Overview Why export? Converting feature.
…using Git/Tortoise Git
1 Computer Programming (ECGD2102 ) Using MATLAB Instructor: Eng. Eman Al.Swaity Lecture (1): Introduction.
CHAPTER TEN AUTHORING.
Silberschatz, Galvin and Gagne  Operating System Concepts Chapter 3: Operating-System Structures System Components Operating System Services.
Integrated Grid workflow for mesoscale weather modeling and visualization Zhizhin, M., A. Polyakov, D. Medvedev, A. Poyda, S. Berezin Space Research Institute.
CSE 219 Computer Science III CVS
Touchstone Automation’s DART ™ (Data Analysis and Reporting Tool)
The european ITM Task Force data structure F. Imbeaux.
ESIP Federation 2004 : L.B.Pham S. Berrick, L. Pham, G. Leptoukh, Z. Liu, H. Rui, S. Shen, W. Teng, T. Zhu NASA Goddard Earth Sciences (GES) Data & Information.
Strategies for Adding EML Support to the GCE Data Toolbox for Matlab Wade Sheldon Georgia Coastal Ecosystems LTER (WWW: gce-lter.marsci.uga.edu/lter)
Version Control with SVN Images from TortoiseSVN documentation
Presented by Scientific Annotation Middleware Software infrastructure to support rich scientific records and the processes that produce them Jens Schwidder.
View_hdf Kam-Pui Lee Science Applications International Corporation CERES Data Management Team Linda Hunt Computer Sciences Corporation Atmospheric Sciences.
National Center for Supercomputing ApplicationsNational Computational Science Grid Packaging Technology Technical Talk University of Wisconsin Condor/GPT.
Earth System Modeling Framework Python Interface (ESMP) October 2011 Ryan O’Kuinghttons Robert Oehmke Cecelia DeLuca.
Introduction to Interactive Media Interactive Media Tools: Authoring Applications.
The HDF Group Introduction to netCDF-4 Elena Pourmal The HDF Group 110/17/2015.
INTRODUCTION TO GIS  Used to describe computer facilities which are used to handle data referenced to the spatial domain.  Has the ability to inter-
12 CVS Mauro Jaskelioff (originally by Gail Hopkins)
John Porter Sheng Shan Lu M. Gastil Gastil-Buhl With special thanks to Chau-Chin Lin and Chi-Wen Hsaio.
University of North Carolina at Chapel Hill Carolina Environmental Programs Community Modeling and Analysis System (CMAS) Year 3 Adel Hanna Director, CMAS.
Postgraduate Computing Lectures PAW 1 PAW: Physicist Analysis Workstation What is PAW? –A tool to display and manipulate data. Learning PAW –See ref. in.
SDM Center Parallel I/O Storage Efficient Access Team.
Introduction to CADStat. CADStat and R R is a powerful and free statistical package [
Chapter – 8 Software Tools.
SPDF Science Advisory Group - September 29-30, 2005 Page 12/24/2016 9:09:48 PM Services of the Space Physics Data Facility (SPDF) / Sun-Earth Connection.
1 09/2003 Processing Library Update CF Checker – Script made available as a web based form on the BADC site -
Information Systems and Network Engineering Laboratory I DR. KEN COSH WEEK 1.
1 RIC 2009 Symbolic Nuclear Analysis Package - SNAP version 1.0: Features and Applications Chester Gingrich RES/DSA/CDB 3/12/09.
Computing in High Energy and Nuclear Physics 2012 May 21-25, 2012 New York United States The version control service for ATLAS data acquisition configuration.
Source Control Dr. Scott Schaefer. Version Control Systems Allow for maintenance and archiving of multiple versions of code / other files Designed for.
INTRODUCTION TO GEOGRAPHICAL INFORMATION SYSTEM
The Use of AMET and Automated Scripts for Model Evaluation
Source Control Dr. Scott Schaefer.
INTRODUCING Adams/CHASSIS
Concurrent Version Control
CVS Concurrent Versioning System
SDLC Phases Systems Design.
Geoprocessing Sample Tools for Lidar Data Management
Overview of HEC Data Storage System (HEC DSS)
Presentation transcript:

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 1 CMAQ Libraries and Utilities l I/O API l netCDF l mpich l Stenex l Pario l CVS l PAVE

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 2 CMAQ Libraries and Utilities (1) l Library files provide an easy way for programs to share commonly used subroutines; three libraries used by CMAQ l I/O API - an easy-to-learn, easy-to-use programming library for data storage and access, available for both Fortran and C l netCDF - an interface for array-oriented data access and a library that provides an implementation of the interface l mpich – message passing interface for parallel computing

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 3 CMAQ Libraries and Utilities (2) l Stenex - the Stencil Exchange library is required for parallel processing l Pario – a set of library routines that control CMAQ input/output for multiprocessor applications

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 4 I/O API Utilities (1) l The Input/Output Applications Programming Interface contains an extensive set of utility routines for manipulating dates and times, performing coordinate conversions, storing and recalling grid definitions, sparse matrix arithmetic, etc., as well as a set of data- manipulation and statistical analysis programs l Command line programs that are easy to script for automating analysis and post processing l l Examples of I/O API utilities

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 5 I/O API Utilities (2) l m3diff: for computing statistics for pairs of variables and for applying various comparison ("differencing") operations to those variables in a pair of files l m3edhdr: edit header attributes/file descriptive parameters l m3merge: merges selected variables from a set of input files for a specified time period, and writes them to a single output file, with optional variable- renaming in the process l vertot: compute vertical-column totals of variables in a file

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 6 netCDF Library l The Network Common Data Form is an interface to a library of data access functions for storing and retrieving data in the form of arrays l An abstraction that supports a view of data as a collection of self-describing, network-transparent objects that can be accessed through a simple interface l By using direct file access, netCDF achieves the goal of supporting efficient access to small subsets of large datasets l

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 7 CVS (1) l Concurrent Versions System is a source code version control system that operates on a hierarchical directory structure to manage code releases and control the concurrent editing of files among multiple authors l Version control systems are primarily used in development environments where multiple programmers may be accessing source code simultaneously l In CMAQ, CVS is used simply as a code repository for protecting the distributed files from direct access

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 8 CVS (2) l Instead of directly accessing the source code in the CMAQ distribution, you use CVS to access copies of the code l If you manipulate these copies when they are checked out of CVS, you can check them back into the repository, where CVS will record information of the nature and timing of the file revisions l l Examples of CVS commands

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 9 CVS (3) l cvs checkout foo – checks out your own working copy of the source for ‘foo’ into the current directory l cvs commit foo – checks your working copy of the source for ‘foo’ into the CVS archive l cvs –n update foo – lists the files that have changed in the source for ‘foo’ since checking them out of the CVS archive l cvs add bar – adds a node to the CVS archive for the source for ‘bar’

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 10 PAVE (1) l Package for Analysis and Visualization of Environmental data is a UNIX/Linux graphics tool for netCDF and UAM formatted data l PAVE is a flexible and distributed application to visualize multivariate gridded environmental datasets l Easily scriptable to automate plot generation l Creates 2-d tile plots, time series, 3-d mesh plots, bar charts, scatter plots, and integrates observations into graphics l → Download Center → Models → User Account required

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 11 PAVE (2) l Exports images and data in GIF, MPEG, Animated GIF, ascii text, and postscript l Intuitive graphical user interface l Current version is PAVE 2.3

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 12 PAVE (3)

_______________________________________________________________CMAQ Libraries and Utilities ___________________________________________________Community Modeling and Analysis System 13 PAVE (4)