CoastColour BEAM Workshop Lisbon, October 21, 2011.

Slides:



Advertisements
Similar presentations
PhUSE 2010 Unit Testing and Code Coverage Assessment with SASUnit - Key Technologies for Development of reliable SAS Macros - HMS Analytical Software.
Advertisements

COMPANY LOGO HERE Getting Started 1. Download the setup file: Go to Click on the Visit Setup Page link (includes Java.
Pulan Yu School of Informatics Indiana University Bloomington Web service based Varuna.Net.
Lecture 11 Server Side Interaction
Scripted Job Submission with Grisu Jython NeSI Workshop for NZ eResearch 2011 Aaron Hicks, Landcare Research
Kyle Thurow, Kyle Neuschaefer, Alexander Matusiak, and Justin Carroll.
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VI December 5, 2002 John Readey
Test Automation Framework Ashesh Jain 2007EE50403 Manager Amit Maheshwari.
Documentation Generators: Internals of Doxygen John Tully.
Model Server for Physics Applications Paul Chu SLAC National Accelerator Laboratory October 15, 2010.
Software Frameworks for Acquisition and Control European PhD – 2009 Horácio Fernandes.
Eclipse Introduction Dwight Deugo Nesa Matic
© 2004, The Trustees of Indiana University 1 OneStart Workflow Basics Brian McGough, Manager, Systems Integration, UITS Ryan Kirkendall, Lead Developer.
How to install the Zelle graphics package
Extending Informix 4GL Programming Capabilities Using FourGen® CASE Tools.
How XSL Formatter works Operation System Requirements How to format GUI for operating on Windows screen Application Integration Interface.
PART A Emac Lisp   Emac Lisp is a programming language  Emacs Lisp is a dialect.
ENVIRONMENTAL INFORMATICS GEOINFORMATION PRODUCTS B ROCKMANN C ONSULT GlobCOLOUR CDR, Jul 2006 Development of DDS Tools N. Fomferra, R. Quast, Brockmann.
LATTICE TECHNOLOGY, INC. For Version 9.0 and later XVL Web Master Tutorial For Version 9.0 and later.
® Page 1 Intel Compiler Lab – Intel Array Visualizer HDF Workshop VIII October 27, 2004 John Readey
Scan System Kay Kasemir, Xihui Chen Jan Managed by UT-Battelle for the U.S. Department of Energy Automated Experiment Control “Scan” should be.
Scan System: Experiment Automation Kay Kasemir, Xihui Chen RAL EPICS Meeting, May 2013.
Sikuli Ivailo Dinkov QA Engineer PhoneX Team Telerik QA Academy.
WaveMaker Visual AJAX Studio 4.0 Training Troubleshooting.
“Automate Anything You See” Uses image recognition to identify and control GUI components Useful when there is no easy access to a GUI's internal or source.
CBPM System Overview (Part I?) 19 September 2012Beam Instrumentation Meeting1.
A.NET desktop application and it’s future And solutions for command line application interoperability.
Introducing Dreamweaver MX 2004
Terrier: TERabyte RetRIevER An Introduction By: Kavita Ganesan (Last Updated April 21 st 2009)
© 2012 LogiGear Corporation. All Rights Reserved Robot framework.
Rsv-control Marco Mambelli – Site Coordination meeting October 1, 2009.
B ROCKMANN C ONSULT – Finnish Environment Institute, Syke Helsinki Programming with BEAM Norman Fomferra Carsten Brockmann.
WRF Domain Wizard A tool for the WRF Preprocessing System Jeff Smith Paula McCaslin July 17, 2008.
COLD FUSION Deepak Sethi. What is it…. Cold fusion is a complete web application server mainly used for developing e-business applications. It allows.
The Pipeline Processing Framework LSST Applications Meeting IPAC Feb. 19, 2008 Raymond Plante National Center for Supercomputing Applications.
Capture and Replay Often used for regression test development –Tool used to capture interactions with the system under test. –Inputs must be captured;
Public Resources for Bioinformatics Databases : how to find relevant information. Analysis Tools.
DTIAtlasBuilder Adrien Kaiser Neuro Image Research and Analysis Laboratories University of North Carolina at Chapel Hill A tool to create an atlas from.
Web Services for Earth Science Data Edward Armstrong, Thomas Huang, Charles Thompson, Nga Quach, Richard Kim, Zhangfan Xing Winter ESIP 2014 Washington.
Internet and Distributed Representation of Agent Based Model by- Manish Sharma.
Why Icon? An icon is a small picture that represents a file. Icons help you execute commands, open programs or documents quickly. It is also useful to.
UWG 2013 Meeting PO.DAAC Web Services Demo. What are PO.DAAC Web Services?
Python From the book “Think Python”
COP 3330 Notes 1/12. Today's topics Downloading Java and Eclipse Hello World Basic control structures Basic I/O Strings.
Ch 1. A Python Q&A Session Spring Why do people use Python? Software quality Developer productivity Program portability Support libraries Component.
Guide to Linux Installation and Administration, 2e1 Chapter 7 The Role of the System Administrator.
VistA Imaging Workstation Configuration. October The information in this documentation includes functionality of the software after the installation.
SciDAC SSS Quarterly Report Sandia Labs August 27, 2004 William McLendon Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed.
WDO-It! 102 Workshop: Using an abstraction of a process to capture provenance UTEP’s Trust Laboratory NDR HP MP.
JavaDoc and Contracts Spring Documenting Contracts with JavaDoc Contract model for methods Preconditions Postconditions JavaDoc Industry standard.
CSC 1010 Programming for All Lecture 2 Introduction to Python Some material based on material from Marty Stepp, Instructor, University of Washington.
Ben Stöver Winter term 2014/2015 Command line and batch files Molekular Phylogenetics – Practical.
TRIUMF HLA Development High Level Applications Perform tasks of accelerator and beam control at control- room level, directly interfacing with operators.
Presented By:. What is JavaHelp: Most software developers do not look forward to spending time documenting and explaining their product. JavaSoft has.
Ganga/Dirac Data Management meeting October 2003 Gennady Kuznetsov Production Manager Tools and Ganga (New Architecture)
Intelligent Data Systems Lab. Department of Computer Science & Engineering Python Installation guide 컴퓨터의 개념 및 실습.
Alan Williams University of Manchester.  Allows you to call a command line script as part of a workflow  Simplest case is calling a single tool  Can.
1 Cloud paradigm, standards and middleware for PGS * ESRIN *
ORNL is managed by UT-Battelle for the US Department of Energy Spark On Demand Deploying on Rhea Dale Stansberry John Harney Advanced Data and Workflows.
SciDAC SSS Quarterly Report Sandia Labs January 25, 2005 William McLendon Sandia is a multiprogram laboratory operated by Sandia Corporation, a Lockheed.
EML 2023 – Modeling, Parts Lecture 1.1 –Configuring SolidWorks.
Progress Apama Fundamentals
Development Environment
CST 1101 Problem Solving Using Computers
GWE Core Grid Wizard Enterprise (
Introduction to ZBOSS Embedded Systems Software Training Center
NGS computation services: APIs and Parallel Jobs
SQL Server 2005 Installation
ESIS Consulting LLC (C) ESIS Consulting LLC. All rights reserved
DIBBs Brown Dog BDFiddle
Presentation transcript:

CoastColour BEAM Workshop Lisbon, October 21, 2011

1. Use BEAM’s command-line tools o from a command-line shell o from shell scripts o from Python, IDL, MATLAB,... using dedicated system 2. Use the BEAM Java API to call BEAM functions o from your Java program o from your Phython program Sept. 27, 2011WaterRadiance, Progress Meeting 6, 2 Options

 Have a look into the ${BEAM-HOME}/bin directory  gpt –Used to execute various “BEAM operators” and chains of operators.  pconvert – Used to convert product files into other data and images formats (will become a gpt opertaor)  binning  meris-smac – Envisat MERIS smile correction  meris-cloud – Envisat MERIS cloud screening  flhmci – Envisat MERIS/AATSR FLH/MCI processors  aatsr-sst – ATSR/AATSR SST processor  mosaic – deprecated, use gpt Reproject  mapproj – deprecated, use gpt Mosaic Sept. 27, 2011WaterRadiance, Progress Meeting 6, 3 BEAM Command-Line Tools

 Most important BEAM batch-mode tool  Other command-line tools will become BEAM operators in the future  Usage  gpt | [options] [...]  Which operators are available?  gpt –h  Note that list of operators may vary depending on the installed BEAM plug-ins Sept. 27, 2011WaterRadiance, Progress Meeting 6, 4 BEAM gpt

 Refer to gpt documentation in BEAM VISAT help  Operator index lists only standard operators Sept. 27, 2011WaterRadiance, Progress Meeting 6, 5 BEAM gpt Operator Index

 Many of the BEAM gpt operators and command- line tools have a counterpart in the VISAT tools menu  You can save a parameter file from an operator’s GUI in VISAT and use it with BEAM gpt on the command-line Sept. 27, 2011WaterRadiance, Progress Meeting 6, 6 BEAM gpt Parameterisation

input-path='~/eodata/MER_RR__1P.N1' gpt.sh Reproject -Pcrs=AUTO: f NetCDF $input-path Sept. 27, 2011WaterRadiance, Progress Meeting 6, 7 Calling BEAM gpt from Shell Scripts

Sept. 27, 2011WaterRadiance, Progress Meeting 6, 8 Calling BEAM gpt from Python import subprocess gpt = '~/software/beam-4.9/bin/gpt.sh' operator = 'Reproject' parameters = '-Pcrs=AUTO: f NetCDF' input_path = '~/eodata/MER_RR__1P.N1' process = subprocess.Popen(gpt + ' ' + operator \ + ' ' + parameters + ' '+ input_path,\ shell=True, \ bufsize=1,\ stdout=subprocess.PIPE, \ stderr=subprocess.STDOUT) trace = open('gpt.stdout', 'w') for line in process.stdout: trace.write(line) trace.flush() trace.close() process.stdout.close() code = process.wait()

 Advantages:  no intermediate files written, no I/O overhead  reusability of processing chains  simple and comprehensive operator configuration  reusability of operator configurations  Usage example  gpt iop-graph.xml Sept. 27, 2011WaterRadiance, Progress Meeting 6, 9 Processing chains: Using gpt Graphs

 Single operator = single node: Sept. 27, 2011WaterRadiance, Progress Meeting 6, 10 BEAM gpt Graph XML Example 1

 Two operator chain: (1) IOP, (2) subset Sept. 27, 2011WaterRadiance, Progress Meeting 6, 11 BEAM gpt Graph XML Example 2

 Using gpt  gpt –h  In BEAM VISAT Help Topics: Graph Processing Framework (GPF)  Setting up a gpt processing chain:  wiki/display/BEAM/Creating+a+GPF+Graph Sept. 27, 2011WaterRadiance, Progress Meeting 6, 12 Getting Help – Command-line

 BEAM Java API Documentation:  consult.de/beam/doc/apidocs/index.html  BEAM home page / downloads  BEAM Java Programming:  wiki/display/BEAM/Development Sept. 27, 2011WaterRadiance, Progress Meeting 6, 13 Getting Help - Java

 Call the BEAM API from C-Python with JPipe:   Use the BEAM API with Jython:  Sept. 27, 2011WaterRadiance, Progress Meeting 6, 14 Integrating BEAM code in Python