INAF–Catania Astrophysical Observatory M. Comparato 1, U. Becciani 1, B. Larsson 1, A. Costa 1, C. Gheller 2 VOTech Project Stage 04 Planning Meetings.

Slides:



Advertisements
Similar presentations
Operating-System Structures
Advertisements

Australian Virtual Observatory A distributed volume rendering grid service Gridbus 2003 June 7 Melbourne University David Barnes School of Physics, The.
A PPARC funded project Common Execution Architecture Paul Harrison AstroGrid consortium meeting Edinburgh UK Dec 2004.
Solar and STP Physics with AstroGrid 1. Mullard Space Science Laboratory, University College London. 2. School of Physics and Astronomy, University of.

Using R as enterprise-wide data analysis platform Zivan Karaman.
IVOA Interop. Meeting, October 2005 VisIVO interoperability with VO enabled tools Claudio Gheller (CINECA) 1, Marco Comparato (OACt) 2 Ugo Becciani (OACt)
A CHAT CLIENT-SERVER MODULE IN JAVA BY MAHTAB M HUSSAIN MAYANK MOHAN ISE 582 FALL 2003 PROJECT.
DANSE Central Services Michael Aivazis Caltech NSF Review May 23, 2008.
Understanding and Managing WebSphere V5
Week 6 Operating Systems.
Computer for Health Sciences
INTRODUCTION TO WEB DATABASE PROGRAMMING
Leicester, February 24, 2005 VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis. VO-TECH Project. Stage01 Ugo Becciani INAF – Astrophysical.
ROOT: A Data Mining Tool from CERN Arun Tripathi and Ravi Kumar 2008 CAS Ratemaking Seminar on Ratemaking 17 March 2008 Cambridge, Massachusetts.
Binding applications with PLASTIC John Taylor Institute for Astronomy, Edinburgh / AstroGrid Topcat Astr oSco pe Plastic.
Platform for Astronomy Tool InterCommunication John Taylor.
Remote OMNeT++ v2.0 Introduction What is Remote OMNeT++? Remote environment for OMNeT++ Remote simulation execution Remote data storage.
UNIX SVR4 COSC513 Zhaohui Chen Jiefei Huang. UNIX SVR4 UNIX system V release 4 is a major new release of the UNIX operating system, developed by AT&T.
The Old World Meets the New: Utilizing Java Technology to Revitalize and Enhance NASA Scientific Legacy Code Michael D. Elder Furman University Hayden.
INAF - National Institute for Astrophysics The National Institute for Astrophysics coordinates and participates in the Astronomy and Astrophysics (A&A)
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
Edinburgh, January 25, 2005 VisIVO, a VO-Enabled tool for Scientific Visualization and Data Analysis: Overview and Demo 1. Ugo Becciani (OACt): Introduction.
Software Software consists of the instructions issued to the computer to perform specific tasks. –The software on a computer system refers to the programs.
1 Computing Fundamantals With thanks to Laudon & Laudon Session 2.
BLU-ICE and the Distributed Control System Constraints for Software Development Strategies Timothy M. McPhillips Stanford Synchrotron Radiation Laboratory.
Victoria, May 2006 DAL for theorists: Implementation of the SNAP service for the TVO Claudio Gheller, Giuseppe Fiameni InterUniversitary Computing Center.
4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
DANSE Central Services Michael Aivazis Caltech NSF Review May 31, 2007.
GCE Data Toolbox -- metadata-based tools for automated data processing and analysis Wade Sheldon University of Georgia GCE-LTER.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
A PPARC funded project AstroGrid Intro & Demo John Taylor Institute for Astronomy, Edinburgh.
STAR net, Resources and VOs C. Vuerli, A. Costa, U. Becciani, P. Massimino, G. Castelli.
Distributed Version Management Distributed Version of Management for Computer Software (DVMS)
V. Serbo, SLAC ACAT03, 1-5 December 2003 Interactive GUI for Geant4 by Victor Serbo, SLAC.
SCIRun and SPA integration status Steven G. Parker Ayla Khan Oscar Barney.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.
VisIVO: data visualization on the grid Scientific Multidimensional Data Exploration 4th EGEE User Forum/ OGF 25 and OGF Europe's 2nd International Event.
A PPARC funded project Workflow and Job Control in Astrogrid Jeff Lusted Dept Physics and Astronomy University of Leicester.
A Web Laboratory for Visual Interactive Simulation of Epitaxial Growth Feng Liu University of Utah Recently, we have developed a prototype of web laboratory.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
C OMPUTING E SSENTIALS Timothy J. O’Leary Linda I. O’Leary Presentations by: Fred Bounds.
OPERATING SYSTEMS BY LANDON, KYLE, AND ETHAN. WHAT IS THEIR PURPOSE? (1) manage the computer's resources, such as the central processing unit (2) establish.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
The EDGeS project receives Community research funding 1 Porting Applications to the EDGeS Infrastructure A comparison of the available methods, APIs, and.
Interactive Workflows Branislav Šimo, Ondrej Habala, Ladislav Hluchý Institute of Informatics, Slovak Academy of Sciences.
Module 2 Part I Introduction To Windows Operating Systems Intro & History Introduction To Windows Operating Systems Intro & History.
NCEP ESMF GFS Global Spectral Forecast Model Weiyu Yang, Mike Young and Joe Sela ESMF Community Meeting MIT, Cambridge, MA July 21, 2005.
Connections to Other Packages The Cactus Team Albert Einstein Institute
A PPARC funded project Common Execution Architecture Paul Harrison IVOA Interoperability Meeting Cambridge MA May 2004.
Environmental Hydrology Applications Team Alliance Report
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
EGI-InSPIRE RI EGI-InSPIRE RI VisIVO: a tool for large astrophysical dataset exploration A&A Meeting 28 March 2012.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
A. Costa, P. Massimino, C. Vuerli, U. Becciani INAF CTA Gateway Prototype Based on gUSE/WS-PGRADE and Single-Sign-On (SSO)
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
VisIt Project Overview
Kai Li, Allen D. Malony, Sameer Shende, Robert Bell
MSSL Astrogrid Workshop
Integrating Scientific Tools and Web Portals
Hydrodynamic Galactic Simulations
Initial Adaptation of the Advanced Regional Prediction System to the Alliance Environmental Hydrology Workbench Dan Weber, Henry Neeman, Joe Garfield and.
University of Technology
Computer Software CS 107 Lecture 2 September 1, :53 PM.
February 16th, 2004 Class Meeting 5
Presentation transcript:

INAF–Catania Astrophysical Observatory M. Comparato 1, U. Becciani 1, B. Larsson 1, A. Costa 1, C. Gheller 2 VOTech Project Stage 04 Planning Meetings September 2006 Strasbourg, France 1 INAF – Catania Astrophysical Observatory 2 CINECA Progress report

VisIVO progress report Linux porting: new GUILinux porting: new GUI New infrastructure providing improved usabilityNew infrastructure providing improved usability New readers and writersNew readers and writers New SamplersNew Samplers Vectors and multiple scalar visualizationVectors and multiple scalar visualization Interoperability:Interoperability: Plastic interface server sidePlastic interface server side Fly interface through ACRFly interface through ACR

Linux porting VisIVO: developed and fully supported on Debian GNU/Linux (Sarge, current stable release)VisIVO: developed and fully supported on Debian GNU/Linux (Sarge, current stable release) moving to Etch, current testing releasemoving to Etch, current testing release Porting progress [=========>] 90%Porting progress [=========>] 90% tar.gz with raw binaries installation package availabletar.gz with raw binaries installation package available

Linux porting stage02 Current problems:Current problems: Not the best Look & FeelNot the best Look & Feel Multi Document Interface (MDI) not available in the linux environmentMulti Document Interface (MDI) not available in the linux environment Performance and stability not as good as the Windows version onesPerformance and stability not as good as the Windows version ones Future solutions:Future solutions: Linking wxWidgets with the Gtk2 libraryLinking wxWidgets with the Gtk2 library Gimp-like graphical user interfaceGimp-like graphical user interface We are investigating on the source of low performanceWe are investigating on the source of low performance and working on the stability of our softwareand working on the stability of our software

Linux porting VisIVO screenshots on Linux

Linux porting VisIVO screenshots on Linux

New infrastructure Importing any file format will cause the creation of a storage (a uniform list of arrays) enriched by all the metadata provided by the fileImporting any file format will cause the creation of a storage (a uniform list of arrays) enriched by all the metadata provided by the file The storage cannot be visualizedThe storage cannot be visualized You can applay to the storage any of the space- indipendent operations (randomizer, scalar statistics, etc…)You can applay to the storage any of the space- indipendent operations (randomizer, scalar statistics, etc…) From a storage item you can:From a storage item you can: create as many visual representations (3D/2D)as you wantcreate as many visual representations (3D/2D)as you want create as many vectors as you wantcreate as many vectors as you want

New infrastructure Vectors Scalars Storage 2D/3D objects Views

New infrastructure: side effects Raw multidimensional subsamplerRaw multidimensional subsampler

New infrastructure: side effects Enhanced UsabilityEnhanced Usability Enhanced performancesEnhanced performances 2 milion particles can be analysed with a four-year old laptop (like mine;)2 milion particles can be analysed with a four-year old laptop (like mine;)

Extracting Clusters Distribute scalar or constant value on a uniform cubic grid Extract an ISO-surface from the generated volume Use this surface to extract the points that form the cluster, from the original data

Multi Scalar Visualization Scale the Radius and Hight of the glyphs using different scalars Show Six different quantities at the same time - 3 Dimensions, X, Y, Z - 2 Sizes of the Glyphs - 1 Colour

Vector Visualization Create Vectors from arbitrary fields in the data set Visualize using Lines, Cones or Arrows Scale and colour the Vectors by Vector magnitude

New readers and writers Readers:Readers: Ascii tablesAscii tables Binary tablesBinary tables Writers:Writers: Ascii tablesAscii tables Binary tablesBinary tables VOTableVOTable

PLASTIC Thanks to the HPC-Europa Transnational AccessThanks to the HPC-Europa Transnational Access VisIVO is now able to register with the PLASTIC as an xmlrpc client/server applicationVisIVO is now able to register with the PLASTIC as an xmlrpc client/server application Supported messages:Supported messages: loadFromURLloadFromURL showObjectsshowObjects Tested communication with Aladin and TopcatTested communication with Aladin and Topcat The GUI allows dynamic changes to the levelThe GUI allows dynamic changes to the level of interaction you want with the hub and theof interaction you want with the hub and the registered applicationregistered application

Interoperability

VisIVO - Astrogrid - FLY Marco Comparato worked on the project, as an HPC-Europa visitor at the Edinburgh Parallel Computing Center, in cooperation with the Edinburgh AstroGrid group.Marco Comparato worked on the project, as an HPC-Europa visitor at the Edinburgh Parallel Computing Center, in cooperation with the Edinburgh AstroGrid group. Goals:Goals: to integrate a cosmological simulation in the Atrogrid environmentto integrate a cosmological simulation in the Atrogrid environment to interface VisIVO with this environment to make it interact with the simulation and all the other tools and resources provided by that infrastructure.to interface VisIVO with this environment to make it interact with the simulation and all the other tools and resources provided by that infrastructure.

FLY FLY is a parallel tree code that runs, with a very high resolution, N-Body simulations of the Large Scale Structure of the Universe. It runs on multi processors Unix- lixe systems where a full implementation of the MPI-2 communication standard is available and on IBM SP systems using LAPI. The code is designed to minimize data replication among processors and to maximize the number of bodies which can be used.FLY is a parallel tree code that runs, with a very high resolution, N-Body simulations of the Large Scale Structure of the Universe. It runs on multi processors Unix- lixe systems where a full implementation of the MPI-2 communication standard is available and on IBM SP systems using LAPI. The code is designed to minimize data replication among processors and to maximize the number of bodies which can be used.

VisIVO - Astrogrid - FLY FLY was installed on the EPCC high performance computing systems along with a java virtual machine and a servlet container (tomcat)FLY was installed on the EPCC high performance computing systems along with a java virtual machine and a servlet container (tomcat) FLY was not desingned to run multiple times from the same user without overwriting the current simulation outputFLY was not desingned to run multiple times from the same user without overwriting the current simulation output FLY must be recompiled each time you change some simulation parameters.FLY must be recompiled each time you change some simulation parameters. Developed a wrapper shell script that makes possible to run simultaneously multiple instances of FLY and makes transparent to the end user the building processes needed after changes to the simulation parameters.Developed a wrapper shell script that makes possible to run simultaneously multiple instances of FLY and makes transparent to the end user the building processes needed after changes to the simulation parameters. Wrapped the FLY shell script with a Common Execution Connector to connect it to the AstroGrid infrastructure and registered it to make it visible to the virtual observatoryWrapped the FLY shell script with a Common Execution Connector to connect it to the AstroGrid infrastructure and registered it to make it visible to the virtual observatory FLY is now visible to AstroGrid's web portal, desktop UI and workflow systemFLY is now visible to AstroGrid's web portal, desktop UI and workflow system

VisIVO - Astrogrid - FLY Implemented an interface in VisIVO to make FLY runnable from our visualization software, with the ability to select files stored in MySpace as input and output of the simulation.Implemented an interface in VisIVO to make FLY runnable from our visualization software, with the ability to select files stored in MySpace as input and output of the simulation.

Interaction ACR Cosmological simulation

Terena Conference (May in Catania Paper Submitted for publication. IVOA Meeting (May – Victoria) IAU Conference (Prague, August 2006) Paper submitted to the special issue of the journal "Concurrency And Computation: Practice And Experience“ (waiting for referee report) VisIVO & TVO (SNAP support for data cut: Theory IG meeting – Cambridge IoA, February) Dissemination

Thank You For Listening