KOREL-VO - The small RESTful "cloud" environment for stellar analysis Petr Škoda Jan Fuchs Petr Hadrava Astronomical Institute Academy of Sciences Ondřejov.

Slides:



Advertisements
Similar presentations
May 2005IVOA Interoperability Meeting, Kyoto1 IRAF Web Services Michael Fitzpatrick NOAO T HE US N ATIONAL V IRTUAL O BSERVATORY.
Advertisements

DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
© J. Christopher Beck Lecture 33: Scheduling and the Web.
Copyright © 2007, SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
14 October 2003ADASS 2003 – Strasbourg1 Resource Registries for the Virtual Observatory R.Plante (NCSA), G. Greene (STScI), R. Hanisch (STScI), T. McGlynn.
The Client/Server Database Environment
Numerical Grid Computations with the OPeNDAP Back End Server (BES)
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
Chapter 8 Windows Outline Programming Windows 2000 System structure Processes and threads in Windows 2000 Memory management The Windows 2000 file.
SCRAM Software Configuration, Release And Management Background SCRAM has been developed to enable large, geographically dispersed and autonomous groups.
Chapter 4 COB 204. What do you need to know about hardware? 
MobSched: An Optimizable Scheduler for Mobile Cloud Computing S. SindiaS. GaoB. Black A.LimV. D. AgrawalP. Agrawal Auburn University, Auburn, AL 45 th.
GRAPPA Part of Active Notebook Science Portal project A “notebook” like GRAPPA consists of –Set of ordinary web pages, viewable from any browser –Editable.
Applications of Fourier disentangling on the spectra of multiple stars Mgr. Jan Elner.
COMP 410 & Sky.NET May 2 nd, What is COMP 410? Forming an independent company The customer The planning Learning teamwork.
Multi-line Analysis of Stellar Spectra in VO Environment Petr Škoda Astronomical Institute Academy of Sciences Ondřejov Czech Republic Multi-wavelength.
Robert Fourer, Jun Ma, Kipp Martin Copyright 2006 An Enterprise Computational System Built on the Optimization Services (OS) Framework and Standards Jun.
Functions and Demo of Astrogrid 1.1 China-VO Haijun Tian.
IVC : a simulation and model-fitting tool for optical-IR interferometry Abstract I present a new software tool, called “Interferometry Visibility Computations”
Wenjing Wu Computer Center, Institute of High Energy Physics Chinese Academy of Sciences, Beijing BOINC workshop 2013.
EÖTVÖS UNIVERSITY BUDAPEST Department of Physics of Complex Systems VO Spectroscopy Workshop, ESAC Spectrum Services 2007 László Dobos (ELTE)
Asynchronous services from NVO Roy Williams Conrad Steenberg Craig Miller Matthew Graham Joe Jacob Julian Bunn.
Bookkeeping Tutorial. Bookkeeping & Monitoring Tutorial2 Bookkeeping content  Contains records of all “jobs” and all “files” that are created by production.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Enabling Grids for E-sciencE EGEE-III INFSO-RI Using DIANE for astrophysics applications Ladislav Hluchy, Viet Tran Institute of Informatics Slovak.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
AgINFRA science gateway for workflows and integrated services 07/02/2012 Robert Lovas MTA SZTAKI.
Getting started DIRAC Project. Outline  DIRAC information system  Documentation sources  DIRAC users and groups  Registration with DIRAC  Getting.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
The EDGeS project receives Community research funding 1 Porting Applications to the EDGeS Infrastructure A comparison of the available methods, APIs, and.
Workshop on How to Publish Data in VO ESAC, June 25-June DAL (Data Access Layer) protocols Jesus Salgado
Colin Folsom (Armagh Observatory).  Read input  Calculate line components (Zeeman splitting)  Calculate continuum opacity (per window, per atmospheric.
Copyright © 2010, SAS Institute Inc. All rights reserved. SAS ® Using the SAS Grid.
1 The EDIT System, Overview European Commission – Eurostat.
Differences Training BAAN IVc-BaanERP 5.0c: Application Administration, Customization and Exchange BaanERP 5.0c Tools / Exchange.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
Using the ARCS Grid and Compute Cloud Jim McGovern.
Common Methods of Stellar Spectra Analysis and their Support in VO Petr Škoda Astronomical Institute Academy of Sciences Ondřejov Czech Republic ESA workshop.
Bookkeeping Tutorial. 2 Bookkeeping content  Contains records of all “jobs” and all “files” that are produced by production jobs  Job:  In fact technically.
Convert generic gUSE Portal into a science gateway Akos Balasko.
Identification of Important VO Spectral Services benefiting from deployment on the GRID Petr Škoda Astronomical Institute Academy of Sciences Ondřejov.
Introduction to the VO ESAVO ESA/ESAC – Madrid, Spain.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks On-line Visualization for Grid-based Astronomical.
Millions of Jobs or a few good solutions …. David Abramson Monash University MeSsAGE Lab X.
Application Specific Module Tutorial Zoltán Farkas, Ákos Balaskó 03/27/
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
The LGI Pilot job portal EGI Technical Forum 20 September 2011 Jan Just Keijser Willem van Engen Mark Somers.
VO for Ground-based Optical Spectroscopy Petr Škoda Astronomical Institute Academy of Sciences Ondřejov Czech Republic IVOA Interoperability meeting Data.
Petr Škoda, Jakub Koza Astronomical Institute Academy of Sciences
CX Introduction to Web Programming
Accessing the VI-SEEM infrastructure
SSA Revisited (Also SDM and SODA suggestions)
The Client/Server Database Environment
Asteroseismic Modeling Portal (AMP) Development
Dr.S.Sridhar, Director, RVCT, RVCE, Bangalore
Grid Computing.
Recap: introduction to e-science
Department of Computer Science Homepage
Support for ”interactive batch”
Information Technology Ms. Abeer Helwa
Stellar spectroscopy with XTGRID
OSU Quantum Information Seminar
Lecture 2 Components of GIS
Google Sky.
敦群數位科技有限公司(vanGene Digital Inc.) 游家德(Jade Yu.)
Best Practices in Higher Education Student Data Warehousing Forum
Presentation transcript:

KOREL-VO - The small RESTful "cloud" environment for stellar analysis Petr Škoda Jan Fuchs Petr Hadrava Astronomical Institute Academy of Sciences Ondřejov Czech Republic IVOA Interoperability meeting GWS Session 2, ESO Garching, 9 th November 2009

Spectra Disentangling ● For blended spectra of binary (multiple) stars – Number of spectra with good orbital coverage – Estimate of orbital parameters ● Wavelength space disentangling Simon & Sturm 1994, 2 * ● Fourier disentangling - Hadrava 1995, 1997 (independently ) ● KOREL (KORelation Elements x FOTEL) ● CCF, RV of blends, spectra decomposition ● Pulsation, models of limb darkening (gen. broadening fun) ● – still new theory – delta Cep Hadrava, Slechta & Skoda 2009 ● Super resolution of spectra (subpixels) Hadrava 2009

Spectra Disentangling in Fourier Space - KOREL HD208905: Koubsky et al. 2006

Disentangle modes - Pulsations Rho Pup – del Sct typeEps Cep - del Sct type

PREKOR tasks V436 Per Janík 2003 Select multiple regions Really s spectra Small regions (at sharp lines) Stack or overplot Check ranges before FFT rebin to common grid in ln(lamda) PREKOR role solved individually (Mathematica, MIDAS, Python) output KOREL.DAT in ASCII

KOREL Web Portal ● The only one place under full control of author ● The disentangling as SERVICE ● Provide program and HW (like e.g. firewals, mail filters) – Official tested version (approved by author) – Optimized for given HW (check of limits time, size) – Scalable – load balance, parallel, GRID ● User registration (authorization by author, science case) ● Shopping cart model, database - “E-shop” for service ● Documentation, Forums ● Binary code - compile on demand (many, long spectra).. ● Integration of graphics, easy forms, links, GUI =Web

KOREL Web Service ● The KOREL.DAT, KOREL.PAR left on user ● User autentication (and authorization - admin) ● Upload parametric and data files (2-3) ● Run jobs (asynch UWS) ● On-the fly output of png (ps), results on click ● List jobs of user – storage for limited time ● Re-editing parameters, resubmit ● Job control (queue, max mem, time, users ?) ● Component spectra for postprocessing - models

Concept of scientific „CLOUD“ ● One server for real number crunching (KOREL) ● Preparation of input - PREKOR ● Several postprocessing (SSA acref for VO data) ● preparing custom input files, applet for SPLAT? ● Another server for handling results – e.g. Check with theory – special postprocessing of output ● - components – convolve rotation, broadening... ● before comparison with TSAP data, user model..

Postprocessing - Dynamic Spectra Netolický 2004 Lambda Sco: Uytterhoeven 2004

Concept of scientific „CLOUD“ ● Why CLOUD ? – User does all the work outside his desktop SOMEWHERE – he does not care – He is asking the SERVICE and gets results – Using WWW browser - supercomputing in PDA/mobil – The machines OVER THERE work together for me –

NORMALIZED spectra in VO ● Most optical spectra in two versions ● Raw counts (unrectified, but wavelength calib) ● Normalized (1.0) – most of final reports (even artistic continuum – novae, molecular bands) ● How to present in VO ? ● 2 files, same metadata, FLUXCALIB=NORMALIZED → other directory? ● How to refer continuum curve ● Ratio, reference continuum ?

Spectra Postprocessing Service ● Normalization critical (continuum – long scale FT) ● Current funcionality ● Different ServiceURL for cutout (BAND select/cut) ● Future development ● Rebinning – how to specify in SSA ? ● Orders at echelle ? ASSOCIATION ● Transformation described by params (SSAv2???) ● Instrument profile (de)convolution ● Broadening functions (rotation, limb dark) ● RV shift ● Not all in client – several servers (transform pipe)