Grid-Integration of Robotic Telescopes

Slides:



Advertisements
Similar presentations
1 Copyright © 2002 Pearson Education, Inc.. 2 Chapter 1 Introduction to Perl and CGI.
Advertisements

IST Humboldt University Berlin, Germany – Computer and Media Service – Electronic Publishing Group Birgit Matthaei, 4th Sept. 2003, Bath,
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Provenance in Open Distributed Information Systems Syed Imran Jami PhD Candidate FAST-NU.
1 Introduction to XML. XML eXtensible implies that users define tag content Markup implies it is a coded document Language implies it is a metalanguage.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
SONG – Stellar Observations Network Group - The robotic software for the SONG network S.Frandsen 1, Eric Weiss 1, J. Skottfelt 2, M.F. Andersen 1, F.Grundahl.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Databases and the Internet. Lecture Objectives Databases and the Internet Characteristics and Benefits of Internet Server-Side vs. Client-Side Special.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
Data Management Subsystem: Data Processing, Calibration and Archive Systems for JWST with implications for HST Gretchen Greene & Perry Greenfield.
GRITS Working with AVM Data Astronomy Visualization Metadata June 11th, 2010 Casey Rosenthal
OracleAS Reports Services. Problem Statement To simplify the process of managing, creating and execution of Oracle Reports.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
5th GridLab Review, 8 April 2005, Amsterdam WP12: Access for mobile users What's new in mobile user support Piotr Grabowski, Bartek Lewandowski
At A Glance VOLT is a freeware, platform independent tool set that coordinates cross-mission observation planning and scheduling among one or more space.
NeSC Apps Workshop July 20 th, 2002 Customizable command line tools for Grids Ian Kelley + Gabrielle Allen Max Planck Institute for Gravitational Physics.
2004/12/02Slide Number 1 of 15 Exposure Time Calculator (ETC) as a Web Service Donald McLean 2004 Technology Open House.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
Implementing an Observational Grid Eric Saunders Alasdair Allan Tim Naylor University of Exeter Iain Steele Chris Mottram Liverpool John Moores University.
Advanced Techniques for Scheduling, Reservation, and Access Management for Remote Laboratories Wolfgang Ziegler, Oliver Wäldrich Fraunhofer Institute SCAI.
Ontologies and Lexical Semantic Networks, Their Editing and Browsing Pavel Smrž and Martin Povolný Faculty of Informatics,
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Grids - the near future Mark Hayes NIEeS Summer School 2003.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
Mantid Stakeholder Review Nick Draper 01/11/2007.
H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Simple Object Access Protocol
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
Chapter 04 Semantic Web Application Architecture 23 November 2015 A Team 오혜성, 조형헌, 권윤, 신동준, 이인용.
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
XML and Distributed Applications By Quddus Chong Presentation for CS551 – Fall 2001.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Introduction: AstroGrid increases scientific research possibilities by enabling access to distributed astronomical data and information resources. AstroGrid.
GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 1 Providing Remote Access.
Integraion und Steuerung von verteilten Sensorsystemen Grid-Package for a Robotic Telescope Network (RTN) Geoforschungszentrum Potsdam 2010 October 20.
AstroGrid -D Job-Monitoring in AstroGrid-D with GRAM-audit-logging S. Braune, F. Breitling, H. Enke, AIP.
The Abdus Salam ICTP Trieste, Workshop on Scientific Instruments and Sensors on the Grid Integration of Robotic Telescopes Frank Breitling 1.
1 RDF Storage and Retrieval Systems Jan Pettersen Nytun, UiA.
AstroGrid-D Host Monitoring in AstroGrid-D with GRAM-Audit or SGAS based on Usage Records Format S. Braune, F. Breitling, H. Enke AIP.
GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 1 Providing Remote Access.
Session: Towards systematically curating and integrating
Workload Management Workpackage
GPIR GridPort Information Repository
MSSL Astrogrid Workshop
Strategies for NIS Development
From LSE-30: Observatory System Spec.
Community Science Updates
NRAO VLA Archive Survey
TeraGrid Information Services Developer Introduction
GF and RS, Dept. of CS, Mangalore University
Middleware independent Information Service
Grid Portal Services IeSE (the Integrated e-Science Environment)
HMA Follow On Activities
Database Management System (DBMS)
Module 01 ETICS Overview ETICS Online Tutorials
LOD reference architecture
Wide Area Workload Management Work Package DATAGRID project
Google Sky.
Database Connectivity and Web Development
Presentation transcript:

Grid-Integration of Robotic Telescopes Hot-wiring the Transient Universe: A Joint VOEvent & HTN Workshop @ The University of Arizona in Tucson 4-7 June 2007 Frank Breitling fbreitling at aip.de Astrophysikalisches Institut Potsdam University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Overview Introduction Robotic Telescopes of the AIP Grid Architecture User Interfaces Summary University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Introduction: Astrophysical Institute Potsdam (http://www.aip.de/) located in Potsdam, 30 km west of Berlin, Germany, near the beautiful Schloßpark Babelsberg not Max-Planck but long history, founded as the “Berliner Sternwarte” in 1711 e.g. Schwarzschild was once the director edits the worlds oldest astro-nomical journal that is still being published since 1821 (journal for this proceedings) involved in many international projects (e.g. XMM-Newton, LBT, ICE-T, LOFAR, AstroGrid-D) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Introduction: The AstroGrid-D Project AstroGrid-D is the name of the German Astronomy Community Grid http://www.gac-grid.org/ a collaboration of 14 German institutes (20 people x 3 years) under the leadership of the AIP funded by the German Ministry of Education and Research part of the D-Grid AstroGrid-D pursues the development of a network of robotic telescopes using grid technology. University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Introduction: Why grid technology? A grid provides what is needed for a robotic telescope-network virtual organization (VO) management manage the access of collaborations to telescopes resource management integration and monitoring of the individual telescopes job management scheduling or canceling of observations data management - immediate access to the data metadata management information about what is going on in the network immediate access to compute and storage resources of the grid for subsequent data analysis University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Robotic telescopes: Robotel AIP, Potsdam, Germany (80m asl) 0.8m telescope CCD Camera for imaging and photometry Objectives Education, 50% of observation time is dedicated to schools and universities Testing of new instruments, software and methods for Stella-I & Stella-II developed, owned and operated by the AIP! Robotel in its dome at the AIP University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Robotic telescopes: Stella-I & Stella-II Teide Observatory, Tenerife, Canary Islands, Spain (2480m) Two 1.2m telescopes Instruments Spectrograph (operating since May 2006) Imaging photometer (commissioning in fall 2007) Scientific Objectives Doppler imaging Search for extrasolar planets Spectroscopic surveys Simultaneous observations with larger facilities developed, owned and operated by the AIP! Stella-I and Stella-II at the Teide Observatory in Tenerife. The shelter is opened as for observation. University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Robotic telescopes: Wolfgang(T6)& Amadeus(T7) Fairborn Observatory*, Patagonia, Arizona, USA, (1600m asl) Two 0.75m telescopes Photoelectric photometry Scientific Objectives study variability timescales and life times of starspots, i.e. photometric long-term monitoring of stars over years Support other observations operated by the AIP! Fairborn observatory, building 2 with open roof showing telescopes T5 (background) through T8 (foreground). *The Fairborn Observatory is a non-profit corporation dedicated to advancement of automated astronomy (http://www.fairobs.org/). University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Robotic telescopes: Stella Control System Sequencer Scheduler CCD Spectrograph Adapter Telescope sequence definition object database command templates target commands to physical devices via TCP/IP or RMI description The Stella Control System (SCS) is used for Stella-I & II and Robotel developed at the AIP (T. Granzer) is a Java-RMI based controller software has an interactive and automatic operation mode has simulation mode for testing and development (e.g. of the grid- integration) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: Overview Computer Center RDF Metadata RDF Metadata RDF Metadata RDF Metadata Information Server Stellaris SPARQL Data AIP Observer's Office Robotel RTML target RTML target RTML target RTML target RTML target globusrun-ws RTML target RTML target SCS Workstation Globus Toolkit Telescope Server Globus Toolkit University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: Overview Extension to a Network by - introducing a scheduler - adding more telescopes Computer Center RDF Metadata RDF Metadata RDF Metadata RDF Metadata Information Server Stellaris SPARQL Data AIP Observer's Office Robotel RTML target RTML target RTML target RTML target RTML target globusrun-ws RTML target RTML target SCS Scheduler Server Globus Toolkit Telescope Server Globus Toolkit University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: Grid Middleware which provides Job management: WS GRAM (Grid Resource and Allocation Manager) with web service interface through endpoint reference (EPR) An elementary set of grid commands for the job management, interactive access to resources and file transfer (globusrun-ws -submit / -status / -cancle, gsissh, gsiftp) Resource monitoring Virtual Organization (VO) management which is adapted by the AIP (VOMRS) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: RTML Remote Telescope Markup Language (RTML) XML format defined through RMTL schema: http://monet.uni- sw.gwdg.de/XMLSchema/RTML/schemas/RTML-nightly.xsd provides description of elementary static and dynamic metadata (e.g. telescope hardware, setup and status, source catalogs, observation requests, observation history, schedules, weather information) standard defined by the Heterogeneous Telescope Network (HTN) http://monet.uni-sw.gwdg.de/twiki/bin/view/RTML/WebHome adopted in AstroGrid-D University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: Information Service Stellaris development of AstroGrid-D by the ZIB (M. Högqvist) available at http://www.gac-grid.org/ (Apache License) is used by AstroGrid-D for grid resource monitoring (e.g. compute resources, telescopes) job monitoring tested and runs stable metadata is exchanged and stored in RDF University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: RDF RDF (Resource Description Framework) standard for storing information is based on graph theory it presents information in triples as different formats exist RDF/XML (W3C recommendation) Notation 3 (N3) (W3C specification) is a development of the semantic web the SPARQL query language exists for retrieval of RDF information Subject Object Predicate University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: RDF graph example of a partial RDF graph represents the location information of Stella-I (static metadata) g e n i d : U D X p K E w 3 4 2 8 m t r s 5 7 6 Izana Observatory, Teneriffa, E 1 9 . http://www.rtml.org/#value http://www.rtml.org/#units http://www.rtml.org/#name http://www.rtml.org/#height http://www.rtml.org/#EastLongitude http://www.rtml.org/#Latitude Obtained with W3C RDF Validation Service (http://www.w3.org/RDF/Validator/) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Grid Architecture: XSLT for Stellaris a conversion from RTML documents into RDF required developed an XSLT (Extensible Stylesheet Language Transformation) at AIP can transform arbitrary XML files into RDF/XML format (e.g. RTML) usage very simple, only two command line programs xsltproc cURL for uploading to Stellaris available at http://www.gac-grid.org/ (Apache License) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

User Interfaces: SPARQL SPARQL Query Language for RDF (W3C working draft) is the counterpart for re-trieving information from RDF simple syntax for selected and sorted retrieval of information Perl modules exist for the integration into Perl scripts SPARQL web browser interface is implemented into Stellaris for a quick lookup of information The Stellaris SPARQL query interface for a web bowser. The SPARQL query retrieves the geographic location of all available telescopes sorted by their altitude. University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

User Interfaces: Telescope Map Web browser user interface Developed in AstroGrid-D by the ZIB (M. Högqvist) and AIP (F. Breitling) to access and display telescope metadata Based on Google Maps and SPARQL available at http://www.gac- grid.org/ (Apache License) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

User Interfaces: Job Monitoring Web browser user interface Developed in AstroGrid-D by the ZIB (M. Högqvist) & AIP (F. Breitling) currently used to display job-state metadata Based on „Simile“ Timeline like Google Maps for time- based information a DHTML-based AJAXy widget for visualizing time- based events. http://simile.mit.edu/timeline/ available at http://www.gac-grid.org/ (Apache License) University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Summary: Achievements five robotic telescopes of the AIP are already operating robotically and are ready for network-operation an architecture for the grid integration has been developed an information service is ready metadata of telescopes and observations can be provided user interfaces are available for accessing the metadata the implementation of the Globus job management using WS GRAM is currently under development tests using the original Stella Control System are ongoing University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes

Summary: Next steps providing dynamic metadata e.g. telescope states, weather information, recorded data developing a versatile scheduler which uses static metadata, e.g. capabilities of telescopes, location dynamic metadata, e.g. weather information, target visibilities, observation schedules multiple telescopes testing of a simulated and a real network first network observations show that it works well participate in campaigns with other networks University of Arizona in Tucson, June 4-7 2007 Hot-wiring the Transient Universe Grid-Integration of Robotic Telescopes