GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 1 Providing Remote Access.

Slides:



Advertisements
Similar presentations
1 Copyright © 2002 Pearson Education, Inc.. 2 Chapter 1 Introduction to Perl and CGI.
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
1 CEOS/WGISS20 – Kyiv – September 13, 2005 Paul Kopp SIPAD New Generation: Dominique Heulet CNES 18, Avenue E.Belin Toulouse Cedex 9 France
Connect. Communicate. Collaborate Click to edit Master title style MODULE 1: perfSONAR TECHNICAL OVERVIEW.
Provenance in Open Distributed Information Systems Syed Imran Jami PhD Candidate FAST-NU.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
INTERNET DATABASE. Internet and E-commerce Internet – a worldwide collection of interconnected computer network Internet – a worldwide collection of interconnected.
2006 IEEE International Conference on Web Services ICWS 2006 Overview.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
SONG – Stellar Observations Network Group - The robotic software for the SONG network S.Frandsen 1, Eric Weiss 1, J. Skottfelt 2, M.F. Andersen 1, F.Grundahl.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Databases and the Internet. Lecture Objectives Databases and the Internet Characteristics and Benefits of Internet Server-Side vs. Client-Side Special.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
GRITS Working with AVM Data Astronomy Visualization Metadata June 11th, 2010 Casey Rosenthal
DISTRIBUTED COMPUTING
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
2004/12/02Slide Number 1 of 15 Exposure Time Calculator (ETC) as a Web Service Donald McLean 2004 Technology Open House.
4th EGEE user forum / OGF 25 Catania, TheoSSA on AstroGrid-D Iliya Nickelt (AIP / GAVO), Thomas Rauch (IAAT / GAVO), Harry Enke (AIP.
Implementing an Observational Grid Eric Saunders Alasdair Allan Tim Naylor University of Exeter Iain Steele Chris Mottram Liverpool John Moores University.
1 All-Hands Meeting 2-4 th Sept 2003 e-Science Centre The Data Portal Glen Drinkwater.
WEB BASED DATA TRANSFORMATION USING XML, JAVA Group members: Darius Balarashti & Matt Smith.
1 5th AstroGrid-D Meeting, MPE Garching Frank Breiting, AIP November 14, 2006 Status of the Dynamo Use Case as prepared by Michael Braun Frank Breitling.
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Grids - the near future Mark Hayes NIEeS Summer School 2003.
1 Computing Challenges for the Square Kilometre Array Mathai Joseph & Harrick Vin Tata Research Development & Design Centre Pune, India CHEP Mumbai 16.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
GO-ESSP Workshop, LLNL, Livermore, CA, Jun 19-21, 2006, Center for ATmosphere sciences and Earthquake Researches Construction of e-science Environment.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
AstroGrid-D and GAVO AstroGrid-D: Infrastructure Network, Computing Resources Grid-Technology, Middleware GAVO: Interoperability of archives.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
German Astrophysical Virtual Observatory Overview and Results So Far W. Voges, G. Lemson, H.-M. Adorf.
H. Widmann (M&D) Data Discovery and Processing within C3Grid GO-ESSP/LLNL / June, 19 th 2006 / 1 Data Discovery and Basic Processing within the German.
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
EGEE is a project funded by the European Union under contract IST Introduction to Web Services 3 – 4 June
The AstroGrid-D Information Service Stellaris A central grid component to store, manage and transform metadata - and connect to the VO!
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
NAREGI PSE with ACS S.Kawata 1, H.Usami 2, M.Yamada 3, Y.Miyahara 3, Y.Hayase 4 1 Utsunomiya University 2 National Institute of Informatics 3 FUJITSU Limited.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 1 Providing Remote Access.
Integraion und Steuerung von verteilten Sensorsystemen Grid-Package for a Robotic Telescope Network (RTN) Geoforschungszentrum Potsdam 2010 October 20.
AstroGrid -D Job-Monitoring in AstroGrid-D with GRAM-audit-logging S. Braune, F. Breitling, H. Enke, AIP.
The Abdus Salam ICTP Trieste, Workshop on Scientific Instruments and Sensors on the Grid Integration of Robotic Telescopes Frank Breitling 1.
Database Principles: Fundamentals of Design, Implementation, and Management Chapter 1 The Database Approach.
AstroGrid-D Host Monitoring in AstroGrid-D with GRAM-Audit or SGAS based on Usage Records Format S. Braune, F. Breitling, H. Enke AIP.
Distributed Control and Measurement via the Internet
The Operations Portal and the Grid Operations Interoperability
MSSL Astrogrid Workshop
From LSE-30: Observatory System Spec.
Grid-Integration of Robotic Telescopes
GF and RS, Dept. of CS, Mangalore University
Middleware independent Information Service
Grid Portal Services IeSE (the Integrated e-Science Environment)
Recap: introduction to e-science
gLite Information System
#01 Client/Server Computing
HMA Follow On Activities
Copyright © 2011 Pearson Education, Inc. Publishing as Pearson Addison-Wesley Chapter 2 Database System Concepts and Architecture.
Database Management System (DBMS)
The Globus Toolkit™: Information Services
PREMIS Tools and Services
Module 01 ETICS Overview ETICS Online Tutorials
EGEE Middleware: gLite Information Systems (IS)
LOD reference architecture
Google Sky.
Status of Grids for HEP and HENP
Data Management Components for a Research Data Archive
Grid Computing Software Interface
#01 Client/Server Computing
Presentation transcript:

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 1 Providing Remote Access to Robotic Telescopes by Adopting Grid Technology German e-Science Conference 2007 Baden-Baden, Germany May 2007 Thomas Granzer Frank Breitling Thomas Roeblitz (ZIB), Harry Enke (AIP), Michael Braun (AIP) Astrogrid-D

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 2 Overview Introduction Robotic Telescopes Components for the Integration Metadata Management Summary

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 3 Introduction: Astrophysical Institute Potsdam located in Potsdam ca. 30km west of Berlin, Germany, near the Schloßpark Babelsberg old institute with a long tradition - founded as the “Berliner Sternwarte” in 1711 still edits the worlds oldest astronomical journal that is still being published (1821) involved in many international projects (e.g. LBT, LOFAR, ICE-T, RAVE, PEPSI, PMAS, XMM- Newton, AstroGrid-D) more info at

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 4 Introduction: The AstroGrid-D project AstroGrid-D is  the name of the German Astronomy Community Grid grid.org/  a collaboration of 14 German institutes under the leadership of the AIP.  funded by the German Ministry of Education and Research  part of the D-Grid AstroGrid-D pursues the  development of a network of  robotic telescopes  using grid technology.

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 5 Introduction: Why robotic telescopes? Achieve optimal usage of the available observation time by minimal overhead times (fast operation) Allow fastest possible reaction to new discoveries (current record 5 sec.) Reduce costs of operation (e.g. no travel expenses, less infrastructure) Operation at remote and/or less developed sites becomes possible (e.g. Antarctica) More and more robotic telescopes become available, thusindividual costs are reduced.

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 6 Access to almost the entire sky at any time, without limitations of daytimes or the weather:  uninterrupted monitoring of long-term targets (e.g. stellar pulsation, search for extrasolar planets)  transient objects (e.g. GRBs) will always be accessible from parts of the network Simultaneous observations are possible:  multi-wavelength campaign  support of large facilities Eases the operation through:  standard interfaces for the operation  standard access to the data  reduced administrative barriers Access to almost the entire sky at any time, without limitations of daytimes or the weather:  uninterrupted monitoring of long-term targets (e.g. stellar pulsation, search for extrasolar planets)  transient objects (e.g. GRBs) will always be accessible from parts of the network Simultaneous observations are possible:  multi-wavelength campaign  support of large facilities Eases the operation through:  standard interfaces for the operation  standard access to the data  reduced administrative barriers

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 7 Introduction: Can grid technology be applied? Robotic telescopes can be treated as special resources in a grid. A robotic telescope executes a special job, an observation of a target. A similar approach can be seen in the International Virtual Observatory Association (observations already done: databases, observations ought to be done: telescopes)...but the essential difference is in scheduling the jobs! The time when an observation is executed may decide its scientific usefulness

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 8 Useful components have already been developed: Virtual organization (VO) management Resource management Job management Data management Metadata management Introduction: Why grid technology?

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 9 Robotic telescopes:Stella-I & Stella-II Teide Observatory, Tenerife, Canary Islands, Spain (2480m asl) Two 1.2m telescopes Instruments  Spectrograph  Imaging photometer Scientific Objectives  Doppler imaging  Search for extrasolar planets  Spectroscopic surveys  Simultaneous observations with larger facilities developed, owned and operated by the AIP, ideal testbed! Stella-I and Stella-II at the Teide Observatory in Tenerife. The shelter is opened as for observation.

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 10 Sequencer Scheduler CCD Spectrogra ph AdapterTelescope sequence definition object database command templates target commands to physical devices via TCP/IP or RS323 etc. target description Robotic telescopes: Stella Control System The Stella Control System (SCS) Generic operations package, is used for Stella-I & II and RoboTel Java based software, linked to outside world via RMI has an interactive and automatic operation mode has simulation mode for testing and development (e.g. of the grid-integration)

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 11 Workstation Globus Toolkit Workstation Globus Toolkit SC S RTML target RTML target RTML target RTML target RTML target Telescope Server Globus Toolkit Telescope Server Globus Toolkit RTML target RTML target RTML target Robotel AIP Observer's Office Information Server Stellaris Information Server Stellaris Computer Center SPARQL Data SPARQL Data RDF Metadata RDF Metadata RDF Metadata Components for the Integration: Architecture globusrun-ws RDF Metadata RDF Metadata

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 12 Components for the Integration: Architecture Scheduler Server Globus Toolkit Scheduler Server Globus Toolkit SC S RTML target RTML target RTML target RTML target RTML target Telescope Server Globus Toolkit Telescope Server Globus Toolkit RTML target RTML target RTML target Robotel AIP Observer's Office Information Server Stellaris Information Server Stellaris Computer Center SPARQL Data SPARQL Data RDF Metadata RDF Metadata RDF Metadata RDF Metadata RDF Metadata Extension to a Network by - introducing a scheduler - adding more telescopes globusrun-ws

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 13 Components for the Integration: Middleware which provides Job management:  WS GRAM (Grid Resource and Allocation Manager) with web service interface through endpoint reference (EPR)  An elementary set of grid commands for the job management, interactive access to resources and file transfer (globusrun-ws -submit / -status / -cancle, gsissh, gsiftp) Resource monitoring Virtual Organization (VO) management which is adapted by the AIP (VOMRS)

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 14 Components for the Integration: RTML Remote Telescope Markup Language (RTML) XML format defined through RMTL schema: sw.gwdg.de/XMLSchema/RTML/schemas/RTML-nightly.xsd provides description of elementary static and dynamic metadata (e.g. telescope hardware, setup and status, source catalogs, observation requests, observation history, schedules, weather information) standard defined by the Heterogeneous Telescope Network (HTN) adopted in AstroGrid-D

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 15 Metadata Management: Informations Service Stellaris development of AstroGrid-D by the ZIB (M. Högqvist) available at (Apache License) is used by AstroGrid-D for  grid resource monitoring (e.g. compute resources, telescopes)  job monitoring tested and runs stable metadata is exchanged and stored in RDF

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 16 Metadata Management: RDF RDF (Resource Description Framework) standard for storing of information is based on graph theory it presents information in triples as different formats exist  RDF/XML (W3C recommendation)  Notation 3 (N3) (W3C specification) is a development of the semantic web the SPARQL query language exists for retrieval of RDF information Subje ct Object Predicate

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 17 Metadata Management: RDF graph example of a partial RDF graph represents the location information of Stella-I (static metadata) Obtained with W3C RDF Validation Service (

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 18 Metadata Management: XSLT for Stellaris a conversion from RTML documents into RDF required developed an XSLT (Extensible Stylesheet Language Transformation) at AIP can transform arbitrary XML files into RDF/XML format (e.g. RTML) usage very simple, only two command line programs  xsltproc  cURL for uploading to Stellaris available at (Apache License)

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 19 Metadata Management: SPARQL SPARQL Query Language for RDF (W3C working draft) is the counterpart for RDF for retrieving information simple syntax for selected and sorted retrieval of information Perl modules exist for the integration into Perl scripts SPARQL web browser interface is implemented into Stellaris for a quick lookup of information The Stellaris SPARQL query interface for a web bowser. The SPARQL query retrieves the geographic location of all available telescopes sorted by their altitude.

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 20 Metadata Management: Telescope Map Web browser user interface Developed in AstroGrid-D by the ZIB (M. Högqvist) and AIP (F. Breitling) for access and display of telescope metadata Based on Google Maps and SPARQL available at grid.org/ (Apache License) grid.org/

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 21 Metadata Management: Job Monitoring Web browser user interface Developed in AstroGrid-D by the ZIB (M. Högqvist) & AIP (F. Breitling) currently used to display job-state metadata Based on „Simile“ Timeline  like Google Maps for time-based information  a DHTML-based AJAXy widget for visualizing time-based events.  available at (Apache License)

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 22 Summary: Achievements Five robotic telescopes are available to the AIP An architecture for the grid integration has been developed Metadata management has made progress  Information service has been developed  Metadata of telescope resources and observations can be provided  User interfaces are available for accessing the metadata The job management using the Globus WS GRAM is under development using a the Stella Control System in Simulation mode

GES 2007 Baden-Baden, Providing Remote Access to Robotic Telescopes by adopting Grid Technology T. Granzer & F. Breitling 23 Summary: Next steps Providing of dynamic metadata of e.g. telescope states, weather information, recorded data, observation history Develope versatile scheduler which uses  static metadata, e.g. capabilities of telescopes, location  dynamic metadata, e.g. weather information, target visibilities, observation schedules  metadata of other telescopes simulation and testing of a network first observations proof that a network of robotic telescopes can be a very powerful instrument