SONG Software1 SONG Cluster Software A few elements of the SONG software principles Søren Frandsen, Jonas B. Nielsen and Mads Fredslund Andersen Aarhus.

Slides:



Advertisements
Similar presentations
A distributed architecture for crystallography data, metadata, and applications John C. Bollinger Indiana University Molecular Structure Center, Bloomington,
Advertisements

KM Ticket Automation Process Flow Diagram. Local Components FC (Flow Computer) –Local proprietary computer that reads the meter. FDS (Field Data Server)
Nationaal Lucht- en Ruimtevaartlaboratorium National Aerospace Laboratory NLR CXXX-1A Edwin Wisse & Rob van Swol National Aerospace Laboratory Neonet A.
Database Architectures and the Web
OpenStack Open Source Cloud Software. OpenStack: The Mission "To produce the ubiquitous Open Source cloud computing platform that will meet the needs.
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
XSEDE 13 July 24, Galaxy Team: PSC Team:
Chapter 3 Database Architectures and the Web Pearson Education © 2009.
Chapter 13 (Web): Distributed Databases
UML Static diagrams. Static View: UML Component Diagram Component diagrams show the organization and dependencies among software components. Component:
Distributed Database Management Systems
Page 1JSOC Review – 17 March 2005 Database Servers Challenges A very large database on the order of a few TB -- We can't copy the whole database in real.
Overview Distributed vs. decentralized Why distributed databases
Stream Sharing Framework System Software Laboratory.
SONG – Stellar Observations Network Group - The robotic software for the SONG network S.Frandsen 1, Eric Weiss 1, J. Skottfelt 2, M.F. Andersen 1, F.Grundahl.
Chapter 3 Database Architectures and the Web Pearson Education © 2009.
Overview of the ODP Data Provider Sergey Sukhonosov National Oceanographic Data Centre, Russia Expert training on the Ocean Data Portal technology, Buenos.
Chinese SONG and mini-SONG Software Xiaomeng Lu National Astronomical Observatories, CAS 18 Sep, 2011 The 4 th Workshop.
SSI-OSCAR A Single System Image for OSCAR Clusters Geoffroy Vallée INRIA – PARIS project team COSET-1 June 26th, 2004.
Chapter 5 Lecture 2. Principles of Information Systems2 Objectives Understand Data definition language (DDL) and data dictionary Learn about popular DBMSs.
© Paradigm Publishing, Inc. 5-1 Chapter 5 Application Software Chapter 5 Application Software.
SAP R/3 System: Client Server Overview (Buck-Emden & Galimow, 1998) Dr. K. Palaniappan.
The Glidein Service Gideon Juve What are glideins? A technique for creating temporary, user- controlled Condor pools using resources from.
1 Support and Maintenance Kristi Jacobson 7/15/08.
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
Submitted by: Shailendra Kumar Sharma 06EYTCS049.
MapReduce: Simplified Data Processing on Large Clusters Jeffrey Dean and Sanjay Ghemawat.
J.T Moscicki CERN LCG - Software Process & Infrastructure1 SPI Software Process & Infrastructure for LCG Software Packaging and Distribution LCG Application.
Astrid: Astronomer’s Integrated Desktop Session 1: Introduction to Astrid & User Interface Overview October 5, 2005 Amy Shelton
Chapter 7: Database Systems Succeeding with Technology: Second Edition.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Cloud computing for internet emulator. Professor Muthucumaru Maheswaran Team Members Mia Hochar Simon Foucher David El Achkar David El Achkar Marc Atie.
Caravan Business Server a viable alternative development platform niti telecom consultancy april 2002.
Cosener’s House – 30 th Jan’031 LHCb Progress & Plans Nick Brook University of Bristol News & User Plans Technical Progress Review of deliverables.
Session-8 Data Management for Decision Support
Database Systems: Design, Implementation, and Management Tenth Edition Chapter 12 Distributed Database Management Systems.
Week 5 Lecture Distributed Database Management Systems Samuel ConnSamuel Conn, Asst Professor Suggestions for using the Lecture Slides.
SAM and D0 Grid Computing Igor Terekhov, FNAL/CD.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
FailSafe SGI’s High Availability Solution Mayank Vasa MTS, Linux FailSafe Gatekeeper
IODE Ocean Data Portal - ODP  The objective of the IODE Ocean Data Portal (ODP) is to facilitate and promote the exchange and dissemination of marine.
Near Real-Time Verification At The Forecast Systems Laboratory: An Operational Perspective Michael P. Kay (CIRES/FSL/NOAA) Jennifer L. Mahoney (FSL/NOAA)
Master Model Eric Poiseau Inria, Rennes. Purpose  Manage IHE concepts model  Manage tests definitions  Share concepts and test definition with more.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
Linux Operations and Administration
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid2Win : gLite for Microsoft Windows Roberto.
1 Standard Onboard Data Handling Architecture Based On SpaceWire Takahiro Yamada and Tadayuki Takahashi (JAXA/ISAS) November 2008 International SpaceWire.
TM 8-1 Copyright © 1999 Addison Wesley Longman, Inc. Client/Server and Middleware.
 Distributed Database Concepts  Parallel Vs Distributed Technology  Advantages  Additional Functions  Distribution Database Design  Data Fragmentation.
By:miguel iturrade.  A computer network is a group of computers that are connected to each other for the purpose of communication.
Rule Executor Detect Channel
HSC Queue Mode Implementation Plan ~ Stage I, II, III ~ Tae-Soo Pyo Subaru Telescope /01/15.
Database Environment Chapter 2. The Three-Level ANSI-SPARC Architecture External Level Conceptual Level Internal Level Physical Data.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI Mario Reale – GARR NetJobs: Network Monitoring Using Grid Jobs.
DCache features overview | Academia Sinica, Taipei| Patrick Fuhrmann | 17 March 2013 | 1 dCache federation design Head Node Request Headnode SITE Plus.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
SCD Monthly Projects Meeting 2014 Scientific Linux Update Rennie Scott January 14, 2014.
IT 5433 LM1. Learning Objectives Understand key terms in database Explain file processing systems List parts of a database environment Explain types of.
Introduction to Fabric Kiwi Team PSNC. E-VLBI system – general idea.
Consorzio COMETA - Progetto PI2S2 UNIONE EUROPEA Grid2Win : gLite for Microsoft Windows Elisa Ingrà - INFN.
ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.
Consulting Services JobScheduler Architecture Decision Template
Database Architectures and the Web
Distributed Database Management Systems
Exemplar CFS Architecture
Consulting Services JobScheduler Architecture Decision Template
Distributed Systems CS
Database Architectures and the Web
Comparison of LAN, MAN, WAN
Distributed Systems CS
Presentation transcript:

SONG Software1 SONG Cluster Software A few elements of the SONG software principles Søren Frandsen, Jonas B. Nielsen and Mads Fredslund Andersen Aarhus University

SONG Software2 Simplified Architecture Central Site Remote Site 1Remote Site 2Remote Site 3 Remote Site 4Remote Site 8 Remote Site 7Remote Site 6Remote Site 5 Flow: Both data and files

SONG Software3 Requirements All communication between sites via the database One central site and eight remote sites Central site center of communication (a star architecture) Autonymous remote sites Continue work if communication is lost Eventually consistent Open-source tools Linux based

SONG Software4 Major Software Component DBMS: PostgreSQL Database Replication: Slony-I File Replication: GlusterFShttp:// All Open source projects/products Mature projects Good release cyclus Good documentation

SONG Software5 dispatcher commands Obs. request web_cam_1 dispatcher_status or_status Database Replication, Overview web_cam_1 dispatcher_status or_status dispatcher commands Obs. request web_cam_1 dispatcher_status or_status dispatcher commands Obs. request web_cam_1 dispatcher_status or_status Remote Node 2Remote Node 1 Central Node

SONG Software6 dispatchercommands dispatcher scheduler worker Work processes Obs. requestdispatchercommandsObs. request slony Central SiteRemote Site n web_cam_1dispatcher_statusor_status... web_cam_1dispatcher_statusor_status... Telescope checker Weather house hold dispatcher

SONG Software7 Ordering an observation: Observing requests Central: OR_handler.py Site 1: OR_executer.py