SAM projects status Robert Illingworth 29 August 2012.

Slides:



Advertisements
Similar presentations
Netscape Application Server Application Server for Business-Critical Applications Presented By : Khalid Ahmed DS Fall 98.
Advertisements

Grid and CDB Janusz Martyniak, Imperial College London MICE CM37 Analysis, Software and Reconstruction.
Distributed components
Web Servers How do our requests for resources on the Internet get handled? Can they be located anywhere? Global?
Background Info The UK Mirror Service provides mirror copies of data and programs from many sources all over the world. This enables users in the UK to.
Oxford Jan 2005 RAL Computing 1 RAL Computing Implementing the computing model: SAM and the Grid Nick West.
Implementing ISA Server Caching. Caching Overview ISA Server supports caching as a way to improve the speed of retrieving information from the Internet.
Data Grid Web Services Chip Watson Jie Chen, Ying Chen, Bryan Hess, Walt Akers.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
Experiences Deploying Xrootd at RAL Chris Brew (RAL)
XOMB Incrementally scalable architecture for middleboxes Presenter : Donghwi Kim.
CIM6400 CTNW (04/05) 1 CIM6400 CTNW Lesson 6 – More on Windows 2000.
OCLC Online Computer Library Center Kathy Kie December 2007 OCLC Cataloging & Metadata Services an introduction.
CDF Grid Status Stefan Stonjek 05-Jul th GridPP meeting / Durham.
CH1. Hardware: CPU: Ex: compute server (executes processor-intensive applications for clients), Other servers, such as file servers, do some computation.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
NOVA Networked Object-based EnVironment for Analysis P. Nevski, A. Vaniachine, T. Wenaus NOVA is a project to develop distributed object oriented physics.
Architectural pattern: Interceptor Source: POSA II pp 109 – 140POSA II Environment: developing frameworks that can be extended transparently Recurring.
ESD Support for UNIX Applications Yet another common direction.
3-Tier Architecture Chandrasekaran Rajagopalan Cs /01/99.
CS 501: Software Engineering Fall 1999 Lecture 12 System Architecture III Distributed Objects.
Database Server Concepts and Possibilities Lee Lueking D0 Data Browser Workshop April 8, 2002.
STAR C OMPUTING STAR Analysis Operations and Issues Torre Wenaus BNL STAR PWG Videoconference BNL August 13, 1999.
The GridPP DIRAC project DIRAC for non-LHC communities.
1 Microsoft Outlook Web Access Outlook Web Access Overview Outlook Web Access Environments.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Storage Netværk Mød Microsoft Feb 2005, Agenda Data Protection Server (opdatering) Microsoft og iSCSI Demo.
The GridPP DIRAC project DIRAC for non-LHC communities.
A Data Handling System for Modern and Future Fermilab Experiments Robert Illingworth Fermilab Scientific Computing Division.
Introduction of Wget. Wget Wget is a package for retrieving files using HTTP and FTP, the most widely-used Internet protocols. Wget is non-interactive,
1 Distributed Systems Architectures Distributed object architectures Reference: ©Ian Sommerville 2000 Software Engineering, 6th edition.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Introduction The concept of a web framework originates from the basic idea that every web application obtains its foundations from a similar set of guidelines.
CERN IT-Storage Strategy Outlook Alberto Pace, Luca Mascetti, Julien Leduc
XenData SX-10 LTO Archive Appliance
BUILD SECURE PRODUCTS AND SERVICES
Nithyamoorthy S Core Mind Technologies
KID - KLOE Integrated Dataflow
Scalable sync-and-share service with dCache
Why the Web?.
WP18, High-speed data recording Krzysztof Wrona, European XFEL
What are they? The Package Repository Client is a set of Tcl scripts that are capable of locating, downloading, and installing packages for both Tcl and.
The Client-Server Model
Netscape Application Server
Vincenzo Spinoso EGI.eu/INFN
DLA Library Audio Collection
Handling Errors in Web Applications
What is WWW? The term WWW refers to the World Wide Web or simply the Web. The World Wide Web consists of all the public Web sites connected to the Internet.
Data Bridge Solving diverse data access in scientific applications
ALICE Monitoring
Cross Platform Development using Software Matrix
Data Management and Database Framework for the MICE Experiment
Some bits on how it works
The Client/Server Database Environment
System Architecture & Hardware Configurations
Servlet API and Lifecycle
ALICE Computing Upgrade Predrag Buncic
Providing Network Services
XenData SX-550 LTO Archive Servers
A Web-Based Data Grid Chip Watson, Ian Bird, Jie Chen,
Distributed Systems Bina Ramamurthy 11/30/2018 B.Ramamurthy.
Objectives In this lesson you will learn about: Need for servlets
Communications & Computer Networks Resource Notes - Introduction
Internet Protocols IP: Internet Protocol
Outline Chapter 2 (cont) OS Design OS structure
Distributed Systems Bina Ramamurthy 4/22/2019 B.Ramamurthy.
Web Servers (IIS and Apache)
Sending data to EUROSTAT using STATEL and STADIUM web client
DIBBs Brown Dog BDFiddle
Presentation transcript:

SAM projects status Robert Illingworth 29 August 2012

SAMWeb motivations Original SAM used CORBA for client/server communication – Reasonable choice 15 years ago, but… Complicated Inflexible and inextensible interfaces Clients require large libraries to use Technology moves on – HTTP basis for a standardized, flexible protocol – Clients built in to almost all languages – Off the shelf solutions for caching, load balancing, etc – Use of SAM by IF experiments gives us opportunity to transition to new system 28/29/12SAM project status

SAMWeb status Sufficient interfaces to access files (“run projects”) implemented – Initially just a bridge to CORBA – Just added to Minerva job submission (by Dennis Box). The same implementation should work for NOvA Long term objective is to remove CORBA entirely Currently working on implementing remaining user interfaces as direct, non-bridged – New file query functionality deployed for NOvA. Will switch Minerva to it soon Provide web browser interface for querying 8/29/12SAM project status3

8/29/12SAM project status4

File Transfer System Started as NOvA project to handle cataloguing and uploading of raw data from online system to disk and tape – Deployed at near detector for over a year Far detector functionality (forwarding files to intermediate location) tested, but not yet deployed Extending it to handle offline files – Files can be dropped in a directory; FTS will catalogue the metadata and copy the file to the appropriate disk and tape locations 8/29/12SAM project status5

8/29/12SAM project status6

FTS plans Although written for NOvA, mostly generic SAM functionality – Useable by any experiment that uses SAM – Metadata extraction requires customization Plan to benefit from ART functionality to have fully self-describing files Implemented using SAM CORBA interface – Intend to rewrite using web interface; totally transparent to users 8/29/12SAM project status7