MONITORING CMS TRACKER CONSTRUCTION AND DATA QUALITY USING A GRID/WEB SERVICE BASED ON A VISUALIZATION TOOL G. ZITO, M.S. MENNEA, A. REGANO Dipartimento.

Slides:



Advertisements
Similar presentations
Welcome to Middleware Joseph Amrithraj
Advertisements

Web Services at IRIS DMC Joanna Muench Linus Kamb.
Database System Concepts and Architecture
Web Service Ahmed Gamal Ahmed Nile University Bioinformatics Group
RPC Robert Grimm New York University Remote Procedure Calls.
Chapter 5 Operating Systems. 5 The Operating System When working with multimedia, the operating system is perhaps the most important, the most complex,
G O B E Y O N D C O N V E N T I O N WORF: Developing DB2 UDB based Web Services on a Websphere Application Server Kris Van Thillo, ABIS Training & Consulting.
CS 571. Web services Web service: "a software system designed to support interoperable machine-to-machine interaction over a network“ – W3C In short,
Notes to the presenter. I would like to thank Jim Waldo, Jon Bostrom, and Dennis Govoni. They helped me put this presentation together for the field.
J2ME Web Services Specification.  With the promise to ease interoperability and allow for large scale software collaboration over the Internet by offering.
Liang, Introduction to Java Programming, Seventh Edition, (c) 2009 Pearson Education, Inc. All rights reserved Chapter 42 Web Services.
XML Technologies and Applications Rajshekhar Sunderraman Department of Computer Science Georgia State University Atlanta, GA 30302
Web Servers How do our requests for resources on the Internet get handled? Can they be located anywhere? Global?
Computer Science 101 Web Access to Databases Overview of Web Access to Databases.
Client/Server Architecture
CS 415 N-Tier Application Development By Umair Ashraf July 6,2013 National University of Computer and Emerging Sciences Lecture # 9 Introduction to Web.
Web services A Web service is an interface that describes a collection of operations that are network-accessible through standardized XML messaging. A.
Web service testing Group D5. What are Web Services? XML is the basis for Web services Web services are application components Web services communicate.
M. Taimoor Khan * Java Server Pages (JSP) is a server-side programming technology that enables the creation of dynamic,
NETWORK CENTRIC COMPUTING (With included EMBEDDED SYSTEMS)
Event display monitoring Giuseppe Zito : Infn Bari Italy Beliy Nikita : University of Mons-Hainaut Belgium.
Adapting Legacy Computational Software for XMSF 1 © 2003 White & Pullen, GMU03F-SIW-112 Adapting Legacy Computational Software for XMSF Elizabeth L. White.
WIDAR Prototype Testing User Interface Software Kevin Ryan NRAO-DRAO Face-to-Face Meeting April 3, 2006.
C Copyright © 2009, Oracle. All rights reserved. Appendix C: Service-Oriented Architectures.
14th IEEE-NPSS Real Time Conference 2005, 8 June Stockholm.
SSC2: Web Services. Web Services Web Services offer interoperability using the web Web Services provide information on the operations they can perform.
Grid Computing, B. Wilkinson, 20043b.1 Web Services Part II.
CIS 375—Web App Dev II Microsoft’s.NET. 2 Introduction to.NET Steve Ballmer (January 2000): Steve Ballmer "Delivering an Internet-based platform of Next.
What are Webservices?. Web Services  What are Web Services?  Examine important Web Services acronyms (UDDI, SOAP, XML and WSDL)  What are the benefits.
Designing For Testability. Incorporate design features that facilitate testing Include features to: –Support test automation at all levels (unit, integration,
Test Of Distributed Data Quality Monitoring Of CMS Tracker Dataset H->ZZ->2e2mu with PileUp - 10,000 events ( ~ 50,000 hits for events) The monitoring.
Presentation: SOAP in a distributed object framework, Application Servers & AXIS SOAP.
SITools Enhanced Use of Laboratory Services and Data Romain Conseil
Web Services An introduction for eWiSACWIS May 2008.
James Holladay, Mario Sweeney, Vu Tran. Web Services Presentation Web Services Theory James Holladay Tools – Visual Studio Vu Tran Tools – Net Beans Mario.
11 Web Services. 22 Objectives You will be able to Say what a web service is. Write and deploy a simple web service. Test a simple web service. Write.
Web Services based e-Commerce System Sandy Liu Jodrey School of Computer Science Acadia University July, 2002.
Presentation: SOAP/WS in a distributed object framework, Application Servers & AXIS SOAP.
Presentation: SOAP/WS in a distributed object framework, Application Servers & AXIS SOAP.
Tracker data quality monitoring based on event display M.S. Mennea – G. Zito University & INFN Bari - Italy.
Semantic Web Technologies Research Topics and Projects discussion Brief Readings Discussion Research Presentations.
INTRODUCTION TO WEB APPLICATION Chapter 1. In this chapter, you will learn about:  The evolution of the Internet  The beginning of the World Wide Web,
Cheap N Fast Web Service Sandeep Anantharaman Mahim Lakhani.
1 Engineering Web Based Legacy Systems By Kanchana Eramudugoda Distributed Computing – CS843.
EGEE User Forum Data Management session Development of gLite Web Service Based Security Components for the ATLAS Metadata Interface Thomas Doherty GridPP.
Kemal Baykal Rasim Ismayilov
Tracker Visualization Tool: integration in ORCA Maria S. Mennea, Giuseppe Zito University & INFN Bari, Italy Tracker b-tau Cosmic Challenge preparation.
S O A P ‘the protocol formerly known as Simple Object Access Protocol’ Team Pluto Bonnie, Brandon, George, Hojun.
CMS Luigi Zangrando, Cern, 16/4/ Run Control Prototype Status M. Gulmini, M. Gaetano, N. Toniolo, S. Ventura, L. Zangrando INFN – Laboratori Nazionali.
Web Services An Introduction Copyright © Curt Hill.
1 Service Oriented Architecture SOA. 2 Service Oriented Architecture (SOA) Definition  SOA is an architecture paradigm that is gaining recently a significant.
Introduction to Web Services Presented by Sarath Chandra Dorbala.
EGEE is a project funded by the European Union under contract IST Introduction to Web Services 3 – 4 June
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Design and Development of a Space Weather Web Service Vern Raben Raben Systems Inc.
CMS Luigi Zangrando, Cern, 16/4/ Run Control Prototype Status M. Gulmini, M. Gaetano, N. Toniolo, S. Ventura, L. Zangrando INFN – Laboratori Nazionali.
CMS TRACKER VISUALISATION TOOLS M.S. MENNEA, a G. ZITO, a A. REGANO a AND I. OSBORNE b a Dipartimento Interateneo di fisica di Bari & INFN sezione di Bari,
Net-centric Computing Web Services. Lecture Outline  What is Web Service  Web Service Architecture  Creating and using Java Web Services  Apache Axis.
Software Architecture Patterns (3) Service Oriented & Web Oriented Architecture source: microsoft.
By Jeremy Burdette & Daniel Gottlieb. It is an architecture It is not a technology May not fit all businesses “Service” doesn’t mean Web Service It is.
Java Web Services Orca Knowledge Center – Web Service key concepts.
Chapter 5 Operating Systems.
Integration with External Applications: General View
Writing simple Java Web Services using Eclipse
Outline SOAP and Web Services in relation to Distributed Objects
Outline SOAP and Web Services in relation to Distributed Objects
PHP / MySQL Introduction
Chapter 42 Web Services.
Distributed System using Web Services
Presentation transcript:

MONITORING CMS TRACKER CONSTRUCTION AND DATA QUALITY USING A GRID/WEB SERVICE BASED ON A VISUALIZATION TOOL G. ZITO, M.S. MENNEA, A. REGANO Dipartimento Interateneo di fisica di Bari & INFN sezione di Bari, Italy The complexity of the CMS Tracker (more than 50 million channels to monitor) now in construction in ten laboratories worldwide with hundreds of interested people, will require new tools for monitoring both the hardware and the software. In our approach we use both visualization tools and Grid services to make this monitoring possible. The use of visualization enables us to represent in a single computer screen all those million channels at once. The Grid will make it possible to get enough data and computing power in order to check every channel and also to reach the experts everywhere in the world allowing the early discovery of problems. We report here on a first prototype developed using the Grid environment already available now in CMS i.e. LCG2. This prototype consists on a Java client which implements the GUI for Tracker Visualization and two data servers connected to the tracker construction database and to Grid catalogs of event datasets. All the communication between client and servers is done using data encoded in xml and standard Internet protocols. The use of web services is essential to ensure the interoperability of our visualisation application with different data sources. Some of these sources (the event store) are on the Grid and their use requires Grid services which are based on Web services. Other data sources are relational databases. In both cases Web services let you establish a standard protocol for data exchange between disparate data sources and a consumer. They serve as a layer of abstraction isolating from the details of data representation, exchange and query. For example the visualisation client handles in the same way tracker data coming from the construction relational data base and from a grid dataset. ABSTRACT 1. The visualization client, which we named Tmon, is implemented in Java. It can execute on any computer with Java Runtime 1.4 installed. This allows the use of our software from any computer connected to Internet without the need to install special software. This client communicates with data servers using standard Internet protocols. All files exchanged contain data encoded in xml. This client implements the user graphics interface and fulfills these main tasks:  Once the user has selected a data server, the client requests the tracker description to the server.  Interprets the data in the xml file that describe the tracker, configuring its graphics interface for the specific tracker.  Allows the user to request new events or data from construction database.  Displays the information sent in a 2D window representing either the complete tracker or the single layer.  Allows the possibility to print the graphical representation on the screen. 4. Visualization Client Why Web Service (Orca – Cms reconstruction project) write their data. The connection between client and server uses standard internet protocols. To extract tracker data from xml files we have used the technique called xml data binding using the free source program Castor [1]. The system consists of a highly portable lightweight client capable of running on many different platforms connected to Internet. The server application works as a gateway in direct contact with the construction database or the event store where standard analysis program System Architecture 2. To implement the data server we used Tomcat [2] + Axis [3]. Tomcat can be used as a normal web server with http protocol. In order to test both the two most popular approaches to web services we have implemented the data server In two different ways: To get events from Montecarlo federations we use the so called REST approach to web services. This consists in naming all resources provided with standard web addresses (URI) and using the commands already available in http protocol (i.e. GET, PUT, DELETE, POST) to manage the resources. ( Tomcat implements all of them ). The client requests events or other data to the server by putting the information about the request directly in the URL with the GET directive. The server answers by sending the data in the XML format. To access the data in the construction database we use instead Axis (working as a Tomcat servlet) to provide web services following the W3C definition with SOAP and WSDL. In this case both the request and the answer are sent in a SOAP envelope. The service itself is described in a WSDL file. Up to now the data servers can provide data from two different sources :  federations of Montecarlo events for the full detector.  data from the construction data base A data server providing real data from a prototype in a test beam is foreseen in the future but not yet implemented. Data Server Implementation

MONITORING CMS TRACKER CONSTRUCTION AND DATA QUALITY USING A GRID/WEB SERVICE BASED ON A VISUALIZATION TOOL The data servers are run on a PC with a CPU Pentium IV. We have tried the visualisation client in Java on many Linux and Windows PC with Java Runtime 1.4 installed. The time needed to fetch the description of the whole tracker and unmarshal it is 10 seconds. This time is reasonable taking in account that the xml file sent is more than 1 Mb large and the Java program has to validate and load the data. Reading a single event or the data from the construction database will take a time that depends on the data size but never exceeds 10 seconds. This time is obtained of course because both reading events and data from database are done by servlets that work as gateway to the real data provider caching the result of query. This was first of all a didactic exercise to get ready for the Grid. Infact the next step is to trasform the web service in a Grid service. Implementing web services requires learning to use a plethora of xml dialects and languages. Also making Tomcat, Axis and Castor working toghether is rather tricky. Anyhow after a steep learning curve the software used has proven to be reliable and with a good performance. Is monitoring a detector like CMS tracker feasible from Internet? Yes when CMS develops a standard Web and Grid interface to its monitoring data. Developing our application we have found that the access to construction data base was very easy because Oracle databases have a standard web interface. Instead the access to CMS event data was difficult because CMS has yet no web interface defined and we had to invent it from scratch by, for example, defining a XML format of CMS events. In our opinion, developing such standard web interface, is absolutely essential to CMS especially if it wants to fully exploit the capabilities of the Grid. 8. The main representation for monitoring is a 2D representation where you can see the whole detector with each one of modules visible. A kind of tracker map. GUI of Client Prototype 5. Performance 7. Lesson learned and conclusion Xml data binding with Castor 6. References Mennea,M.S; Regano,A; Zito,G. "CMS Tracker Visualisation", CMS-NOTE2004/009; Geneva, CERN, 08Jun2004 Request of a new event It is possible to select as data source the construction database. Many kind of data can be downloaded. The user can choose to see all the tracker or only one of the 41 layers. It is possible to zoom when a single layer is displayed Possibility to represent the information in two way: overlayed (not shown here) and separated. See 4 for a detailed explanation. The representation can be printed as.gif The tracker map can be examined using the two scrollbars Serialization/Deserialization (converting data to/extracting data from) xml files is done by Castor. Castor uses the Xml-schema description of the tracker or the event data model to generate authomatically the java classes implementing it (Castor beans). The program WSDL2Java (provided with the Axis distribution) used the WSDL description of the Web service to generate the Java code implementing it. Elements created by hand