Experiences with OGSA-DAI : Portlet Access and Benchmark Deepti Kodeboyina and Beth Plale Computer Science Dept. Indiana University.

Slides:



Advertisements
Similar presentations
Wei Lu 1, Kate Keahey 2, Tim Freeman 2, Frank Siebenlist 2 1 Indiana University, 2 Argonne National Lab
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
E-Science Data Information and Knowledge Transformation Eldas Building Service Grids with Enterprise Level Data Access Services Alan Gray
Using the Collaborative Tools in NEESgrid Charles Severance University of Michigan.
Nondeterministic Queries in a Relational Grid Information Service Peter A. Dinda Dong Lu Prescience Lab Department of Computer Science Northwestern University.
High Performance Computing Course Notes Grid Computing.
Scenario ResultsEase of Use Ease of Use captures intangible aspects of performance of a grid service, in particular, amount of work client must undertake.
GEODE Project introduction and summary, 12/12/05 GEODE: Grid Enabled Occupational Data Environment GEODE Project introduction and summary, 12/12/05 Motivation.
Copyright 2004 Monash University IMS5401 Web-based Systems Development Topic 2: Elements of the Web (g) Interactivity.
Web Server Hardware and Software
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
NextGRID & OGSA Data Architectures: Example Scenarios Stephen Davey, NeSC, UK ISSGC06 Summer School, Ischia, Italy 12 th July 2006.
Mike Jackson EPCC OGSA-DAI Today Release 2.2 Principles and Architectures for Structured Data Integration: OGSA-DAI.
Institute for Scientific Computing – University of ViennaP.Brezany 1 Databases and the Grid Peter Brezany Institute für Scientific Computing University.
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 7: Planning a DNS Strategy.
©Silberschatz, Korth and Sudarshan18.1Database System Concepts Centralized Systems Run on a single computer system and do not interact with other computer.
1 Distributed Mathematics Assessment System (DMAS) & WME Progress and Demo Saleh Al-shomrani Department of Computer Science Kent State University 06/13/2007.
DotSlash: Providing Dynamic Scalability to Web Applications Weibin Zhao and Henning Schulzrinne Department of Computer Science, Columbia University More.
Kangseok Kim, Marlon E. Pierce Community Grids Laboratory, Indiana University
Designing and Building Grid Services GGF9 Chicago October 8, 2003 Organizers: Ian Foster, Marty Humphrey, Kate Keahey, Norman Paton, David Snelling.
E-Commerce The technical side. LAMP Linux Linux Apache Apache MySQL MySQL PHP PHP All Open Source and free packages. Can be installed and run on most.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
TNC Common Project EVO / UPMC TNC 2010 Goals Integrate a distance learning system called EVO-Learning into universities environment. Provide a.
● Problem statement ● Proposed solution ● Proposed product ● Product Features ● Web Service ● Delegation ● Revocation ● Report Generation ● XACML 3.0.
Systems Group Dept. Computer Science ETH Zurich - Switzerland XQBench An XQuery Benchmarking Service Peter M. Fischer.
1 Dr. Markus Hillenbrand, ICSY Lab, University of Kaiserslautern, Germany A Generic Database Web Service for the Venice Service Grid Michael Koch, Markus.
Institute of Computer and Communication Network Engineering OFC/NFOEC, 6-10 March 2011, Los Angeles, CA Lessons Learned From Implementing a Path Computation.
Data Management Kelly Clynes Caitlin Minteer. Agenda Globus Toolkit Basic Data Management Systems Overview of Data Management Data Movement Grid FTP Reliable.
GRAM: Software Provider Forum Stuart Martin Computational Institute, University of Chicago & Argonne National Lab TeraGrid 2007 Madison, WI.
Profiling Grid Data Transfer Protocols and Servers George Kola, Tevfik Kosar and Miron Livny University of Wisconsin-Madison USA.
PHP With Oracle 11g XE By Shyam Gurram Eastern Illinois University.
WSRF Supported Data Access Service (VO-DAS)‏ Chao Liu, Haijun Tian, Dan Gao, Yang Yang, Yong Lu China-VO National Astronomical Observatories, CAS, China.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.
Scalable Web Server on Heterogeneous Cluster CHEN Ge.
Towards Low Overhead Provenance Tracking in Near Real-Time Stream Filtering Nithya N. Vijayakumar, Beth Plale DDE Lab, Indiana University {nvijayak,
1 All-Hands Meeting 2-4 th Sept 2003 e-Science Centre The Data Portal Glen Drinkwater.
INFSO-RI Enabling Grids for E-sciencE Supporting legacy code applications on EGEE VOs by GEMLCA and the P-GRADE portal P. Kacsuk*,
Advanced Computer Networks Topic 2: Characterization of Distributed Systems.
June 6, 2007TeraGrid '071 Clustering the Reliable File Transfer Service Jim Basney and Patrick Duda NCSA, University of Illinois This material is based.
WebServices, GridServices and Firewalls Matthew J. Dovey Technical Manager Oxford e-Science Centre
1 1 EPCC 2 Curtin Business School & Edinburgh University Management School Michael J. Jackson 1 Ashley D. Lloyd 2 Terence M. Sloan 1 Enabling Access to.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
INFSO-RI Enabling Grids for E-sciencE OGSA DAI Data Access and Integration Marek Ciglan Institute of Informatics, Slovac Academy.
NCSA Alliance Portal Expedition Demo Marlon Pierce, Greg Daues, Gopi Kandaswamy, and Liang Fang Supercomputing 2004 Pittsburg, PA.
RUS: Resource Usage Service Steven Newhouse James Magowan
Portal Update Plan Ashok Adiga (512)
ClearQuest XML Server with ClearCase Integration Northwest Rational User’s Group February 22, 2007 Frank Scholz Casey Stewart
Interactive Data Analysis on the “Grid” Tech-X/SLAC/PPDG:CS-11 Balamurali Ananthan David Alexander
Performance Testing Test Complete. Performance testing and its sub categories Performance testing is performed, to determine how fast some aspect of a.
03/03/051 Performance Engineering of Software and Distributed Systems Research Activities at IIT Bombay Varsha Apte March 3 rd, 2005.
Features Of SQL Server 2000: 1. Internet Integration: SQL Server 2000 works with other products to form a stable and secure data store for internet and.
An Efficient Threading Model to Boost Server Performance Anupam Chanda.
Data Manipulation with Globus Toolkit Ivan Ivanovski TU München,
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
DataGrid is a project funded by the European Commission EDG Conference, Heidelberg, Sep 26 – Oct under contract IST OGSI and GT3 Initial.
OGSA-DAI 简介及其它在 China-VO DAS 系统中的应用 杨阳 中国虚拟天文台研发团队 Chinese Virtual Observatory.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
M2OProxy Details Andy Salnikov Monitoring in M2OProxy2 Monitoring What is monitored Requests Requests client ID (host IP address/port)
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
OGSA-DAI.
Added Value to XForms by Web Services Supporting XML Protocols Elina Vartiainen Timo-Pekka Viljamaa T Research Seminar on Digital Media Autumn.
Servicing Seismic and Oil Reservoir Simulation Data through Grid Data Services Sivaramakrishnan Narayanan, Tahsin Kurc, Umit Catalyurek and Joel Saltz.
CIIT-Human Computer Interaction-CSC456-Fall-2015-Mr
Web Application.
Grid Portal Services IeSE (the Integrated e-Science Environment)
Grid Information Services: alternate models
Cloud computing mechanisms
Middleware for Grid Portal Development
Performance And Scalability In Oracle9i And SQL Server 2000
Presentation transcript:

Experiences with OGSA-DAI : Portlet Access and Benchmark Deepti Kodeboyina and Beth Plale Computer Science Dept. Indiana University

Portals for Grids  Portals as user-oriented interfaces to the grid. They are used for providing user access to grid services  Potential for data access, integration, collaborative data analysis of large datasets. Data access to either commercial or scientific data would add value to the day-to-day operations of grid users.  OGSA-DAI – collaboration of grid services for providing access to heterogeneous data sources (exactly what we need)  Our goal – creation of a portlet to provide an interface for data management of disparate and heterogeneous data sources using OGSA- DAI and to understand the overheads associated with that.

Portal infrastructure  The portlet is currently deployed onto the Alliance portal that is hosted on a Linux server.

Portlet interaction

Portlet interaction return results Provided Factory Service Handle GDS Create service document assigned Perform document chosen Response as XML and html Perform document sent to the GDS. GDS replies with response document.

Portlet interaction: asynchronous requests through gFTP Gftp portlet Ogsa-dai portlet Request doc, proxy cert gFTP response, proxy cert response set

On-going work  Transfer of data by means of other mechanisms (grid ftp) for providing secure access.  Transparency of the perform document location to be added. By way of using WebDAV in order to remove existing usage restrictions.  Dynamic creation of perform documents via the portlet itself. Plan is to allow user to enter/choose required information in a web form and dynamically generate the XML documents from that.

IU RGRbench  IU RGR Benchmark – benchmark/workload for grid information servers. realistic grid information server specific questions Synthetic workloads to test query response time under multi-client workload  Applied benchmark to analyze performance of OGSA-DAI. quantify overhead of grid service interface to database.  Benchmark queries 13 queries, iterate, sequential access to database. Data size of result set varies from few bytes to 45 KB  Benchmark scenarios synthetic workloads evaluate sensitivity of query response time to update load. Query workloads run for 20 minutes; concurrent updates begun at minute 6, run through minute 11. Response times averaged over interval.

Experiment details  Platform Specifications Globus toolkit 3.0 version and OGSA_DAI v3.0 deployed on linux server Database accessed: mySQL  situated on a separate dual processor Xeon server All these machines are part of the Local Area Network of the CS department.  Experiment summarization Average query response times vary from 100 ms to 600 ms for synchronous requests. Query response times vary with the size of the data sets also. Scenarios have varying response times extremely sensitive to the no. of updates.

Ogsa-Dai v3.0 Query Results Note that scale is 10^4 Synchronous response mechanismAsynchronous response mechanism

Ogsa-Dai v3.0 Scenario Results Multiple Attribute UpdatesInsertion of records

Future work  On-the-fly creation of Grid Data Services in response to multiple users is being explored. Also, when the users require data from resources which can not be created by existing factories, new ones to access these will have to be created.  More profiling being done to determine and understand the latencies caused at a finer granularity.  Aiming at a much more broader usage of the portlet