Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University.

Slides:



Advertisements
Similar presentations
Data Management Expert Panel - WP2. WP2 Overview.
Advertisements

Using the Collaborative Tools in NEESgrid Charles Severance University of Michigan.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Jun-15 1 Management Information Systems Class Web Server Usage Instructions.
Other servers Java client, ROOT (analysis tool), IGUANA (CMS viz. tool), ROOT-CAVES client (analysis sharing tool), … any app that can make XML-RPC/SOAP.
Magda – Manager for grid-based data Wensheng Deng Physics Applications Software group Brookhaven National Laboratory.
THE BASICS OF THE WEB Davison Web Design. Introduction to the Web Main Ideas The Internet is a worldwide network of hardware. The World Wide Web is part.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
XCAT Science Portal Status & Future Work July 15, 2002 Shava Smallen Extreme! Computing Laboratory Indiana University.
GRAPPA Part of Active Notebook Science Portal project A “notebook” like GRAPPA consists of –Set of ordinary web pages, viewable from any browser –Editable.
A Web 2.0 Portal for Teragrid Fugang Wang Gregor von Laszewski May 2009.
Chapter 6 The World Wide Web. Web Pages Each page is an interactive multimedia publication It can include: text, graphics, music and videos Pages are.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
Don Quijote Data Management for the ATLAS Automatic Production System Miguel Branco – CERN ATC
1. Introduction  The JavaScript Grid Portal is trying to find a way to access Grid through Web browser, while using Web 2.0 technologies  The portal.
HEP Experiment Integration within GriPhyN/PPDG/iVDGL Rick Cavanaugh University of Florida DataTAG/WP4 Meeting 23 May, 2002.
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
3 Sept 2001F HARRIS CHEP, Beijing 1 Moving the LHCb Monte Carlo production system to the GRID D.Galli,U.Marconi,V.Vagnoni INFN Bologna N Brook Bristol.
CoG Kit Overview Gregor von Laszewski Keith Jackson.
1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Introduction to Apache OODT Yang Li Mar 9, What is OODT Object Oriented Data Technology Science data management Archiving Systems that span scientific.
CPSC 203 Introduction to Computers Lab 23 By Jie Gao.
MySQL and GRID Gabriele Carcassi STAR Collaboration 6 May Proposal.
23:48:11Service Oriented Cyberinfrastructure Lab, Grid Portals Fugang Wang April 29
GridFE: Web-accessible Grid System Front End Jared Yanovich, PSC Robert Budden, PSC.
Nick Brook Current status Future Collaboration Plans Future UK plans.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
CYBERINFRASTRUCTURE FOR THE GEOSCIENCES Data Replication Service Sandeep Chandra GEON Systems Group San Diego Supercomputer Center.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
MAGDA Roger Jones UCL 16 th December RWL Jones, Lancaster University MAGDA  Main authors: Wensheng Deng, Torre Wenaus Wensheng DengTorre WenausWensheng.
US ATLAS Grid Projects Rob Gardner Indiana University Mid Year Review of US ATLAS Computing NSF Headquarters, Arlington VA June 20, 2002
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
Production Tools in ATLAS RWL Jones GridPP EB 24 th June 2003.
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
Virtual Batch Queues A Service Oriented View of “The Fabric” Rich Baker Brookhaven National Laboratory April 4, 2002.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grappa Grid Access Portal for Physics Applications CHEP 2003 UCSD March 24-28,2003 Daniel Engh (UC), Shava Smallen (IU), Liang Fang (IU), Jerry Gieraltowski.
1 The Portal Expedition Beth Plale, Dennis Gannon Indiana University – Project Leads Jay Alameda NCSA – Project Coordinator The Alliance Portals Expedition.
Part 9: MyProxy Pragmatics This presentation and lab ends the GRIDS Center agenda Q: When do we convene again tomorrow?
Atlas Grid Status - part 1 Jennifer Schopf ANL U.S. ATLAS Physics and Computing Advisory Panel Review Argonne National Laboratory Oct 30, 2001.
The GriPhyN Planning Process All-Hands Meeting ISI 15 October 2001.
A radiologist analyzes an X-ray image, and writes his observations on papers  Image Tagging improves the quality, consistency.  Usefulness of the data.
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
August 30, 2002Jerry Gieraltowski Launching ATLAS Jobs to either the US-ATLAS or EDG Grids using GRAPPA Goal: Use GRAPPA to launch a job to one or more.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
CS562 Advanced Java and Internet Application Introduction to the Computer Warehouse Web Application. Java Server Pages (JSP) Technology. By Team Alpha.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Virtual Data Management for CMS Simulation Production A GriPhyN Prototype.
VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.
Overview of Grid Webservices in Distributed Scientific Applications Dennis Gannon Aleksander Slominski Indiana University Extreme! Lab.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
National Energy Research Scientific Computing Center (NERSC) Visportal : interface to grid enabled NERC resources Cristina Siegerist NERSC Center Division,
Magda Distributed Data Manager Prototype Torre Wenaus BNL September 2001.
The Gateway Computational Web Portal Marlon Pierce Indiana University March 15, 2002.
Introduction to HTML Simple facts yet crucial to beginning of study in fundamentals of web page design!
Application Web Service Toolkit Allow users to quickly add new applications GGF5 Edinburgh Geoffrey Fox, Marlon Pierce, Ozgur Balsoy Indiana University.
Grid Status - PPDG / Magda / pacman Torre Wenaus BNL DOE/NSF Review of US LHC Software and Computing Fermilab Nov 29, 2001.
1 CMS Virtual Data Overview Koen Holtman Caltech/CMS GriPhyN all-hands meeting, Marina del Rey April 9, 2001.
10 March Andrey Grid Tools Working Prototype of Distributed Computing Infrastructure for Physics Analysis SUNY.
Basics Components of Web Design & Development Basics, Components, Design and Development.
Magda Distributed Data Manager Torre Wenaus BNL October 2001.
U.S. ATLAS Grid Production Experience
Moving the LHCb Monte Carlo production system to the GRID
The XCAT Science Portal
Introduction to HTML Simple facts yet crucial to beginning of study in fundamentals of web page design!
Presentation transcript:

Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University

Outline GriPhyN Grappa –XCAT Science Portal project –Demo Future Directions –Virtual Data Browser

GriPhyN: Grid Physics Network Many many participating people and institutions Targets data-intensive applications –ATLAS, CMS, LIGO, and SDSS –90% of data is derived Provide a set of tools for collaborative data analysis –Virtual data - transparency with respect to location and materialization

Simplified View storage Planner Executor Catalog Services Information Services Policy/Security Monitoring Replica Management Reliable Transfer Service GriPhyN/Grid Services Resources Athena Applications App1 App2 storage

Virtual Data Catalogs Data X orig Data X orig Indiana Data X copy1 Data X copy1 Boston Data X copy2 Data X copy2 Oklahoma Replica Catalog Metadata Catalog Higgs particle, proton center of mass, etc Transparency with respect to location Transparency with respect to materialization Derived Metadata Catalog Derived Data Catalog Transformation Catalog Random seed, number of events Athena version, pythia, atlfast, application model, etc. Virtual Data Language

Motivation for Grappa Lots of GriPhyN/Grid services Requires a good deal of expertise – more than what many users want to know Common approach is a Grid portal Provide a portal interface by which physicists can launch and manage applications and data over the Grid

XCAT Science Portal Framework for building personal science portals A science portal is an application- specific Grid portal Active notebook –HTML pages to describe the features of the notebook and how to use it –HTML forms which can be used to launch parameterizable scripts (transformation) –Parameters stored in a sub-notebook (derivation)

Scripts Very flexible Jython - access to Java classes –Globus Java CoG kit –XCAT –XMESSAGES Not every user has to write scripts Notebooks can be shared among users –Import/export capability

Portal Web Server (tomcat server + java servlets) Jython Intepreter Notebook Database GSI Authentication XCAT Science Portal Architecture User’s Web Browser Grid

Athena Notebook Demo Graphical way to submit jobOptions file 1.Log in using GSI credential 2.Select athena notebook from desktop 3.Content pages describing athena and how to use the notebook 4.Resource management via “Add Resource” and “Check Resources” 5.Submit job options file via “Submit Athena Job”

a)Stage directory b)Results directory 6.Monitor simple status of job (i.e., pending, active, done) Boston University IUPUI Indiana University University of Oklahoma Indiana University BNL

Demo Available via Pacman under grappa-demo Further information and installation instructions available at: > pacman –fetch –install grappa-demo

Where next? Interface to GriPhyN and other Grid services (i.e., Virtual Data Language, Magda, EDG, etc.) Only focused on execution management –(Still can make improvements here) –Centered around notebook abstraction Is this an appropriate abstraction for data management too?

Grid

Virtual Data Browser A browser interface which can be used to search and create virtual data Functionality analogous to that of a web browser –Create virtual data (e.g., Netscape composer) –Navigate virtual data (e.g., point n’ click links) –Search virtual data (via search engines – Yong Zhao – U. of Chicago) –Bookmarks to virtual data (or transformations) –User profile – resource mgmt, credential mgmt, home

Next step Write up design specification for VDB Probably develop code from scratch –Jetspeed looks promising –Keep script functionality –Replace notebook database with virtual data catalogs Interface to Virtual Data Language

More Information Acknowledgements: –IU Physics Rob Gardner, Lisa Ensman, Fred Leurhing –Extreme Computing Lab –US ATLAS testbed sites Grappa web page: