Download presentation
Presentation is loading. Please wait.
Published byRoderick Shields Modified over 9 years ago
1
Grappa: Grid access portal for physics applications Shava Smallen Extreme! Computing Laboratory Department of Physics Indiana University
2
Outline GriPhyN Grappa –XCAT Science Portal project –Demo Future Directions –Virtual Data Browser
3
GriPhyN: Grid Physics Network Many many participating people and institutions Targets data-intensive applications –ATLAS, CMS, LIGO, and SDSS –90% of data is derived Provide a set of tools for collaborative data analysis –Virtual data - transparency with respect to location and materialization
4
Simplified View storage Planner Executor Catalog Services Information Services Policy/Security Monitoring Replica Management Reliable Transfer Service GriPhyN/Grid Services Resources Athena Applications App1 App2 storage
5
Virtual Data Catalogs Data X orig Data X orig Indiana Data X copy1 Data X copy1 Boston Data X copy2 Data X copy2 Oklahoma Replica Catalog Metadata Catalog Higgs particle, proton center of mass, etc Transparency with respect to location Transparency with respect to materialization Derived Metadata Catalog Derived Data Catalog Transformation Catalog Random seed, number of events Athena version, pythia, atlfast, application model, etc. Virtual Data Language
6
Motivation for Grappa Lots of GriPhyN/Grid services Requires a good deal of expertise – more than what many users want to know Common approach is a Grid portal Provide a portal interface by which physicists can launch and manage applications and data over the Grid
7
XCAT Science Portal Framework for building personal science portals A science portal is an application- specific Grid portal Active notebook –HTML pages to describe the features of the notebook and how to use it –HTML forms which can be used to launch parameterizable scripts (transformation) –Parameters stored in a sub-notebook (derivation)
8
Scripts Very flexible Jython - access to Java classes –Globus Java CoG kit –XCAT –XMESSAGES Not every user has to write scripts Notebooks can be shared among users –Import/export capability
9
Portal Web Server (tomcat server + java servlets) Jython Intepreter Notebook Database GSI Authentication XCAT Science Portal Architecture User’s Web Browser Grid
10
Athena Notebook Demo Graphical way to submit jobOptions file 1.Log in using GSI credential 2.Select athena notebook from desktop 3.Content pages describing athena and how to use the notebook 4.Resource management via “Add Resource” and “Check Resources” 5.Submit job options file via “Submit Athena Job”
11
a)Stage directory b)Results directory 6.Monitor simple status of job (i.e., pending, active, done) Boston University IUPUI Indiana University University of Oklahoma Indiana University BNL
12
Demo Available via Pacman under grappa-demo Further information and installation instructions available at: > pacman –fetch –install grappa-demo http://iuatlas.physics.indiana.edu/grappa
13
Where next? Interface to GriPhyN and other Grid services (i.e., Virtual Data Language, Magda, EDG, etc.) Only focused on execution management –(Still can make improvements here) –Centered around notebook abstraction Is this an appropriate abstraction for data management too?
14
Grid
15
Virtual Data Browser A browser interface which can be used to search and create virtual data Functionality analogous to that of a web browser –Create virtual data (e.g., Netscape composer) –Navigate virtual data (e.g., point n’ click links) –Search virtual data (via search engines – Yong Zhao – U. of Chicago) –Bookmarks to virtual data (or transformations) –User profile – resource mgmt, credential mgmt, home
16
Next step Write up design specification for VDB Probably develop code from scratch –Jetspeed looks promising –Keep script functionality –Replace notebook database with virtual data catalogs Interface to Virtual Data Language
17
More Information Acknowledgements: –IU Physics Rob Gardner, Lisa Ensman, Fred Leurhing –Extreme Computing Lab –US ATLAS testbed sites Grappa web page: Email: ssmallen@cs.indiana.edu http://iuatlas.physics.indiana.edu/grappa
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.