CoG Kit Overview Gregor von Laszewski Keith Jackson.

Slides:



Advertisements
Similar presentations
The Anatomy of the Grid: An Integrated View of Grid Architecture Carl Kesselman USC/Information Sciences Institute Ian Foster, Steve Tuecke Argonne National.
Advertisements

Using the Collaborative Tools in NEESgrid Charles Severance University of Michigan.
Earth System Curator Spanning the Gap Between Models and Datasets.
C. Grimme, A. Papaspyrou Scheduling in C3-Grid AstroGrid-D Workshop Project: C3-Grid Collaborative Climate Community Data and Processing Grid Scheduling.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
1 CENTER FOR PARALLEL COMPUTERS An Introduction to Globus Toolkit® 3 -Developing Interoperable Grid services.
The DOE Science Grid Computing and Data Infrastructure for Large-Scale Science William Johnston, Lawrence Berkeley National Lab Ray Bair, Pacific Northwest.
Globus Toolkit 4 hands-on Gergely Sipos, Gábor Kecskeméti MTA SZTAKI
Presented by Scalable Systems Software Project Al Geist Computer Science Research Group Computer Science and Mathematics Division Research supported by.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
The Cactus Portal A Case Study in Grid Portal Development Michael Paul Russell Dept of Computer Science The University of Chicago
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
GridSphere for GridLab A Grid Application Server Development Framework By Michael Paul Russell Dept Computer Science University.
Simo Niskala Teemu Pasanen
Globus Computing Infrustructure Software Globus Toolkit 11-2.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
Grid Computing, B. Wilkinson, a.1 Grid Portals.
Commodity Grid (CoG) Kits Keith Jackson, Lawrence Berkeley National Laboratory Gregor von Laszewski, Argonne National Laboratory.
National Computational Science National Center for Supercomputing Applications National Computational Science MyProxy: An Online Credential Repository.
A Web 2.0 Portal for Teragrid Fugang Wang Gregor von Laszewski May 2009.
Future Grid Future Grid User Portal Marlon Pierce Indiana University.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
NeSC Grid Apps Workshop Exposing Legacy Applications as OGSI Components using pyGlobus Keith R. Jackson Distributed Systems Department Lawrence Berkeley.
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
Grid Computing, B. Wilkinson, b.1 National Science Foundation Middleware Initiative (NMI) Started in 2001 initially over 3 years “to create and deploy.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
National Computational Science National Center for Supercomputing Applications National Computational Science NCSA-IPG Collaboration Projects Overview.
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Experiment Management with Microsoft Project Gregor von Laszewski Leor E. Dilmanian Acknowledgement: NSF NMI, CMMI, DDDAS
Grid Architecture William E. Johnston Lawrence Berkeley National Lab and NASA Ames Research Center (These slides are available at grid.lbl.gov/~wej/Grids)
1 Grid Portal for VN-Grid Cu Nguyen Phuong Ha. 2 Outline Some words about portals in principle Overview of OGCE GridPortlets.
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grappa Grid Access Portal for Physics Applications CHEP 2003 UCSD March 24-28,2003 Daniel Engh (UC), Shava Smallen (IU), Liang Fang (IU), Jerry Gieraltowski.
1October 9, 2001 Sun in Scientific & Engineering Computing Grid Computing with Sun Wolfgang Gentzsch Director Grid Computing Cracow Grid Workshop, November.
Web Portal Design Workshop, Boulder (CO), Jan 2003 Luca Cinquini (NCAR, ESG) The ESG and NCAR Web Portals Luca Cinquini NCAR, ESG Outline: 1.ESG Data Services.
The Earth System Grid (ESG) Computer Science and Technologies DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Scalable Systems Software for Terascale Computer Centers Coordinator: Al Geist Participating Organizations ORNL ANL LBNL.
ISERVOGrid Architecture Working Group Brisbane Australia June Geoffrey Fox Community Grids Lab Indiana University
CEOS Working Group on Information Systems and Services - 1 Data Services Task Team Discussions on GRID and GRIDftp Stuart Doescher, USGS WGISS-15 May 2003.
May 6, 2002Earth System Grid - Williams The Earth System Grid Presented by Dean N. Williams PI’s: Ian Foster (ANL); Don Middleton (NCAR); and Dean Williams.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
VisPortal Project developer’s experience C.E.Siegerist, J. Shalf, E.W. Bethel NERSC/LBNL Visualization Group T.J. Jankun-Kelley, O. Kreylos, K.L. Ma CIPIC/UC.
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
Overview of Grid Webservices in Distributed Scientific Applications Dennis Gannon Aleksander Slominski Indiana University Extreme! Lab.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
Parallel Computing Globus Toolkit – Grid Ayaka Ohira.
Shaowen Wang 1, 2, Yan Liu 1, 2, Nancy Wilkins-Diehr 3, Stuart Martin 4,5 1. CyberInfrastructure and Geospatial Information Laboratory (CIGI) Department.
Collaborations and Interactions with other Projects
Shaowen Wang1, 2, Yan Liu1, 2, Nancy Wilkins-Diehr3, Stuart Martin4,5
Grid Portal Services IeSE (the Integrated e-Science Environment)
OGCE OGCE The Open Grid Computing Environments Collaboratory
Standard Portlet Architecture Supports Reusable Components
Middleware for Grid Portal Development
OGCE Architecture: Portlets and Services for Science Gateways
Grid Computing Software Interface
Presentation transcript:

CoG Kit Overview Gregor von Laszewski Keith Jackson

Grids for the DOE Grids provide the means of sharing resources as part of virtual organizations with appropriate sharing rules. The Globus Toolkit provides the means of developing services and applications that can utilize the Grids. The DOE Science Grid provides an actual Grid which can be used by DOE scientists.

Problem Statement PROBLEM –Many application developers and advanced software designers desire to program the Grid in higher level frameworks they are familiar with. Current Grid toolkits are not well supported in such frameworks. SOLUTION –The SciDAC CoG Kit project integrates Grid software based on the Globus Toolkit and a commodity framework such as Java and Python.

CoGs are more … CoGs are more than just an interface to the Globus Toolkit CoGs allow Grid programmers to use the Commodity Technologies AND the Grids advantages –Example: Event and exception model of Java –Example: SWIG wrappers in Python for dusty deck support. Thus, CoGs are not just an API but provide access to the Commodity Framework

Impact Easier development of advanced Grid services Easier and more rapid application development Easier deployment of Grid services Code reuse and use of component repositories Use of Web services as part of the Grids Widespread use of the Grid

Milestones Deliver high-quality CoG Kits for Java and Python Provide access to basic Grid services: - GRAM, MDS, security, GridFTP, GSI - Replica Catalog, co-scheduling Develop composable components: - Develop guidelines for component development - Design and implement component hierarchies - Develop a component repository Integrate Web and Grid services

Outreach Projects –We are working closely with the Globus Project. We also work with a variety of major funded applications through SciDAC, NSF (e.g., DOE Science Grid, Earth Systems Grid), and NASA IPG. Tutorials –Various tutorials have been given Papers –At least 5 papers surrounding CoG activities have been submitted

Commodity Grid Kit Commodity Access to Elementary Grid Components and Services Commodity Access to Advanced Grid Components and Services Application Specific Grid Components and Services Portal Specific Grid Components and Services Commodity Access to Elementary Grid GUI Components and Services Commodity Access to Advanced Grid GUI Components and Services Grid Services Commodity Technologies Gap CoG Kits: Successively Filling a Gap

CoGs promote portal development The following architecture (next slide) cartoons the usefulness of, for example, Java CoG. Besides the possibility for developing advanced Grid/Web Services in Java we can use sophisticated development and deployment tools. Leveraging of from successful industry experience will broaden the use to other than science communities (example IBM)

CoG Kit Portal Architecture Application User Portal Administration Portal Infrastructure Monitoring Administration Service Compute Services Data Services Network Services Installation Job Submission Authentication DiscoveryReservation Job Management Submission Scheduling Grid Services... CoG Toolkit Mapping & Interfaces to existing and new Grid Services Advanced Components & Services Application Portal PSE Design Portal Design Environment Caching File Transfer Authorization QoS Repository Information Services Data Management Problem Session Management Collaborative Session Management

Sophisticated Crossplatform Independent Services and Interfaces Focus is to develop crossplatform and framework independent services Nevertheless, CoGs provide the possibility to develop sophisticated crossplatform independent user Interfaces that are intuitive to use by the non experts.

The CoG Kit Overview Globus Toolkit Java-based Grid Portals and Applications Java CoG Toolkit Python CoG Toolkit Commodity Python Tools and Services Commodity Java Tools and Services Portal High Energy Physics BiologyPSEChemistry Python IDE Earth Science Java IDE Java Distributed Programming Framework Java CoG Globus Service … … Composable CoG Components

Dependency Access to Possible use ANL Java CoGKit JSP CoG Kit (LBL GPDK) SDSC Perl CoG Kit Rutgers/ANL CORBA CoG Kit Indiana Jpython CoG Kit Indiana Science Portal Rutgers DISCOVER SDSC Grid Port Hotpage Active Notebook IPG Launchpad JiPang Astro-Physics Simulation Collaboratory Portal NCSA Extensible Comp.Chem. Environment ANL Java MyProxy CCAT Max Plank Inst. Cactus NetsolveUNICORENinf INRIA ProActive CERN Data and Management Grid ANL Portal Desktop ANL Java CoG Kit Subset of Projects using CoGs

CoG Demo at Sc2002 Demonstrated that –sophisticated interfaces are possible –Integration with Windows Software is possible –Installation can be performed by non experts –A good way to develop advanced science portals

Expresso Toolkit for Scientific Modeling Argonne Midwest Regional Climate Modeling Group Provides convenient access to various Climate models that can be invoked on various Grid Compute resources It is used for research It uses CoG

Astrophysical Collaboratory Enables scientists to –Develop code collaboratively –Run experiments collaboratively Uses Cactus, Globus Toolkit The portal is implemented on top of CoG

Acknowledgement The Java CoG Effort is part of the Globus Project The CoG Kit is funded through SciDAC with the DOE Some application portals are supported by NSF More information can be found at – –