Status of Grids for HEP and HENP

Slides:



Advertisements
Similar presentations
Project Overview Daniel Mallmann, Research Centre Juelich Alistair Dunlop, University of Southampton.
Advertisements

OMII-Europe Repository Steven Newhouse Director, OMII-UK.
SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
CMS Applications Towards Requirements for Data Processing and Analysis on the Open Science Grid Greg Graham FNAL CD/CMS for OSG Deployment 16-Dec-2004.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
The OMII Position At the University of Southampton.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
HEP Experiment Integration within GriPhyN/PPDG/iVDGL Rick Cavanaugh University of Florida DataTAG/WP4 Meeting 23 May, 2002.
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
Grid Job and Information Management (JIM) for D0 and CDF Gabriele Garzoglio for the JIM Team.
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.
1 S-Matrix and the Grid Geoffrey Fox Professor of Computer Science, Informatics, Physics Pervasive Technology Laboratories Indiana University Bloomington.
A DΙgital Library Infrastructure on Grid EΝabled Technology ETICS Usage in DILIGENT Pedro Andrade
DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.
Ruth Pordes, Fermilab CD, and A PPDG Coordinator Some Aspects of The Particle Physics Data Grid Collaboratory Pilot (PPDG) and The Grid Physics Network.
Data Grid projects in HENP R. Pordes, Fermilab Many HENP projects are working on the infrastructure for global distributed simulated data production, data.
10/24/2015OSG at CANS1 Open Science Grid Ruth Pordes Fermilab
GEM Portal and SERVOGrid for Earthquake Science PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics, Physics.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
David Adams ATLAS ADA, ARDA and PPDG David Adams BNL June 28, 2004 PPDG Collaboration Meeting Williams Bay, Wisconsin.
VDT 1 The Virtual Data Toolkit 7.th EU DataGrid Internal Project Conference Heidelberg / Germany Todd Tannenbaum (Miron Livny) (Alain.
Grids - the near future Mark Hayes NIEeS Summer School 2003.
EGEE is a project funded by the European Union under contract IST Middleware Planning for LCG/EGEE Bob Jones EGEE Technical Director e-Science.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
Alain Roy Computer Sciences Department University of Wisconsin-Madison Packaging & Testing: NMI & VDT.
LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
The Particle Physics Data Grid Collaboratory Pilot Richard P. Mount For the PPDG Collaboration DOE SciDAC PI Meeting January 15, 2002.
Cole David Ronnie Julio. Introduction Globus is A community of users and developers who collaborate on the use and development of open source software,
The National Grid Service Mike Mineter.
Middleware for Campus Grids Steven Newhouse, ETF Chair (& Deputy Director, OMII)
Remarks on OGSA and OGSI e-Science All Hands Meeting September Geoffrey Fox, Indiana University.
Testing Grid Software on the Grid Steven Newhouse Deputy Director.
Alain Roy Computer Sciences Department University of Wisconsin-Madison Condor & Middleware: NMI & VDT.
GriPhyN Project Paul Avery, University of Florida, Ian Foster, University of Chicago NSF Grant ITR Research Objectives Significant Results Approach.
Biomedical Informatics Research Network The Storage Resource Broker & Integration with NMI Middleware Arcot Rajasekar, BIRN-CC SDSC October 9th 2002 BIRN.
U.S. Grid Projects and Involvement in EGEE Ian Foster Argonne National Laboratory University of Chicago EGEE-LHC Town Meeting,
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
The National Grid Service Mike Mineter.
Last update: 03/03/ :37 LCG Grid Technology Area Quarterly Status & Progress Report SC2 February 6, 2004.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
Parallel Computing Globus Toolkit – Grid Ayaka Ohira.
Bob Jones EGEE Technical Director
BaBar-Grid Status and Prospects
EGEE Middleware Activities Overview
E-Infrastructure for Testing, Integration and Configuration of Software Alberto Di Meglio CERN, INFN, Engineering, 4D Soft, University of Wisconsin.
Stephen Pickles Technical Director, GOSC
GGF OGSA-WG, Data Use Cases Peter Kunszt Middleware Activity, Data Management Cluster EGEE is a project funded by the European.
P-GRADE and GEMLCA.
CSC 480 Software Engineering
LCG middleware and LHC experiments ARDA project
University of Technology
iSERVOGrid Architecture Working Group Brisbane Australia June
A conceptual model of grid resources and services
Some remarks on Portals and Web Services
Overview of the EGEE project and the gLite middleware
Open Science Grid at Condor Week
Large Scale Distributed Computing
Review of grid computing
Current and Future Perspectives of Grid Technology Panel
gLite The EGEE Middleware Distribution
gLite and LCG-2: an overview
GGF10 Workflow Workshop Summary
CReSIS Cyberinfrastructure
Presentation transcript:

Status of Grids for HEP and HENP May 21 2004 GlueX Workshop Bloomington Indiana Geoffrey Fox gcf@indiana.edu

Some Grid Activities Griphyn iVDGL PPDG VDT EDG EGEE LCG ATLAS CMS ARDA GT-3 and Gt-4 NMI OMII Semantic Grid

Topics Covered File Transport Datasets (linked files) Data Management Running and monitoring jobs Data Provenance and Curation Caching Batch Processing – Monte Carlo and Data transformations Physics Analysis Collaboration

Structure of Grids Grids are today structured as “services” – packaged distributed programs System Services: Security, File and database access, Collaboration, Service catalog, Metadata repository, Notification, Fault tolerance Application Services: Run a job, Define a PWA model, do a maximum likelihood fit Condor and Globus are critical job scheduling/running services in early HEP Grids All future Services will be built as Web Services Grid Portals with component interfaces

2: Schedule and control Execution 3: Access to Remote Computers Remote Grid Service 10: Job Status 1: Job Management Service (Grid Service Interface to user or program client) 1: Plan Execution 4: Job Submittal 2: Schedule and control Execution 8: Virtual Data 3: Access to Remote Computers 7: Cache Data Replicas 6: File and Storage Access Data 5: Data Transfer Data 9: Grid MPI

Some Grid Activities in Detail I Griphyn iVDGL PPDG VDT Package Globus 2 and Condor Deliver US counterpart to LCG EDG EGEE LCG Starting with Globus/Condor, deliver as Web Services with various enhancemed services as in metadata, security and caching ATLAS CMS Experiment specific software linked to ARDA ARDA EGEE led project to produce physics analysis (as opposed to batch processing system) Grid

ARDA

ATLAS CMS ARDA Integration

Some Grid Activities in Detail II Globus Toolkit GT-3 and GT-4 Produce enhanced Web Services as OGSI (GT-3) or WSRF (GT-4) Produce Grid Service version of Globus (GT-2) NMI NSF Middleware Initiative Package Internet-2 Security, Globus, Condor and Portal technologies OMII Open Middleware Infrastructure Institute Funded by UK e-Science program to produce generally useable Grid software Semantic Grid Support metadata about services and data (provenance) Data curation uses to look after data – digital libraries