INFSO-RI-508833 Enabling Grids for E-sciencE www.eu-egee.org The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison.

Slides:



Advertisements
Similar presentations
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
Advertisements

EGEE-II INFSO-RI Enabling Grids for E-sciencE The gLite middleware distribution OSG Consortium Meeting Seattle,
Plateforme de Calcul pour les Sciences du Vivant SRB & gLite V. Breton.
EInfrastructures (Internet and Grids) US Resource Centers Perspective: implementation and execution challenges Alan Blatecky Executive Director SDSC.
INFSO-RI Enabling Grids for E-sciencE JRA3 2 nd EU Review Input David Groep NIKHEF.
3 rd International Summer School Grid July Vico Equense - Naples Giovaaaanni’s Group The 3 rd International Summer School on Grid Computing.
Open Science Grid June 28, 2006 Bill Kramer Chair of the Open Science Grid Council NERSC Center General Manager, LBNL.
The Globus Toolkit Gary Jackson. Introduction The Globus Toolkit is a product of the Globus Alliance ( It is middleware for developing.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Kate Keahey Argonne National Laboratory University of Chicago Globus Toolkit® 4: from common Grid protocols to virtualization.
Commodity Grid (CoG) Kits Keith Jackson, Lawrence Berkeley National Laboratory Gregor von Laszewski, Argonne National Laboratory.
OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.
GIG Software Integration: Area Overview TeraGrid Annual Project Review April, 2008.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
What is OMII-Europe? Qin Li Beihang University. EU project: RIO31844-OMII-EUROPE 1 What is OMII-Europe? Open Middleware Infrastructure Institute for Europe.
ARGONNE  CHICAGO Ian Foster Discussion Points l Maintaining the right balance between research and development l Maintaining focus vs. accepting broader.
OSG Middleware Roadmap Rob Gardner University of Chicago OSG / EGEE Operations Workshop CERN June 19-20, 2006.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Simply monitor a grid site with Nagios J.
INFSO-RI Enabling Grids for E-sciencE SA1: Cookbook (DSA1.7) Ian Bird CERN 18 January 2006.
Grid Workload Management & Condor Massimo Sgaravatto INFN Padova.
Enabling Grids for E-sciencE ENEA and the EGEE project gLite and interoperability Andrea Santoro, Carlo Sciò Enea Frascati, 22 November.
Miron Livny Computer Sciences Department University of Wisconsin-Madison Welcome and Condor Project Overview.
Miron Livny Center for High Throughput Computing Computer Sciences Department University of Wisconsin-Madison Open Science Grid (OSG)
INFSO-RI Enabling Grids for E-sciencE Status and Plans of gLite Middleware Erwin Laure 4 th ARDA Workshop 7-8 March 2005.
Virtual Data Grid Architecture Ewa Deelman, Ian Foster, Carl Kesselman, Miron Livny.
GriPhyN EAC Meeting (Jan. 7, 2002)Carl Kesselman1 University of Southern California GriPhyN External Advisory Committee Meeting Gainesville,
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks PPS All sites Meeting: Introduction & Agenda.
Quick Introduction to NorduGrid Oxana Smirnova 4 th Nordic LHC Workshop November 23, 2001, Stockholm.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks, An Overview of the GridWay Metascheduler.
Tools for collaboration How to share your duck tales…
Ames Research CenterDivision 1 Information Power Grid (IPG) Overview Anthony Lisotta Computer Sciences Corporation NASA Ames May 2,
NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 NW-GRID Campus Grids Workshop Liverpool31 Oct 2007 Moving Beyond Campus Grids Steven Young Oxford NGS.
LCG EGEE is a project funded by the European Union under contract IST LCG PEB, 7 th June 2004 Prototype Middleware Status Update Frédéric Hemmer.
GRIDS Center Middleware Overview Sandra Redman Information Technology and Systems Center and Information Technology Research Center National Space Science.
INFSO-RI Enabling Grids for E-sciencE OSG-LCG Interoperability Activity Author: Laurence Field (CERN)
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Open Science Grid Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab September 1, 2005.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
INFSO-RI Enabling Grids for E-sciencE gLite Data Management and Interoperability Peter Kunszt (JRA1 DM Cluster) 2 nd EGEE Conference,
US LHC OSG Technology Roadmap May 4-5th, 2005 Welcome. Thank you to Deirdre for the arrangements.
Conference name Company name INFSOM-RI Speaker name The ETICS Job management architecture EGEE ‘08 Istanbul, September 25 th 2008 Valerio Venturi.
INFSO-RI Enabling Grids for E-sciencE EGEE Middleware reengineering Claudio Grandi – JRA1 Activity Manager - INFN EGEE Final EU.
Project Overview Dr Fredrik Hedman Royal Institute of Technology (PDC/KTH)
Glite. Architecture Applications have access both to Higher-level Grid Services and to Foundation Grid Middleware Higher-Level Grid Services are supposed.
G Z LIGO's Physics at the Information Frontier Grant and OSG: Update Warren Anderson for Patrick Brady (PIF PI) OSG Executive Board Meeting Caltech.
Alain Roy Computer Sciences Department University of Wisconsin-Madison Condor & Middleware: NMI & VDT.
Status Organization Overview of Program of Work Education, Training It’s the People who make it happen & make it Work.
2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Upcoming Features and Roadmap Ricardo Rocha ( on behalf of the.
U.S. Grid Projects and Involvement in EGEE Ian Foster Argonne National Laboratory University of Chicago EGEE-LHC Town Meeting,
EGEE-II INFSO-RI Enabling Grids for E-sciencE gLite and Condor present and future Claudio Grandi (INFN – Bologna)
Open Science Grid: Beyond the Honeymoon Dane Skow Fermilab October 25, 2005.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Communication tools between Grid Virtual.
Università di Perugia Enabling Grids for E-sciencE Status of and requirements for Computational Chemistry NA4 – SA1 Meeting – 6 th April.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Grid Monitoring Tools E. Imamagic, SRCE CE.
Parag Mhashilkar Computing Division, Fermi National Accelerator Laboratory.
EGEE-II INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Interoperability Shibboleth - gLite Christoph.
1 An update on the Open Science Grid for IHEPCCC Ruth Pordes, Fermilab.
Towards deploying a production interoperable Grid Infrastructure in the U.S. Vicky White U.S. Representative to GDB.
1 Open Science Grid: Project Statement & Vision Transform compute and data intensive science through a cross- domain self-managed national distributed.
INFSO-RI Enabling Grids for E-sciencE EGEE general project update Fotis Karayannis EGEE South East Europe Project Management Board.
OSG Facility Miron Livny OSG Facility Coordinator and PI University of Wisconsin-Madison Open Science Grid Scientific Advisory Group Meeting June 12th.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
2 nd EGEE/OSG Workshop Data Management in Production Grids 2 nd of series of EGEE/OSG workshops – 1 st on security at HPDC 2006 (Paris) Goal: open discussion.
Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.
Enabling Grids for E-sciencE University of Perugia Computational Chemistry status report EGAAP Meeting – 21 rst April 2005 Athens, Greece.
Regional Operations Centres Core infrastructure Centres
Open Science Grid Progress and Status
Leigh Grundhoefer Indiana University
gLite The EGEE Middleware Distribution
Presentation transcript:

INFSO-RI Enabling Grids for E-sciencE The US Federation Miron Livny Computer Sciences Department University of Wisconsin – Madison

Enabling Grids for E-sciencE INFSO-RI US Federation 2 Overview US institutions – –University of Chicago (I. Foster) –University of Southern California (C. Kesselman) –University of Wisconsin-Madison (M. Livny) Funding (year 1) – –$200K from the NSF Middleware Imitative (NMI) via the GRIDS center –$250K from the Particle and Nuclear Astrophysics program at the NSF –$97K from the DOE-LHC Research Program

Enabling Grids for E-sciencE INFSO-RI US Federation 3 gLite Integral part of the gLite technical process –Contributed to the formulation of the gLite technical effort –Participation in the monthly meeting of the gLite design team –Participation in “focused” meetings of the design team (Data Management, Account management and Authentication) –Review architecture documents Operate one out of the two gLite prototype sites Facilitate exchange of concepts, principals and implementation details between EGEE and OSG –Joint membership in the design teams of the two grids –Formal and informal exchanges of design principals and development plans and schedules

Enabling Grids for E-sciencE INFSO-RI US Federation 4 University of Chicago Dynamic accounts service –GT4-based service for creation, lifetime management, access control of dynamically created Unix accounts –EGEE using with GT2 GRAM; adaptation to GT4 GRAM easy –Integration with LCMAPS and VOMS security services from EGEE –Tested on gLite testbed; scheduled for 1st release GRAM4 design & implementation –Control of resource usage on head node, and other benefits –Also evaluated as gLite SetUID service New GridFTP implementation –Visit to CERN to discuss status & inclusion in EGEE software GT4 development and evaluation –Frequent contact with EGEE integration team; visits to CERN Grid Security Infrastructure enhancements –Many, some have made their way into EGEE software

Enabling Grids for E-sciencE INFSO-RI US Federation 5 University of Southern California Developed a Globus-based POOL FileCatalog using Globus Replica Location Service (RLS) + minor enhancements –Unit, system and performance tested at Fermi Lab –Used in test environment with ORCA application –Early performance tests show up to 800/sec file registrations and up to 400/sec file lookups –Currently adapting to new interfaces exposed by upcoming release of POOL – eliminate unused metadata interfaces Near-term plans: enhance the Globus File Catalog to support a distributed backend Long-term plans: add complimentary Publishing Service (based on LIGO LDR) to replicate data files among sites Deployment of Globus RLS on Wisconsin EGEE testbed –Currently: Uses Globus RLS for the GLite replica catalog –Future: Working to replace the GLite file catalog

Enabling Grids for E-sciencE INFSO-RI US Federation 6 University of Wisconsin-Madison Compute Element – –Collaborated with the gLite team on adding PBS and LSF interfaces to Condor-G –Developed Condor-C according to meet gLite requirements –Collaborated with the gLite team on interfacing the WMS with Condor-C Data Management –Supported the evaluation and usage of Stork Prototype –Operated one of the two nodes of the testbed –Deployed a second VO on the UW node –Participated in the weekly eXtented Integration Meeting Virtual Data Toolkit (VDT) –Worked closely with EGEE deployment to meet their requirements and incorporate their enhancements

Enabling Grids for E-sciencE INFSO-RI US Federation 7 Observations Effective exchange of ideas, requirements, solutions and technologies Coordinated development of new capabilities Open communication channels Joint deployment and testing of middleware Early detection of differences and disagreements gLite is not “just” a software stack, it is a “new” framework for international collaborative middleware development. Much has been accomplished in the first year. However, this is “just” the first step.