DataTAG Research and Technological Development for a Transatlantic Grid Abstract The main idea behind the DataTAG project was to strengthen the collaboration.

Slides:



Advertisements
Similar presentations
CERN STAR TAP June 2001 Status of the EU DataGrid Project Fabrizio Gagliardi CERN EU-DataGrid Project Leader June 2001
Advertisements

The DataTAG Project 25 March, Brussels FP6 Information Day Peter Clarke, University College London.
An open source approach for grids Bob Jones CERN EU DataGrid Project Deputy Project Leader EU EGEE Designated Technical Director
Particle physics – the computing challenge CERN Large Hadron Collider –2007 –the worlds most powerful particle accelerator –10 petabytes (10 million billion.
SWITCH Visit to NeSC Malcolm Atkinson Director 5 th October 2004.
The DutchGrid Platform Collaboration of projects from –Computer Science, HEP and service providers Participating and supported projects –Virtual Laboratory.
EInfrastructures (Internet and Grids) US Resource Centers Perspective: implementation and execution challenges Alan Blatecky Executive Director SDSC.
A conceptual model of grid resources and services Authors: Sergio Andreozzi Massimo Sgaravatto Cristina Vistoli Presenter: Sergio Andreozzi INFN-CNAF Bologna.
Optical networking research in Amsterdam Paola Grosso UvA - AIR group.
EGEE is proposed as a project funded by the European Union under contract IST The EGEE International Grid Infrastructure and the Digital Divide.
CERN Krakow 2001 F. Gagliardi - CERN/IT 1 RTD efforts in Europe by Kyriakos Baxevanidis Foster cohesion, interoperability, cross- fertilization of knowledge,
GridPP meeting Feb 03 R. Hughes-Jones Manchester WP7 Networking Richard Hughes-Jones.
The LHC Computing Grid Project Tomi Kauppi Timo Larjo.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
1 INFRA : INFRA : Scientific Information Repository supporting FP7 “The views expressed in this presentation are those of the author.
The SIS On-Line Stand at the ICT4D World Summit Exhibition demonstrates how the internet connectivity and technology has the potential.
LCG and HEPiX Ian Bird LCG Project - CERN HEPiX - FNAL 25-Oct-2002.
From GEANT to Grid empowered Research Infrastructures ANTONELLA KARLSON DG INFSO Research Infrastructures Grids Information Day 25 March 2003 From GEANT.
Jarek Nabrzyski, Ariel Oleksiak Comparison of Grid Middleware in European Grid Projects Jarek Nabrzyski, Ariel Oleksiak Poznań Supercomputing and Networking.
EU-IndiaGrid (RI ) is funded by the European Commission under the Research Infrastructure Programme The EU-IndiaGrid Project Joining.
Data Grid projects in HENP R. Pordes, Fermilab Many HENP projects are working on the infrastructure for global distributed simulated data production, data.
MAIN TECHNICAL CHARACTERISTICS Next generation optical transport networks with 40Gbps capabilities are expected to be based on the ITU’s.
DataTAG Research and Technological Development for a Transatlantic Grid Abstract Several major international Grid development projects are underway at.
GriPhyN EAC Meeting (Jan. 7, 2002)Carl Kesselman1 University of Southern California GriPhyN External Advisory Committee Meeting Gainesville,
October LHCUSA meeting BNL Bjørn S. Nilsen Update on NSF-ITR Proposal Bjørn S. Nilsen The Ohio State University.
D0RACE: Testbed Session Lee Lueking D0 Remote Analysis Workshop February 12, 2002.
23 January 2003Paolo Moroni (Slide 1) SWITCH-cc meeting DataTAG overview.
Bob Jones Technical Director CERN - August 2003 EGEE is proposed as a project to be funded by the European Union under contract IST
Authors: Ronnie Julio Cole David
EGEE is a project funded by the European Union under contract IST Middleware Planning for LCG/EGEE Bob Jones EGEE Technical Director e-Science.
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 DataGrid Project Status Fabrizio Gagliardi.
…building the next IT revolution From Web to Grid…
Middleware Camp NMI (NSF Middleware Initiative) Program Director Alan Blatecky Advanced Networking Infrastructure and Research.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
Olivier MartinThe BETEL Project 28/11/1997 Slide (1) BETEL (Broadband Exchange over Trans-European Links) u Presentation Outline: l Background l Partners.
Project Results Thanks to the exceptional cooperation spirit between the European and North American teams involved in the DataTAG project,
NORDUnet Nordic Infrastructure for Research & Education Workshop Introduction - Finding the Match Lars Fischer LHCONE Workshop CERN, December 2012.
Tiziana FerrariThe DataTAG Projct, Roma Nov DataTAG Project.
119 May 2003HEPiX/HEPNT National Institute for Nuclear Physics and High Energy Physics Coordinates all (experimental) subatomic physics research in The.
29/1/2002A.Ghiselli, INFN-CNAF1 DataTAG / WP4 meeting Cern, 29 January 2002 Agenda  start at  Project introduction, Olivier Martin  WP4 introduction,
30 June Wide Area Networking Performance Challenges Olivier Martin, CERN UK DTI visit.
CERN The GridSTART EU accompany measure Fabrizio Gagliardi CERN
INFSO-RI Enabling Grids for E-sciencE The EGEE Project Owen Appleton EGEE Dissemination Officer CERN, Switzerland Danish Grid Forum.
Open Science Grid in the U.S. Vicky White, Fermilab U.S. GDB Representative.
EGEE Project Review Fabrizio Gagliardi EDG-7 30 September 2003 EGEE is proposed as a project funded by the European Union under contract IST
DataGrid is a project funded by the European Commission under contract IST rd EU Review – 19-20/02/2004 The EU DataGrid Project Three years.
LHC Computing, SPC-FC-CC-C; H F Hoffmann1 CERN/2379/Rev: Proposal for building the LHC computing environment at CERN (Phase 1) Goals of Phase.
GRIDSTART a European GRID coordination attempt Fabrizio Gagliardi CERN.
The EU DataTAG Project Richard Hughes-Jones Based on Olivier H. Martin GGF3 Frascati, Italy Oct 2001.
DataTAG overview. 3 February 2003Paolo Moroni (Slide 2) APM meeting - Barcelona Summary  Why DataTAG?  DataTAG project  Test-bed extensions  General.
DutchGrid KNMI KUN Delft Leiden VU ASTRON WCW Utrecht Telin Amsterdam Many organizations in the Netherlands are very active in Grid usage and development,
Grid Computing at NIKHEF Shipping High-Energy Physics data, be it simulated or measured, required strong national and trans-Atlantic.
Bob Jones EGEE Technical Director
JRA3 Introduction Åke Edlund EGEE Security Head
TESTBED (Technical)
Grid related projects CERN openlab LCG EDG F.Fluckiger
WP7 objectives, achievements and plans
University of Technology
CERN-USA connectivity update DataTAG project
CEOS workshop on Grid computing Slides mainly from Olivier Martin
DataTAG Project update
TCP Performance over a 2.5 Gbit/s Transatlantic Circuit
The EU DataTAG Project Olivier H. Martin CERN - IT Division
5th EU DataGrid Conference
Report on GLUE activities 5th EU-DataGRID Conference
Presentation at University of Twente, The Netherlands
Internet2 Spring Member meeting
Presented at the 4th DataGrid Conference
LHC Computing, RRB; H F Hoffmann
Presentation transcript:

DataTAG Research and Technological Development for a Transatlantic Grid Abstract The main idea behind the DataTAG project was to strengthen the collaboration between, Globus middleware based, Grid projects in Europe and in the USA by providing a common dedicated testbed, in order to facilitate the deployment of a “transparent” Grid infrastructure allowing access to the massively distributed computing infrastructure that is needed to meet the challenges of modern high energy physics experiments such as the data intensive LHC (Large Hadron Collider at CERN) applications. Consequently, the DataTAG project has addressed the issues which arise in the sectors of high performance inter-Grid and interoperability between the Grid middleware layers such as information and security services. The advances made have been disseminated into each of the associated Grid projects. Objectives The fundamental goal of the DataTAG project is to create a large-scale multi-vendor transatlantic testbed for Data Intensive Grids. Together with the European DataGrid (EDG) project and other related Grid projects in the USA such as GriPhyN, iVDGL and PPDG, this will allow to explore advanced networking technologies as well as interoperability issues between different Grid domains. Technical Approach The Grid interoperability issues have been addressed by INFN in collaboration with DataGrid and the Globus team through the definition of a new interoperable schema for describing Grid ressources such as computing, storage and network elements. Whereas, the networking issues have been addressed by procuring a dedicated 2.5 Gbps (phase 1) then 10Gbps (phase 2) circuit between CERN in Geneva and the StarLight Internet Exchange located at Northwestern University in Chicago. IST Research Networks - DataTAG Simplified view of the DataTAG project showing the EC project partners as well as the main cooperating networks on both sides of the Atlantic, while also stressing the worldwide nature of the emerging Grid infrastructure. Among the many other similar transatlantic circuits available to European researchers, the high speed DataTAG circuit between CERN in Geneva and STARLIGHT in Chicago will be the first one to offer 10 Gigabit Ethernet access in an open multi-vendor testbed environment for the benefit of Grid related network research.

Project name: DataTAG Contract no.: IST Project type: RTD Start date: 01/01/2001 Duration: 24 months Total budget: Є Funding from the EC: Є Total effort in person-month: 521 Web site: Contact person: Dr. Olivier H. Martin tel.: fax.: Project participants: CERN International INFN IT INRIA FR PPARC UK UvA NL Keywords: Grid High Speed Networks Internet2 landspeed record Scientific Research Telecommunications Collaboration with other EC funded projects: CrossGrid DataGRID Géant Gridstart Testbed The transatlantic DataTAG testbed is based on equipment and circuit funded jointly by the European Commission, the US National Science Foundation (NSF) through the Electronic Visualisation Lab (EVL) at University of Illinois in Chicago (UIC) and the US Department of Energy (DoE) through the California Institute of Technology (Caltech). The DataTAG multi-vendor layer 2 (Ethernet) and layer 3 (Internet) testbed with equipment from mainly Alcatel, Cisco and Juniper connected to high end Linux servers at 1 Gigabit as well as 10 Gigabit Ethernet is believed to be unique. The main use of this testbed has been for advanced network research and demonstrations focusing, in particular, on very high speed transport protocols, QoS and advance bandwidth reservation techniques Access to the testbed for experimental purposes is made possible in Europe through GEANT/DANTE and the National Research and Education Networks (NREN) involved using transparent VPN layer 2 tunnels, as well as through a 10Gbps circuit from Amsterdam contributed by Surfnet and a 2.5Gbps circuit to Lyon contributed by the French VTHD pilot network. The DataTAG testbed is open to other EC Grid projects as well as to other network research projects in the field of high performance transport protocols, on a case by case basis. Experiments Together with Surfnet that also operates a similar transatlantic circuit, the project pioneered Ethernet over SONET/SDH transport networks. Applications. Together with DataGrid and the LHC Computing Grid (LCG) project, the software of the CERN LHC experiments ALICE, ATLAS CMS and LHCb has been adapted to the Grid environment. Innovation The DataTAG project has many innovative components in the area of high performance transport, Quality of Service (QoS), advance bandwidth reservation, EU-US Grid interoperability and new tools for easing the management of Virtual Organizations such as the Virtual Organization Membership Server (VOMS) and Grid monitoring (GridICE). Results Thanks to the excellent cooperative spirit between the European and American teams involved in DataTAG, remarkable results have been achieved In a very short while. Regarding high performance transport, new Internet2 landspeed records for both IPv4 and IPv6 have been established and TCP/IP stacks variants such as FAST, Scalable TCP and High Speed TCP have been extensively tested. Regarding EU-US Grid interoperability, the Grid Laboratory Universal Environment (GLUE) activity led to the definition of common/interoperable Information specifications to be used for Resource Discovery. The “GLUE” schema has been subsequently incorporated in the Globus and DataGrid middleware. The WorldGrid demos made at IST2002 and SC2002 conferences and featuring cross job submission between the US and EU with “GLUE” enhanced EDG and Globus middleware on both sides of the Atlantic marked a very significant milestone towards the interoperability of EU & US Grid projects such as DataGrid, GriPhyN, iVDGL and PPDG. Success Stories Following the upgrade of the DataTAG circuit to 10Gb/s in September, the first ever transatlantic testbed with 10Gigabit Ethernet access capabilities became available, just in time for live demonstrations at Telecom World 2003 where CERN had a booth on the Lake Geneva Region stand. Thanks to this, a new 5.44Gb/s single stream TCP/IP data transfer record between CERN and Starlight was established by Caltech and CERN on October 1, and considerable publicity was given to this very significant technical feat by numerous media around the world. Indeed, ultra high speed data transfer will enable to download CDs, DVDs, complex images, etc, in seconds rather than minutes or hours which, in turn, will pave the way to new innovative applications. Contribution to Standards DataTAG is heavily involved in GGF activities with presence in the steering group (GFSG) and in several research groups (RG) and working groups (WG) such as Authorization Frameworks and Mechanisms, Grid Resource Allocation Agreement Protocol, High Performance Networking, Data Transport, OGSA, OGSI. The Generic AAA work co-authored by the University of Amsterdam (UvA) is described in IETF RFCs 2903/2904/2906 and IRTF Draft draft-irtf-aaaarch-generic-policy-03.txt IST Research Networks - DataTAG