Grid-Ireland Gateway Architecture

Slides:



Advertisements
Similar presentations
FP7-INFRA Enabling Grids for E-sciencE EGEE Induction Grid training for users, Institute of Physics Belgrade, Serbia Sep. 19, 2008.
Advertisements

NorduGrid Grid Manager developed at NorduGrid project.
Adding scalability to legacy PHP web applications Overview Mario A. Valdez-Ramirez.
Sphinx Server Sphinx Client Data Warehouse Submitter Generic Grid Site Monitoring Service Resource Message Interface Current Sphinx Client/Server Multi-threaded.
HEAnet Conference 2006 John Walsh Grid-Ireland Grid Manager Trinity College Dublin The Grid Computing Infrastructure in Ireland and Abroad.
S. Gadomski, "ATLAS computing in Geneva", journee de reflexion, 14 Sept ATLAS computing in Geneva Szymon Gadomski description of the hardware the.
OxGrid, A Campus Grid for the University of Oxford Dr. David Wallom.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
11 Dec 2000F Harris Datagrid Testbed meeting at Milan 1 LHCb ‘use-case’ - distributed MC production
Bookkeeping data Monitoring info Get jobs Site A Site B Site C Site D Agent Production service Monitoring service Bookkeeping service Agent © Andrei Tsaregorodtsev.
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
The National Computational Grid for Ireland OpsCentre Infrastructure Staff TestGrid Porting Current Issues Future Plans Grid-Ireland OpsCentre.
Connecting OurGrid & GridSAM A Short Overview. Content Goals OurGrid: architecture overview OurGrid: short overview GridSAM: short overview GridSAM: example.
US ATLAS Western Tier 2 Status and Plan Wei Yang ATLAS Physics Analysis Retreat SLAC March 5, 2007.
03/27/2003CHEP20031 Remote Operation of a Monte Carlo Production Farm Using Globus Dirk Hufnagel, Teela Pulliam, Thomas Allmendinger, Klaus Honscheid (Ohio.
D0 SAM – status and needs Plagarized from: D0 Experiment SAM Project Fermilab Computing Division.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
L ABORATÓRIO DE INSTRUMENTAÇÃO EM FÍSICA EXPERIMENTAL DE PARTÍCULAS Enabling Grids for E-sciencE Grid Computing: Running your Jobs around the World.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
DataGrid is a project funded by the European Union VisualJob Demonstation EDG 1.4.x 2003 The EU DataGrid How the use of distributed resources can help.
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
Grid Workload Management Massimo Sgaravatto INFN Padova.
Laboratório de Instrumentação e Física Experimental de Partículas GRID Activities at LIP Jorge Gomes - (LIP Computer Centre)
PROGRESS: ICCS'2003 GRID SERVICE PROVIDER: How to improve flexibility of grid user interfaces? Michał Kosiedowski.
Operating Systems David Goldschmidt, Ph.D. Computer Science The College of Saint Rose CIS 432.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
June 24-25, 2008 Regional Grid Training, University of Belgrade, Serbia Introduction to gLite gLite Basic Services Antun Balaž SCL, Institute of Physics.
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
MTA SZTAKI Hungarian Academy of Sciences Introduction to Grid portals Gergely Sipos
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.
AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.
LCG LCG-1 Deployment and usage experience Lev Shamardin SINP MSU, Moscow
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
UTA MC Production Farm & Grid Computing Activities Jae Yu UT Arlington DØRACE Workshop Feb. 12, 2002 UTA DØMC Farm MCFARM Job control and packaging software.
PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.
Grid testing using virtual machines Stephen Childs*, Brian Coghlan, David O'Callaghan, Geoff Quigley, John Walsh Department of Computer Science Trinity.
The DataGrid Project NIKHEF, Wetenschappelijke Jaarvergadering, 19 December 2002
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
Alien and GSI Marian Ivanov. Outlook GSI experience Alien experience Proposals for further improvement.
Developing GRID Applications GRACE Project
Grid-Ireland John Morrison, University College Cork (UCC) Brian Coghlan, Trinity College Dublin (TCD) Andy Shearer, NUI Galway (NUIG) Ron Perrott, Queens.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI EGI solution for high throughput data analysis Peter Solagna EGI.eu Operations.
Accessing the VI-SEEM infrastructure
Computer Architecture & Grid Research Group and Grid-Ireland OpsCentre
Grid Computing: Running your Jobs around the World
First proposal for a modification of the GIS schema
Regional Operations Centres Core infrastructure Centres
Real Time Fake Analysis at PIC
Xiaomei Zhang CMS IHEP Group Meeting December
DataGrid WP6/CA CA Trust Matrices
U.S. ATLAS Grid Production Experience
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
GWE Core Grid Wizard Enterprise (
StratusLab Final Periodic Review
StratusLab Final Periodic Review
BOSS: the CMS interface for job summission, monitoring and bookkeeping
BOSS: the CMS interface for job summission, monitoring and bookkeeping
Hybrid Cloud Architecture for Software-as-a-Service Provider to Achieve Higher Privacy and Decrease Securiity Concerns about Cloud Computing P. Reinhold.
Stephen Childs Trinity College Dublin
BOSS: the CMS interface for job summission, monitoring and bookkeeping
THE STEPS TO MANAGE THE GRID
TYPES OFF OPERATING SYSTEM
Patrick Dreher Research Scientist & Associate Director
The International Dimension
Transactional Grid Deployment
Wide Area Workload Management Work Package DATAGRID project
Servers Options Put all services on one server, or
The DZero/PPDG D0/PPDG mission is to enable fully distributed computing for the experiment, by enhancing SAM as the distributed data handling system of.
Presentation transcript:

Grid-Ireland Gateway Architecture One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. Grid-Ireland Gateway Architecture John Walsh David O’Callaghan Brian Coghlan Trinity College Dublin

& Application Developers Grid Musicians Scientists & Application Developers Certificate Authorities System Managers One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. File Systems Operating Systems Batch Systems PBS, LSF Computing Nodes Storage Logging & Bookkeeping

Grid Symphony DB DB Replica Catalog Resource Broker Input Dataset 1 gridui JDL 3 DB One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. Output Dataset 11 Job Submit Event 2 7 5 Resource Broker Information Service 6 4 Job Submission Service 9 8 Computing Nodes Storage Job Status 10 Logging & Bookkeeping

Grid-Ireland Architecture Distributed gateways: TCD, UCD, NUIG, DIAS, UCD One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. Resource Centres: NUIG, UCD, DIAS, UCC, … CPU & disk farms Local management Grid Operations Centre [TCD] Gateway deployment National services Central management

Grid-Ireland Gateway LOGICAL Architecture gridnm gridui gridmon gridstore gridgate gridinstall 1Gbps switch UPS Servers x 6 Level-3 switch UPS Safe One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. gridinstall: boot server for others gridgate: site entry point gridstore: site temporary storage gridmon: information service gridui: submission user interface gridnm: network monitor

Grid-Ireland Gateway PHYSICAL Architecture gridstore gridgate gridinstall 1Gbps switch UPS gridmon gridnm gridui Servers x 3 Level-3 switch UPS Safe 3 servers run as virtual machines One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references.

Grid-Ireland Gateway Architecture public network firewall gridinstall repository net tracer UPS gridstore gridnm gridui UML gridgate gridmon 1Gbps switch VLAN0 1Gbps switch VLAN1 One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. cluster network

Grid-Ireland MiniGateway PHYSICAL Architecture Servers x 1 Level-3 switch UPS Safe 5 servers run as virtual machines gridinstall 1Gbps switch UPS gridnm gridui gridmon gridstore gridgate One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references.

Grid-Ireland MiniGateway Architecture public network firewall One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. gridinstall repository net tracer gridnm UPS UML gridui gridmon gridgate gridstore 1Gbps switch VLAN0 1Gbps switch VLAN1 cluster network

One of the initial services the networks intended to offer their clients was access to OMI results. It was envisioned that this should not be passive access, but proactive promotion through which the OMI offering was always proposed to the SME if there was an OMI solution to their problem. Despite multiple attempts to identify and establish an OMI solution for a problem, we were unable to promote OMI beyond the stage of a possible option and to achieve acceptance from an SME to use OMI technology. Multiple reasons exists for this: the huge difficulties identifying an OMI option if at all available; poor packaging and immature technology; low market profile for OMI developments suggesting they are not widely used and far from being a de-facto market standard; absence of previous experiences of applying the technology; most of the hardware developed within OMI is available only as chip building blocks (macrocells) not as chip-sets. In total the OMI option was rejected, as it was perceived to be too risky by the potential user. SMEs are highly risk-sensitive and usually do not operate in volumes justifying development of ASICs that can exploit OMI results, even if the macrocells were licensable with reasonable effort. The responsibility for marketing the OMI results lies with the companies originally developing the processor core or macrocell. The User Support Networks can, not and should not, take on this marketing effort. For the macrocells to find a market with the SMEs they must be turned into chip-sets easily available with proper documentation like application notes helping the SMEs engineer systems exploiting these chips. Knowledge about the available results is a key problem and there is an imminent need for a catalogue detailing what are available out of OMI, the availability of the products, terms and conditions, and application references. End