Download presentation
Presentation is loading. Please wait.
1
GridPP, The Grid & Industry
Tony Doyle, Project Leader Steve Lloyd, Collaboration Board Chairman Robin Middleton, Middleware Coordinator Neasan O’Neill, Events Officer Who we are, what it is and what we can do.
2
Developed a working, highly functional Grid
Who are GridPP? 19 UK Universities, CERN and CCLRC (RAL & Daresbury) Funded by PPARC: GridPP (£17m) “From Web to Grid” GridPP (£16m) “From Prototype to Production” GridPP (proposed) “From Production to Exploitation” Developed a working, highly functional Grid
3
Web: information sharing
Invented at CERN by Tim Berners-Lee Quickly crossed over into public use No. of Internet hosts (millions) Year Agreed protocols: HTTP, HTML, URLs Anyone can access information and post their own
4
Why do particle physicists need the Grid?
The CERN LHC The world’s most powerful particle accelerator 4 Large Experiments
6
Why do particle physicists need the Grid?
Example from LHC: starting from this event Concorde (15 Km) Mt. Blanc (4.8 Km) One year’s data from LHC would fill a stack of CDs 20km high ~100,000,000 electronic channels 800,000,000 proton-proton interactions per second Higgs per second 10 PBytes of data a year (10 Million GBytes = 14 Million CDs) We are looking for this “signature” Selectivity: 1 in 1013 Like looking for 1 person in a thousand world populations Or for a needle in 20 million haystacks!
7
Solution – Build a Grid Share more than information
Efficient use of resources at many institutes Leverage over other sources of funding Data, computing power, applications Join local communities Challenges: share data between thousands of scientists with multiple interests link major and minor computer centres ensure all data accessible anywhere, anytime grow rapidly, yet remain reliable for more than a decade cope with different management policies of different centres ensure data security be up and running routinely by 2007
8
Middleware is Everything
Your Program Single PC Grid PROGRAMS Your Program MIDDLEWARE User Interface Machine Word/Excel Games /Web Resource Broker Information Service OPERATING SYSTEM CPU Disks, CPU etc Replica Catalogue Bookkeeping Service Middleware is the Operating System of a distributed computing system Disk Server CPU Cluster CPU Cluster CPU Cluster
9
GridPP Middleware Development
Grid Data Management Network Monitoring Workload Management Information Services Security Storage Interfaces
10
What you need to use the Grid
1. Get a digital certificate (UK Certificate Authority) Authentication – who you are 2. Join a Virtual Organisation (VO) Authorisation – what you are allowed to do 3. Get access to a local User Interface Machine (UI) and copy your files and certificate there 4. Write some Job Description Language (JDL) and scripts to wrap your programs ############# HelloWorld.jdl ################# Executable = "/bin/echo"; Arguments = "Hello welcome to the Grid "; StdOutput = "hello.out"; StdError = "hello.err"; OutputSandbox = {"hello.out","hello.err"}; #########################################
11
International Context
GridPP is part of EGEE and LCG (currently the largest Grid in the world) EU Enabling Grids for e-Science (EGEE) Grid Deployment Project for all disciplines GridPP LCG EGEE UK National Grid Service UK’s core production computational and data Grid LHC Computing Grid (LCG) Grid Deployment Project for LHC NorduGrid (Scandinavia) Grid Research and Development collaboration Open Science Grid (USA) Science applications from HEP to biochemistry
12
The LCG Grid Status Worldwide 182 Sites 23,438 CPUs 9.2 PB Disk
2,200 Years of CPU time UK 21 Sites 4,482 CPUs 180 TB Disk 593 Years of CPU time
13
What GridPP Has Done So Far
Analysed 300,000 possible drug components in the fight against the Avian Flu virus Simulated 46 million molecules for medical research in 5 weeks, which would have taken over 80 years on a single PC Reached transfer speeds of 1 Gigabyte per second in high speed networking tests from CERN – a DVD every 5 seconds Simulated 500 million particle physics collisions with the BaBar experiment Transformed the way particle physics computing problems are approached
14
Who else can use a Grid? Astronomy Bioinformatics Engineering
Healthcare Commerce Gaming
15
“UK contributes to EGEE's battle with malaria”
Number of Biomedical jobs processed by country BioMed Successes/Day Success % % WISDOM (Wide In Silico Docking On Malaria) The first biomedical data challenge for drug discovery, which ran on the EGEE grid production service from 11 July 2005 until 19 August 2005. GridPP resources in the UK contributed ~100,000 kSI2k-hours from 9 sites Normalised CPU hours contributed to the biomedical VO for UK sites, July-August 2005
16
"GridPP has been developed to help answer questions about the conditions in the Universe just after the Big Bang," said Professor Keith Mason, head of the Particle Physics and Astronomy Research Council (PPARC). "But the same resources and techniques can be exploited by other sciences with a more direct benefit to society."
17
GridPP & Industry What We Have To Offer
Our Grid Security tools GridSite R-GMA APEL accounting system
18
Our Grid The UK Grid (via one of the individual university sites) can be used to run applications for areas such as finance and image processing.
19
Certification Authority
Security Tools & Gridsite Grid Security for the Web Web platforms for Grids Digital Certificates Certification Authority Gridsite identifies users to websites with the digital certificates GridSiteWiki is an extension to the tool GridSite is open source ( Gridsite: Have access to the sites' web-based editing interface.
20
RGMA & APEL accounting system
Relational Grid Monitoring Architecture An information and monitoring system for static and dynamic information about grid resources, applications and networks Accounting Processor for Event Logs Provides a summary of the resources consumed based on attributes such as CPU time, Wall Clock Time, Memory and grid user identity
21
GridPP & Industry Current Involvement
HP are sponsoring a joint project with GridPP at Bristol. GridPP has an association with IBM through collaboration on ScotGrid and R-GMA. Specific sites also have close relationships with various industrial suppliers.
22
GridPP & Industry Current Involvement
Posters at “Technology Opportunities from CERN: the impact of Big Physics on Industry”. Attended KITE club meetings on: Healthcare, Medical image processing Film and computer games Speakers at a forum on Network and Grid Security organised for the IT industry.
23
Future Plan to establish a small steering group to lead technology transfer activity. The group, working with various companies, would examine different methods of technology transfer and identify the GridPP activities that can be used in industry and business. Examples of methods of technology transfer include: CERN’s openlab programme; the EGEE Industry Forum; HP’s collaboration with Bristol; PPARC’s industry awards scheme and the DTI Technology Programme
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.