1. GriPhyN Project Overview Paul Avery University of Florida avery@phys.ufl.edu GriPhyN NSF Project Review 29-30 January 2003 Chicago

2. 229 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN = Experiments + CS + Grids GriPhyN = Grid Physics Network –Computer Scientists (Globus, Condor, SRB, …) –Physicists from 4 frontier physics/astronomy expts. GriPhyN basics (2000 – 2005) –$11.9M (NSF) + $1.6M (matching) –17 universities, SDSC, 3 labs, ~80 people –Integrated Outreach effort (UT Brownsville) Management –Paul Avery (Florida)co-Director –Ian Foster (Chicago)co-Director –Mike Wilde (Argonne)Project Coordinator –Rick Cavanaugh (Florida)Deputy Coordinator

3. 329 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Institutions (Sep. 2000) –U Florida –U Chicago –Boston U –Caltech –U Wisconsin, Madison –USC/ISI –Harvard –Indiana –Johns Hopkins –Texas A&M –Stanford –U Illinois at Chicago –U Penn –U Texas, Brownsville –UC Berkeley –U Wisconsin, Milwaukee –UC San Diego –SDSC –Lawrence Berkeley Lab –Argonne –Fermilab –Brookhaven Funded by GriPhyN

4. 429 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Vision Create tools to enable collaborative research –Large research teams … by global scientific communities –International distribution of people and resources … at petascale levels –PetaOps + PetaBytes + Performance … in a transparent way –Scientists think in terms of their science

5. 529 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Science Drivers US-CMS & US-ATLAS –HEP experiments at LHC/CERN –100s of Petabytes LIGO –Gravity wave experiment –100s of Terabytes Sloan Digital Sky Survey –Digital astronomy (1/4 sky) –10s of Terabytes Data growth Community growth 2007 2002 2001  Massive CPU  Large, distributed datasets  Large, distributed communities

6. 629 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Goals Conduct CS research to achieve vision –Virtual Data as unifying principle –Planning, execution, performance monitoring Disseminate through Virtual Data Toolkit Integrate into GriPhyN science experiments –Common Grid tools, services Impact other disciplines –HEP, biology, medicine, virtual astronomy, eng. –Other Grid projects Educate, involve, train students in IT research –Undergrads, grads, postdocs, –Underrepresented groups

7. 729 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Goal: PetaScale Virtual-Data Grids Virtual Data Tools Request Planning & Scheduling Tools Request Execution & Management Tools Transforms Distributed resources (code, storage, CPUs, networks) Resource Management Services Security and Policy Services Other Grid Services Interactive User Tools Production Team Single Researcher Workgroups Raw data source  PetaOps  Petabytes  Performance

8. 829 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu CMS Experiment Example: Global LHC Data Grid Online System CERN Computer Center > 20 TIPS USA Korea Russia UK Institute 100-200 MBytes/s 2.5 Gbits/s 1 Gbits/s 2.5 - 10 Gbits/s ~0.6 Gbits/s Tier 0 Tier 1 Tier 3 Tier 2 Physics cache PCs, other portals Institute Tier2 Center Tier 4

9. 929 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Project Challenges We balance and coordinate –CS research with “goals, milestones & deliverables” –GriPhyN schedule/priorities/risks with those of the 4 experiments –General tools developed by GriPhyN with specific tools developed by 4 experiments –Data Grid design, architecture & deliverables with those of other Grid projects Appropriate balance requires –Tight management, close coordination, trust We have (so far) met these challenges –But requires constant attention, good will

10. 1029 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu External Advisory Committee Physics Experiments Project Directors Paul Avery Ian Foster Internet 2DOE Science NSF PACIs Project Coordination Mike Wilde Rick Cavanaugh Outreach/Education Manuela Campanelli Industrial Connections Ian Foster / Paul Avery EDG, LCG, Other Grid Projects Architecture Carl Kesselman VDT Development Coord.: M. Livny Requirements, Definition & Scheduling (Miron Livny) Integration, Testing, Documentation, Support (Alain Roy) Globus Project & NMI Integration (Carl Kesselman) CS Research Coord.: I. Foster Virtual Data (Mike Wilde) Request Planning & Scheduling (Ewa Deelman) Execution Management (Miron Livny) Measurement, Monitoring & Prediction (Valerie Taylor) Applications Coord.: R. Cavanaugh ATLAS (Rob Gardner) CMS (Rick Cavanaugh) LIGO (Albert Lazzarini) SDSS (Alexander Szalay) Inter-Project Coordination: R. Pordes HICB (Larry Price) HIJTB (Carl Kesselman) PPDG (Ruth Pordes) TeraGrid, NMI, etc. (TBD) International (EDG, etc) (Ruth Pordes) GriPhyN Management iVDGL iVDGL Rob Gardner

11. 1129 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu External Advisory Committee Members –Fran Berman (SDSC Director) –Dan Reed (NCSA Director) –Joel Butler (former head, FNAL Computing Division) –Jim Gray (Microsoft) –Bill Johnston (LBNL, DOE Science Grid) –Fabrizio Gagliardi (CERN, EDG Director) –David Williams (former head, CERN IT) –Paul Messina (former CACR Director) –Roscoe Giles (Boston U, NPACI-EOT) Met with us 3 times: 4/2001, 1/2002, 1/2003 –Extremely useful guidance on project scope & goals

12. 1229 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Integration of GriPhyN and iVDGL International Virtual-Data Grid Laboratory –A global Grid laboratory (US, EU, Asia, …) –A place to conduct Data Grid tests “at scale” –A mechanism to create common Grid infrastructure –A laboratory for Grid tests by other disciplines Tight integration with GriPhyN –Testbeds –VDT support –Outreach –Common External Advisory Committee International participation –DataTag (EU) –UK e-Science programme: support 6 CS Fellows

13. 1329 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN/iVDGL Basics Both NSF funded, overlapping periods –GriPhyN:$11.9M (NSF) + $1.6M (match)(2000–2005) –iVDGL:$13.7M (NSF) + $2M (match)(2001–2006) Basic composition –GriPhyN:12 universities, SDSC, 3 labs(~82 people) –iVDGL:16 institutions, SDSC, 3 labs(~84 people) –Large overlap: people, institutions, experiments GriPhyN (Grid research) vs iVDGL (Grid deployment) –GriPhyN:2/3 “CS” + 1/3 “physics”( 0% H/W) –iVDGL:1/3 “CS” + 2/3 “physics”(20% H/W) –Virtual Data Toolkit (VDT) in common –Testbeds in common

14. 1429 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu U FloridaCMS CaltechCMS, LIGO UC San DiegoCMS, CS Indiana UATLAS, iGOC Boston UATLAS U Wisconsin, MilwaukeeLIGO Penn StateLIGO Johns HopkinsSDSS, NVO U ChicagoCS U Southern CaliforniaCS U Wisconsin, MadisonCS Salish KootenaiOutreach, LIGO Hampton UOutreach, ATLAS U Texas, BrownsvilleOutreach, LIGO FermilabCMS, SDSS, NVO BrookhavenATLAS Argonne LabATLAS, CS iVDGL Institutions T2 / Software CS support T3 / Outreach T1 / Labs (not funded)

15. 1529 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu US-iVDGL Sites (Spring 2003) Partners?  EU  CERN  Brazil  Australia  Korea  Japan UF Wisconsin BNL Indiana Boston U SKC Brownsville Hampton PSU J. Hopkins Caltech Tier1 Tier2 Tier3 FIU FSU Arlington Michigan LBL Oklahoma Argonne Vanderbilt UCSD/SDSC NCSA Fermilab

16. 1629 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Example: US-CMS Grid Testbed

17. 1729 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu iVDGL Management & Coordination Project Coordination Group US External Advisory Committee GLUE Interoperability Team Collaborating Grid Projects TeraGridEDGAsiaDataTAG BTEV LCG? BioALICEGeo? D0PDCCMS HI ? US Project Directors Outreach Team Core Software Team Facilities Team Operations Team Applications Team International Piece US Project Steering Group U.S. Piece GriPhyN Mike Wilde

18. 1829 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Meetings in 2000-2001 GriPhyN/iVDGL meetings –Oct. 2000All-handsChicago –Dec. 2000ArchitectureChicago –Apr. 2001All-hands, EACUSC/ISI –Aug. 2001PlanningChicago –Oct. 2001All-hands, iVDGLUSC/ISI Numerous smaller meetings –CS-experiment –CS research –Liaisons with PPDG and EU DataGrid –US-CMS and US-ATLAS computing reviews –Experiment meetings at CERN

19. 1929 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Meetings in 2002 GriPhyN/iVDGL meetings –Jan. 2002EAC, Planning, iVDGLFlorida –Mar. 2002Outreach WorkshopBrownsville –Apr. 2002All-handsArgonne –Jul. 2002Reliability WorkshopISI –Oct. 2002Provenance WorkshopArgonne –Dec. 2002Troubleshooting WorkshopChicago –Dec. 2002All-hands technicalISI + Caltech –Jan. 2003EACSDSC Numerous other 2002 meetings –iVDGL facilities workshop (BNL) –Grid activities at CMS, ATLAS meetings –Several computing reviews for US-CMS, US-ATLAS –Demos at IST2002, SC2002 –Meetings with LCG (LHC Computing Grid) project –HEP coordination meetings (HICB)

20. 2029 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Progress: CS, VDT, Outreach Lots of good CS research (Later talks) Installation revolution: VDT + Pacman (Later talk) –Several major releases this year: VDT 1.1.5 –VDT/Pacman vastly simplify Grid software installation –Used by all experiments –Agreement to use VDT by LHC Computing Grid Project Grid integration in experiment s/w (Later talks) Expanding education/outreach (Later talk) –Integration with iVDGL –Collaborations: PPDG, NPACI-EOT, SkyServer, QuarkNet –Meetings, brochures, talks, …

21. 2129 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Progress: Student Participation Integrated student involvement –CS research –VDT deployment, testing, support –Integrating Grid tools in physics experiments –Cluster building, testing –Grid software deployment –Outreach, web development Integrated postdoc involvement –Involvement in all areas –Necessary when students not sufficient

22. 2229 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Global Context: Data Grid Projects U.S. Infrastructure Projects –GriPhyN (NSF) –iVDGL (NSF) –Particle Physics Data Grid (DOE) –TeraGrid (NSF) –DOE Science Grid (DOE) EU, Asia major projects –European Data Grid (EDG) (EU, EC) –EDG related national Projects (UK, Italy, France, …) –CrossGrid (EU, EC) –DataTAG (EU, EC) –LHC Computing Grid (LCG) (CERN) –Japanese Project –Korea project

23. 2329 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu U.S. Project Coordination: Trillium Trillium = GriPhyN + iVDGL + PPDG –Large overlap in leadership, people, experiments Benefit of coordination –Common S/W base + packaging: VDT + PACMAN –Low overhead for collaborative or joint projects: security, monitoring, newsletter, prod. grids, demos –Wide deployment of new technologies, e.g. Virtual Data –Stronger, more extensive outreach effort Forum for US Grid projects –Joint view, strategies, meetings and work –Unified entity to deal with EU & other Grid projects “Natural” collaboration across DOE and NSF projects –Funding agency interest?

24. 2429 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN = Experiments + CS + Grids GriPhyN = Grid Physics Network –Computer Scientists (Globus, Condor, SRB, …) –Physicists from 4 frontier physics/astronomy expts. GriPhyN basics (2000 – 2005) –$11.9M (NSF) + $1.6M (matching) –17 universities, SDSC, 3 labs, ~80 people –Integrated Outreach effort (UT Brownsville) Management –Paul Avery (Florida)co-Director –Ian Foster (Chicago)co-Director –Mike Wilde (Argonne)Project Coordinator –Rick Cavanaugh (Florida)Deputy Coordinator

25. 2529 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Institutions (Sep. 2000) –U Florida –U Chicago –Boston U –Caltech –U Wisconsin, Madison –USC/ISI –Harvard –Indiana –Johns Hopkins –Texas A&M –Stanford –U Illinois at Chicago –U Penn –U Texas, Brownsville –UC Berkeley –U Wisconsin, Milwaukee –UC San Diego –SDSC –Lawrence Berkeley Lab –Argonne –Fermilab –Brookhaven Funded by GriPhyN

26. 2629 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu GriPhyN Project Challenges We balance and coordinate –CS research with “goals, milestones & deliverables” –GriPhyN schedule/priorities/risks with those of the 4 experiments –General tools developed by GriPhyN with specific tools developed by 4 experiments –Data Grid design, architecture & deliverables with those of other Grid projects Appropriate balance requires –Tight management, close coordination, trust We have (so far) met these challenges –But requires constant attention, good will

27. 2729 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu External Advisory Committee Physics Experiments Project Directors Paul Avery Ian Foster Internet 2DOE Science NSF PACIs Project Coordination Mike Wilde Rick Cavanaugh Outreach/Education Manuela Campanelli Industrial Connections Ian Foster / Paul Avery EDG, LCG, Other Grid Projects Architecture Carl Kesselman VDT Development Coord.: M. Livny Requirements, Definition & Scheduling (Miron Livny) Integration, Testing, Documentation, Support (Alain Roy) Globus Project & NMI Integration (Carl Kesselman) CS Research Coord.: I. Foster Virtual Data (Mike Wilde) Request Planning & Scheduling (Ewa Deelman) Execution Management (Miron Livny) Measurement, Monitoring & Prediction (Valerie Taylor) Applications Coord.: R. Cavanaugh ATLAS (Rob Gardner) CMS (Rick Cavanaugh) LIGO (Albert Lazzarini) SDSS (Alexander Szalay) Inter-Project Coordination: R. Pordes HICB (Larry Price) HIJTB (Carl Kesselman) PPDG (Ruth Pordes) TeraGrid, NMI, etc. (TBD) International (EDG, etc) (Ruth Pordes) GriPhyN Management iVDGL iVDGL Rob Gardner

28. 2829 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu External Advisory Committee Members –Fran Berman (SDSC Director) –Dan Reed (NCSA Director) –Joel Butler (former head, FNAL Computing Division) –Jim Gray (Microsoft) –Bill Johnston (LBNL, DOE Science Grid) –Fabrizio Gagliardi (CERN, EDG Director) –David Williams (former head, CERN IT) –Paul Messina (former CACR Director) –Roscoe Giles (Boston U, NPACI-EOT) Met with us 3 times: 4/2001, 1/2002, 1/2003 –Extremely useful guidance on project scope & goals

29. 2929 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Integration of GriPhyN and iVDGL International Virtual-Data Grid Laboratory –A global Grid laboratory (US, EU, Asia, …) –A place to conduct Data Grid tests “at scale” –A mechanism to create common Grid infrastructure –A laboratory for Grid tests by other disciplines Tight integration with GriPhyN –Testbeds –VDT support –Outreach –Common External Advisory Committee International participation –DataTag (EU) –UK e-Science programme: support 6 CS Fellows

30. 3029 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu iVDGL Management & Coordination Project Coordination Group US External Advisory Committee GLUE Interoperability Team Collaborating Grid Projects TeraGridEDGAsiaDataTAG BTEV LCG? BioALICEGeo? D0PDCCMS HI ? US Project Directors Outreach Team Core Software Team Facilities Team Operations Team Applications Team International Piece US Project Steering Group U.S. Piece GriPhyN Mike Wilde

31. 3129 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Meetings in 2000-2001 GriPhyN/iVDGL meetings –Oct. 2000All-handsChicago –Dec. 2000ArchitectureChicago –Apr. 2001All-hands, EACUSC/ISI –Aug. 2001PlanningChicago –Oct. 2001All-hands, iVDGLUSC/ISI Numerous smaller meetings –CS-experiment –CS research –Liaisons with PPDG and EU DataGrid –US-CMS and US-ATLAS computing reviews –Experiment meetings at CERN

32. 3229 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Meetings in 2002 GriPhyN/iVDGL meetings –Jan. 2002EAC, Planning, iVDGLFlorida –Mar. 2002Outreach WorkshopBrownsville –Apr. 2002All-handsArgonne –Jul. 2002Reliability WorkshopISI –Oct. 2002Provenance WorkshopArgonne –Dec. 2002Troubleshooting WorkshopChicago –Dec. 2002All-hands technicalISI + Caltech –Jan. 2003EACSDSC Numerous other 2002 meetings –iVDGL facilities workshop (BNL) –Grid activities at CMS, ATLAS meetings –Several computing reviews for US-CMS, US-ATLAS –Demos at IST2002, SC2002 –Meetings with LCG (LHC Computing Grid) project –HEP coordination meetings (HICB)

33. 3329 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Global Context: Data Grid Projects U.S. Infrastructure Projects –GriPhyN (NSF) –iVDGL (NSF) –Particle Physics Data Grid (DOE) –TeraGrid (NSF) –DOE Science Grid (DOE) EU, Asia major projects –European Data Grid (EDG) (EU, EC) –EDG related national Projects (UK, Italy, France, …) –CrossGrid (EU, EC) –DataTAG (EU, EC) –LHC Computing Grid (LCG) (CERN) –Japanese Project –Korea project

34. 3429 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu U.S. Project Coordination: Trillium Trillium = GriPhyN + iVDGL + PPDG –Large overlap in leadership, people, experiments Benefit of coordination –Common S/W base + packaging: VDT + PACMAN –Low overhead for collaborative or joint projects: security, monitoring, newsletter, prod. grids, demos –Wide deployment of new technologies, e.g. Virtual Data –Stronger, more extensive outreach effort Forum for US Grid projects –Joint view, strategies, meetings and work –Unified entity to deal with EU & other Grid projects “Natural” collaboration across DOE and NSF projects –Funding agency interest?

35. 3529 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu International Grid Coordination Close collaboration with EU DataGrid (EDG) –Many connections with EDG activities HICB: HEP Inter-Grid Coordination Board –Non-competitive forum, strategic issues, consensus –Cross-project policies, procedures and technology –International joint projects HICB-JTB Joint Technical Board –Definition, oversight and tracking of joint projects –GLUE interoperability group Participation in LHC Computing Grid (LCG) –Software Computing Committee (SC2) –Project Execution Board (PEB) –Grid Deployment Board (GDB)

36. 3629 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Creation of WorldGrid Joint US-EU Grid deployment GriPhyN contribution: VDT –WorldGrid is major driver for VDT –Demonstrated at IST2002 (Copenhagen) –Demonstrated at SC2002 (Baltimore) Becoming major outreach tool in 2003 –Meeting in February to continue development

37. 3729 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu WorldGrid Sites

38. 3829 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu What Coordination Takes

39. 3929 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Extending GriPhyN’s Reach Dynamic workspaces proposal –Expansion of virtual data technologies to global analysis communities FIU: Creation of “CHEPREO” in Miami area –HEP research, participation in WorldGrid –Strong minority E/O, coordinate with GriPhyN/iVDGL –Research & int’l network: Brazil / South America Also, MRI, SciDAC, other proposals

40. 4029 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Summary CS research –Unified approach based around Virtual Data –Virtual Data, Planning, Execution, Monitoring Education/Outreach –Student & postdoc involvement at all levels –New collaborations with other E/O efforts, WorldGrid Organization and management –Clear management coordinating CS + experiments –Collaboration/coordination  US and international Research dissemination, broad impact –Wide deployment of VDT (US, WorldGrid, EDG, LCG) –Demo projects, experiment testbeds, major productions –New projects extending virtual data technologies

41. 4129 Jan 2003 Paul Avery, University of Florida avery@phys.ufl.edu Grid References Grid Book –www.mkp.com/grids GriPhyN –www.griphyn.org iVDGL –www.ivdgl.org PPDG –www.ppdg.net TeraGrid –www.teragrid.org Globus –www.globus.org Global Grid Forum –www.gridforum.org EU DataGrid –www.eu-datagrid.org