Collaborative Campus Grid - Practices and experiences in Leiden University Campus Grid (LUCGrid) Hui Li Feb 4, 2005

ASCI GNARP Workshop2 Outline Introduction Why another Grid? How to build a Grid? Lessons, challenges, and opportunities

Feb 4, 2005ASCI GNARP Workshop3 A Short Intro to Grid

Feb 4, 2005ASCI GNARP Workshop4 Why LUCGrid? Seminar Grid Computing - a collaborative “system” project Learning Grids via building a Grid Inter-faculty collaboration Exploit existing IT infrastructure A more “dynamic” system for research

Feb 4, 2005ASCI GNARP Workshop5 LUCGrid - testbed DAS2 (user) DAS1 (owner, 20 PI nodes) Workstations LIACS* Grid Portal Server Workstations Biopharmacy*

Feb 4, 2005ASCI GNARP Workshop6 LUCGrid - Middleware Packages –NSF NMI5 (GT3, Condor, MyProxy, NWS, etc) –VDT (GT2, Condor, VDS, Netlogger, etc) Tools –OGCE2 Portal –CSF Metascheduler –Ganglia cluster monitoring Applications –BLUST (biopharmacy)

Feb 4, 2005ASCI GNARP Workshop7 LUCGrid - Components Data Management Component (Proj. 7) Portal (Proj. 3) Resource Management Component (Proj. 4) Information Services Component (Proj. 5) Security and VO Component (Proj. 6) Applications Component (Proj. 8) Fabric Management Component (Proj. 1) Desktop Computing Component (Proj. 2)

Feb 4, 2005ASCI GNARP Workshop8 Project 1: Fabric Management - Setting Up the Testbed Networking (DHCP, NFS, NTP, DNS, etc) Linux Automatic Installation Infrastructure Middleware selection, installation and configuration (VDT) Security Infrastructure (NIKHEF CA) Testing and verification User Support: web site, documentation, mailing lists, trouble ticket system (Bugzilla)

Feb 4, 2005ASCI GNARP Workshop9 Project 2: Stealing the Idle Cycles

Feb 4, 2005ASCI GNARP Workshop10 Project 3: LUCGrid PortalLUCGrid Portal A Grid portal is a web server that provides an interface to Grid services, allowing users to submit jobs, transfer files, and query Grid information services from a standard web browser. Tools to facilitate building portals: –OGCE2 (Open Grid Computing Environment) Goal: –Setting up a portal server (lucgrid.liacs.nl) –Integrating with other Grid components

Feb 4, 2005ASCI GNARP Workshop11 Project 4: Resource Management Deployment –Condor configuration –CSF as metascheduler –Interfaces to Information Services Development –Scheduling plugins for CSF

Feb 4, 2005ASCI GNARP Workshop12 Project 5: Information Services and monitoring

Feb 4, 2005ASCI GNARP Workshop13 Project 6: Security and VO Management MyProxy - integration with portal VO (Virtual Organization) Management –Setting up multiple VOs –Authorization and Manage VOs – VOMS software

Feb 4, 2005ASCI GNARP Workshop14 Demo Condor Cluster –file:///Users/hli/Desktop/Ganglia-Report.htmlfile:///Users/hli/Desktop/Ganglia-Report.html Portal Server –file:///Users/hli/Desktop/LUCGrid-Portal-My- Workspace.htmlfile:///Users/hli/Desktop/LUCGrid-Portal-My- Workspace.html –file:///Users/hli/Desktop/P-f0545bae w.htmlfile:///Users/hli/Desktop/P-f0545bae w.html

Feb 4, 2005ASCI GNARP Workshop15 Lessons Organization –Core team (2-4) for deployment –Carefully designed project for development Policy and Management –System admin support, firewalls –Management support Dissemination and support –Education, tutorials –Helpdesk, bugzilla –Maintenance and update Clear goals –Bioinformatics applications

Feb 4, 2005ASCI GNARP Workshop16 Challenges Security Fabric Resource Management Information Services Data Management Applications User Portals

Feb 4, 2005ASCI GNARP Workshop17 Opportunities Inter-faculty resource-sharing and collaboration Inter-campus collaboration Testbed with many “dynamic” resources for research and development

Feb 4, 2005ASCI GNARP Workshop18 Acknowledgements All students in seminar Grid Computing 2004/2005 David Groep, CT NIKHEF Lex Wolters

Remarks, questions?