Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid Patrick Dreher Research Scientist & Associate Director MIT Laboratory for Nuclear Science Common Solutions Group Meeting Seattle, Washington September 18, 2002 September 9, 2002 Grid Technology Panel Patrick Dreher

General Goals for Production Grid End-to-end integration and deployment using existing and prototype grid services Seemless deployment and extensions of grid middleware and extensions between application 24x7 service and access to grid High availability of grid in production mode under stressful loads September 9, 2002 Grid Technology Panel Patrick Dreher

Web Services Data Analysis Grid Web services data analysis grid is being written, developed and tested jointly by Thomas Jefferson National Lab (Chip Watson, Walt Akers, Jie Chen, Ying Chen) and MIT (myself) Web Services approach chosen because there is wide spread distribution of browsers and powerful tools and applications from multiple vendors Traditional 3 tier architecture 1st tier is the browser 2nd tier is the Web services 3rd tier applications, databases, servers, etc. September 9, 2002 Grid Technology Panel Patrick Dreher

A Three Tier Web Services Architecture Web Browser Application Authenticated connections XML to HTML servlet Web Service Web Server (Portal) Web Service Web Service Remote Web Server Grid Service Web Service Grid resources, e.g. Condor Local Backend Services (batch, file, etc.) Storage system Batch system September 9, 2002 Grid Technology Panel Patrick Dreher

Distributed Analysis Environment Describe and publish data set (GFN, tag) Track and move data (sets) on requests Authenticate and authorize Submit, control, monitor access to resources September 9, 2002 Grid Technology Panel Patrick Dreher

Certificates September 9, 2002 Grid Technology Panel Patrick Dreher

September 9, 2002 Grid Technology Panel Patrick Dreher

Current certificate procedure Build strong authentication by combining Personal certificate used to create a proxy certificate Permanent certificate w/o the private key CA authority certificate (DOE Grids or JLab) Present this strong authentication triplicate to the Web server JLab server issues temporary 24 hour certificate Web server then grants SSL connection User registration for multi-site access is next step September 9, 2002 Grid Technology Panel Patrick Dreher

Authorizations September 9, 2002 Grid Technology Panel Patrick Dreher

Authorization Issues Local vs. grid-wide account management Closely tied to local site acceptable use policies Can either have local or group accounts Not every site allows group or pooled accounts Determine whether sites be willing (able) to delegate account management to a trusted CA? Grid-mapfiles Needs to be generated and distributed Local site needs to be able to access and download a grid-mapfile September 9, 2002 Grid Technology Panel Patrick Dreher

Replication and Transfers Prototype Web Services Data Analysis Grid is operational at the present time Current design allows for automated monitoring of repository directories and disk caches (currently not activated) September 9, 2002 Grid Technology Panel Patrick Dreher

Operation of the Replica Catalog September 9, 2002 Grid Technology Panel Patrick Dreher

DEMO September 9, 2002 Grid Technology Panel Patrick Dreher

Lattice Portal Technologies Employed Apache web server Tomcat servlet engine (periodically queries cluster batch systems and produces an XML data structure) 2nd servlet applies a style sheet to this XML document DEMO (cluster stats and job submission for authorized users) September 9, 2002 Grid Technology Panel Patrick Dreher

Theoretical Physics Computational Clusters and Grid Interconnects Fermilab and JLAB/MIT designing and operating clusters for lattice QCD since 1999 Currently 160 Pentium III processors (80 duals) at Fermilab, 88 ALPHA processors (singles, duals, quads) at JLAB and MIT; connected with Myrinet Newly installed 128 node system at JLAB and purchasing 256 node system at FNAL, using dual Pentium IV and Myrinet 2000 interconnect Preliminary schedule: ~1/4 TFlops sustained in 2002 ~10 TFlops sustained in 2005 September 9, 2002 Grid Technology Panel Patrick Dreher

Development Milestones Deploy prototype grid environment in 2002 Improve the robustness, reliability and maintainability of grid software through early use in production application environments. Integration, coordination, and inter-networking with functional working systems Integrate with international groups September 9, 2002 Grid Technology Panel Patrick Dreher

September 9, 2002 Grid Technology Panel Patrick Dreher