Towards Dynamic Database Deployment LCG 3D Meeting November 24, 2005 CERN, Geneva, Switzerland Alexandre Vaniachine (ANL)

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)2 Outline CMS & ATLAS collaborate in OSG ESF Activity The first ESF VM was deployed by CMS The first ESF service on that VM was by ATLAS: Grid-enabled mysql DB built by the DASH project: The next step is FroNTier deployment on ESF by CMS

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)3 Why Dynamic Deployment? Increased fluctuations in server load due to chaotic nature of opportunistic computations Static services deployment require over-capacity Opportunistic production on non-LCG sites Requires DB services deployment on-demand Framework for secure on-demand services deployment on OSG: Edge Services Includes grid-enabled database services

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)4 VO Software Installation Initial Model: VO admin prepares trusted pacman cache Site admin download (pacman –get ) VO user run test job Scalable Model: Site admin grant write access to VO admin VO admin push software to the sites VO user run test job

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)5 VO Services Installation Current Model: VO admin prepares replica rpm Site admin install: rpm -iVh VO user run test job Scalable model – same as software: Site admin grant write access to VO admin VO admin push services to the sites VO user run test job That requires VObox or Globus Workspace technology

SC05 booth presentation OSG Edge Services Framework 6 Open Science Grid Virtual Workspaces Virtual Workspaces: environments that can be made available dynamically on the Grid –Different possible implementations Workspace Service –Enables secure deployment and management of a workspace within a trusted computing base Authentication and authorization Deployment configuration Resource allocation enforcement –Workspace = deployment meta-data + image –More information and technology preview download available at

Open Science Grid Living on the Edge: OSG Edge Services Framework Kate Keahey Abhishek Rana

SC05 booth presentation OSG Edge Services Framework 8 Open Science Grid Edge Services Services executing on the edge of the public and private network Site CDF CMS ATLAS Guest VO SE CE Compute nodes and Storage nodes

SC05 booth presentation OSG Edge Services Framework 9 Open Science Grid Virtual Machines Excellent isolation, security, fine-grain forensics… Promising enforcement properties More control to the site & great recoverability Flexible configuration The ability to serialize and migrate Modern implementation are fast LXVU SPEC INT2000 (score) LXVU Linux build time (s) LXVU OSDB-OLTP (tup/s) LXVU SPEC WEB99 (score) Benchmark suite running on Linux (L), Xen (X), VMware Workstation (V), and UML (U)

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)10 Virtual Machine Monitor We have a fully functional ports of Linux 2.4 and 2.6 running over Xen, and regularly use it for running demanding applications like MySQL, Apache and PostgreSQL Xen has been supported by UK EPSRC, Intel Research, HP Labs, Microsoft Research, Network Appliance, and XenSource Inc.

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)11 Enhanced Security Outstanding isolation properties VM is completely isolated from a site gaining root privileges on a VM or even compromising a VM gives no access to the physical machine different VMs are fully isolated from each other and cannot harm each other Improved detection and forensics strategies Recovery images (compromised or otherwise) is easy: just start a copy of the image that has not been compromised or otherwise brought down starting up a Xen image takes on the order of ~100 milliseconds in contrast to many minutes to reimage a node

SC05 booth presentation OSG Edge Services Framework 12 Open Science Grid Edge Service Framework Staging Tools Workspace Service Image Repository Image Information ESF - Phase 1

SC05 booth presentation OSG Edge Services Framework 13 Open Science Grid Testbed & Images Testbed –SDSC (Abhishek) OSG production site, 150+ worker nodes Intel 2.6, 4GB, RAID device, Xen –FNAL (Burt) Xeon 3.2, 4GB, RAID device, Xen –UChicago (Rob, Borja) TeraPort, Xen 3 –ANL, PIOCON (Ed, John) coming online Images –SDSC: SL3.0.3, FC4, CentOS4.1 –FNAL: SL3.0.3, SL4, LTS 3, LTS 4 Edge Services –ATLAS: mysql-gsi db built by the DASH project

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)14 Proof-of-Concept Site admin: login as root to the ESF host at OSG production site Configure and launch VM on ESF host at UCSD/SDCS ( CMS Tier2) VO admin: login as root to VM Install DASH MySQL-build from PIOCON Configure grid certificate access privileges Close public network access to the server VO user: login to ATLAS production submit host at BNL Init grid proxy certificate Submit test job to OSG production site (SDSC) Job run on Worker Node access database via the private network and authorized by grid proxy certificate

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)15 The “Bubbly” Test Grid job established DB connection via the private network: /mysql Ver Distrib beta, for pc-linux-gnu (i686) Connection id: 8 Current database: gridTest Current user: SSL: Cipher in use is DHE-RSA-AES256-SHA Current pager: stdout Using outfile: '' Using delimiter: ; Server version: beta-x509up-log Protocol version: 10 Connection: via TCP/IP

SC05 booth presentation OSG Edge Services Framework 16 Open Science Grid ESF Project Phase 1 objective: create a proof-of-concept dynamic deployment of Edge Services Progress: Implement and release the Workspace Service Bubbly test: static deployment and test of a real Edge Service on a production site Dynamic deployment of an Edge Service and integration into OSG infrastructure Configuring more testbeds Deploying and testing more Edge Services

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)17 Roadmap Ahead Launch and test on static VM the next application: FroNTier Store these static images on SE Test dynamic deployment of trusted images

LCG 3D Meeting, November 24, 2005 Alexandre Vaniachine (ANL)18 OSG Flyers at SC05

Open Science Grid Backup Slides

SC05 booth presentation OSG Edge Services Framework 20 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO Admin

SC05 booth presentation OSG Edge Services Framework 21 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO Admin

SC05 booth presentation OSG Edge Services Framework 22 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site Role=VO Admin

SC05 booth presentation OSG Edge Services Framework 23 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site Role=VO Admin

SC05 booth presentation OSG Edge Services Framework 24 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO Admin

SC05 booth presentation OSG Edge Services Framework 25 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO Admin

SC05 booth presentation OSG Edge Services Framework 26 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO Admin LCG3D Data Replication

SC05 booth presentation OSG Edge Services Framework 27 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO User

SC05 booth presentation OSG Edge Services Framework 28 Open Science Grid ESF - Phase 1 ESF SE CMS Site ATLAS DB Role=VO User CE

SC05 booth presentation OSG Edge Services Framework 29 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO User

SC05 booth presentation OSG Edge Services Framework 30 Open Science Grid ESF - Phase 1 ESF SE CE CMS Site ATLAS DB Role=VO User