A Linux PC Farm for Physics Analysis at the ZEUS Experiment Marek Kowal, Krzysztof Wrona, Tobias Haas, Ingo Martens, Rainer Mankel DESY, Notkestrasse 85, Hanburg, Germany

Marek Kowal A Linux PC farm - plan of talk Overall status Key issues Hardware and Software Next steps

Marek Kowal Overall status First reconstruction farm working since 1997 Right now farm consists of 47 PCs Both reconstruction and analysis software runs efficiently on PCs

Marek Kowal Key issues Big computing power Big IO rate Easy user interface Maintenance Prices

Marek Kowal Hardware - introduction “worker” PCs - 45 “server” PCs - 2 Fileservers - 3 TB Old SGI Multiprocessor machines - 44 processors Network

Marek Kowal PCs - commodity hardware Farm built over past three years Number of PCsprocessormemoryIDESCSI –16 BPPro 20064MB2GB- –1 SPPro MB2GB3x8GB –19 BPII MB6GB- –1 SPII MB6GB3x8GB –10 BPIII MB8GB- Each PC equipped with 100Mb network card

Marek Kowal Fileservers - SGI Origin 2000, 4xIP27 195MHz, 0.75GB RAM, HIPPI 800Mb, 1Gb Challenge DM, 4xIP19 100MHz, 384 MB RAM, HIPPI 800Mb SCSI discs - 2TB Fibre Channel (!) discs - 1TB

Marek Kowal SGI Challenge XL total of three machines total of 44 processors (IP19,IP25) /20,16,8/ 4.3GB RAM /1.5,1,1.8/ HIPPI 800Mb

Marek Kowal Network hardware

Marek Kowal Software - introduction BATCH System Job submission tpfs & RFIO WWW interface

Marek Kowal Batch system NQS and LSF evaluated, LSF choosen for PCs LSF –possibility to define load window –possibility to define resource requirements for job (HDD!) SGI Challenges - still NQS

Marek Kowal Job submission software Allows to submit jobs (binaries & data) to batch system Each job is allocated its own working directory Operations supported: submission, retreival, querying status, listing, killing, purging Avaliable for: Linux, Solaris, IRIX, OSF1, Windows NT

Marek Kowal tpfs tpfs - transparent access to data stored on robots (hard copy) and discs (cached copy) automatic staging of files upon trial to open them

Marek Kowal RFIO stateless avaliable as dynamically loaded library (DLL) > export LD_PRELOAD_PATH=librfio.so > some_program

Marek Kowal WWW interface queues status / steering systems’ load and statistics discs avaliability and free space reports staging status and statistics

Marek Kowal Maintenance & Costs More space required for PCs than for Challenges (Racks!) No real console avaliable (BIOS problems!) Synchronization of software - AFS Price: 3000DM (PC, rack space, switch port, cabling and LSF licence)

Marek Kowal Next steps - hardware complete removal of SGI machines except for Origin2000 fileserver further PCs to be added increase in size of discs attached to fileserver - up to 4.5 TB till the end of 2000

Marek Kowal Next steps - software Development of new job submission software written as JAVA applet accesible via WWW New version of RFIO software with support for Disc Cache project started at DESY (see poster session - Patrick Fuhrmann)

Marek Kowal Have you got any questions? …...

A Linux PC Farm for Physics Analysis at the ZEUS Experiment Marek Kowal, Krzysztof Wrona, Tobias Haas, Ingo Martens, Rainer Mankel DESY, Notkestrasse 85, Hanburg, Germany