14 February 2007Fabrizio Cei1 INFN and University of Pisa PSI Review Meeting PSI, 14 February 2007 Status of MEG Software

14 February 2007Fabrizio Cei2 Outline  MEG Software organization  Status of Monte Carlo simulation  Short remind of analysis framework  Status of analysis codes  Status of MEG computing  Problem of overall data size  Conclusions

14 February 2007Fabrizio Cei3 MEG Software Organization MC Bartender(ROME) Analyzer(ROME) DAQ ZEBRA ROOT MIDAS ROOT Simulation Real Data WFM andsimulation WFM and pile-up simulation

14 February 2007Fabrizio Cei4 Status of Monte Carlo MEGMC program - written in Geant3.21; - data output in ZEBRA banks, automatically converted to C++ structures (readable from analysis codes); to C++ structures (readable from analysis codes); - it simulates pair (e.g.  e  ) or single (e.g. Michel positrons) events; - Full simulation of detector & calibration devices; - specific modules (tbeam & tbtc) for LXe/TC beam tests; - specific modules (tbeam & tbtc) for LXe/TC beam tests; - Next release soon; - Next release soon; - Updates since last meeting - Updates since last meeting –Common magnetic field with MEGAnalyzer –Different geometrical configurations (final or run 2006); - To be done; - To be done; -Few event types missing, e.g. LED; -Revision for radiative decay and AIF.

14 February 2007Fabrizio Cei5 Examples of MC events  e  event Michel positron RUN 2006 configuration: No LXe, no TICZ, 8 DCH, TICP displaced by ± 12 cm

14 February 2007Fabrizio Cei6 MC mass production  Expected to start very soon;  Event types and numbers to be decided. Typical CPU & DISK requirements for gem CPU time / 10 k events disk size / 10 k events Signal 24 hrs 2.5 GB alpha 1.3 hrs 400 MB Michel (> 40 MeV) 10 min 700 MB Michel (> 5 MeV) 5 min 550 MB

14 February 2007Fabrizio Cei7 Software framework: ROME ROME (Root based Object Oriented Midas Environment) is a framework generator. framework generator. It uses only 6 different C++ objects. It uses only 6 different C++ objects. ROME makes the “dirty job”: creating the structure, defining C++ classes, writing many include creating the structure, defining C++ classes, writing many include files, creating the dependences and the hierarchy …; files, creating the dependences and the hierarchy …; the users and detector experts perform the “smart job”: the users and detector experts perform the “smart job”: writing the analysis methods (tasks) and the related folders writing the analysis methods (tasks) and the related folders (data stored on memory) and trees (data stored on disks). (data stored on memory) and trees (data stored on disks). The most important feature is the modularity: the tasks can be exchanged at runtime. the tasks can be exchanged at runtime. Main developer: M. Schneebeli (PSI)

14 February 2007Fabrizio Cei8 ROME Interconnections Folders Tasks Fill Read Trees Fill Flag Histograms Fill Disk (Output) Write (ROOT) Disk (Input) Read (Format: ZEBRA, MIDAS & ROOT)

14 February 2007Fabrizio Cei9 ROME Event Display (ARGUS) Display includes tracks and energy deposits

14 February 2007Fabrizio Cei10 Waveform/track display Liquid Xenon Drift Chamber Both used in on-line and analysis too

14 February 2007Fabrizio Cei11 Trigger/TICP display Rate of individual channels TC bars

14 February 2007Fabrizio Cei12 Status of MEGBartender MEGBartender runs stable.  Event mixing with multiple formats planned (presently only ZEBRA); (presently only ZEBRA);  Refinement of simulation parameters on the basis of run 2006 data; the basis of run 2006 data;  Waveform simulation completed for LXe, TICP/TICZ, DCH wires; work needed TICP/TICZ, DCH wires; work needed for pad simulation; for pad simulation;  Several trigger simulations included.

14 February 2007Fabrizio Cei13 Status of MEGAnalyzer 1) MEGAnalyzer modified for use in online & offline LXe(R. Sawada (Tokyo), G. Signorelli (Pisa), Y.  LXe : (R. Sawada (Tokyo), G. Signorelli (Pisa), Y. Uchiyama (Tokyo), S. Yamada (UCI), F. Cei (Pisa)) Uchiyama (Tokyo), S. Yamada (UCI), F. Cei (Pisa)) - Waveform decoding implemented; -Charge-based reconstruction algorithms implemented; most of them tested; most of them tested; -Timing reconstruction & calibration algorithms under implementation and testing; under implementation and testing; - Peak finding and pattern recognition tasks existing.

14 February 2007Fabrizio Cei14 Status of MEGAnalyzer 2)  TICP/Z (P. Cattaneo (Pavia), Y. Uchiyama, D. Zanello (Rome), F. Xiao (UCI), A. Barchiesi (Rome), S. Dussoni (Genova)) F. Xiao (UCI), A. Barchiesi (Rome), S. Dussoni (Genova)) - waveform analysis implemented; - preliminary hit reconstruction implemented (Q,t L,t R )  (z, ); - still missing: correlation between adjacent bars & with DCH. - still missing: correlation between adjacent bars & with DCH.  DCH (H. Nishiguchi (Tokyo), M. Schneebeli, Y. Hisamatsu, V. Tumakov (UCI)) V. Tumakov (UCI)) - 3D-map of magnetic field; - 3D-map of magnetic field; - tracking by (preliminary) Kalman filter implemented; - tracking by (preliminary) Kalman filter implemented; - waveform decoding existing; - waveform decoding existing; - extraction of z-coordinate from cathode pad information in progress. - extraction of z-coordinate from cathode pad information in progress. - still missing: full hit reconstruction (3D information); - still missing: full hit reconstruction (3D information); pattern recognition at the beginning. pattern recognition at the beginning. Software changing very fast on the basis of 2006 data

14 February 2007Fabrizio Cei15 Status of MEGAnalyzer 3)  Trigger (G. Signorelli, D. Nicolò (Pisa)) - trigger info/banks coded in MIDAS: run #, event #, trigger - trigger info/banks coded in MIDAS: run #, event #, trigger code & WFMs, scalers (useful for determining run/live time); code & WFMs, scalers (useful for determining run/live time); - charge and timing reconstruction algorithms implemented - charge and timing reconstruction algorithms implemented and under testing. and under testing.  Database (R. Sawada) - two databases: MySQL and sqlite3; easy conversion; - two databases: MySQL and sqlite3; easy conversion; - MySQL needs network; sqlite3 for stand-alone environment in - MySQL needs network; sqlite3 for stand-alone environment in a separate svn module (megdb); a separate svn module (megdb); - included: geometry, trigger/hardware configuration, run - included: geometry, trigger/hardware configuration, run table, physical constants, reconstruction coefficients … table, physical constants, reconstruction coefficients …

14 February 2007Fabrizio Cei16 DRS in MEGAnalyzer  Data structure established - It is possible to write limited time regions of waveforms; waveforms; - Data size (including header) can be zero if the channel is not interesting; channel is not interesting; - Each chip has clock and trigger signal for calibration.  Calibration procedures under development and to be studied in detail. and to be studied in detail.

14 February 2007Fabrizio Cei17 MEG Sun Fire x4100 quad core 4 GB Fiber Channel Switch 15 x 500 GB SATA GBit Ethernet Offline cluster for MEG (LCMEG) Presently available : 20 CPU cores + 30 TB disk + Sun Grid EnginePresently available : 20 CPU cores + 30 TB disk + Sun Grid Engine Final situation : 64 CPU cores TB disk in totalFinal situation : 64 CPU cores TB disk in total Easily extensible; planned within 2007Easily extensible; planned within 2007

14 February 2007Fabrizio Cei18 Overall Data Rate In 2006 run we had 2.8 MB events (50% DC + TC, no LXe; 1/3 of the final configuration) and could run at ~ 10 HzIn 2006 run we had 2.8 MB events (50% DC + TC, no LXe; 1/3 of the final configuration) and could run at ~ 10 Hz Full detector estimates without any reduction: 9 MB/event,Full detector estimates without any reduction: 9 MB/event, 5 Hz, 10 7 sec, 450 TB/year 5 Hz, 10 7 sec, 450 TB/year Possible strategies for reducing data size:Possible strategies for reducing data size: –Zero suppression (50% on LXe, 80% on DC) –ADC/TDC values for non-signal-like events –Partial waveform readout (reduced window size) –Keep timing information in SQL database –3 rd level trigger in online cluster (e.g. linear fit, fast tracking …) (e.g. linear fit, fast tracking …) Effects on data to be evaluated Effects on data to be evaluated 30 Tb/year

14 February 2007Fabrizio Cei19 Conclusions  The MEG software is in an advanced state of preparation: state of preparation: –MEGMC + MEGBartender: almost finished –MEGAnalyzer: LXe: close to completion; TICP/Z & DCH: some parts missing, but fast TICP/Z & DCH: some parts missing, but fast evolution and significant effort; evolution and significant effort; Trigger/Database: ~ ok. Trigger/Database: ~ ok.  First part (~ 1/3) of MEG offline cluster in operation; in operation;  Data size to be reduced; discussion under way.

14 February 2007Fabrizio Cei20 Backup slides

14 February 2007Fabrizio Cei21 MC Man Power All 10  50 % of their time All 10  50 % of their time:  Coordination: S. Yamada (UCI), F. Cei (Pisa);  SVN repository: S. Yamada;  Event generation:F. Cei, S. Yamada, Y. Hisamatsu (Tokyo);  LXe: S. Yamada, F. Cei, G. Signorelli (Pisa);  TICP/TICZ: P. Cattaneo, Y. Uchiyama (Tokyo);  DCH: H. Nishiguchi (Tokyo), M. Hillebrandt (PSI);  Beam & Magnet: W. Ootani (Tokyo);  Target: V. Tumakov (UCI);  NaI: Y. Nishimura (Tokyo);  Calibrations: F. Cei