1. ACAT 2010 Axel Naumann

2. What? International Workshop …on Advanced Computing …and Analysis Techniques …in Physics Research "Beyond the Cutting edge in Computing" February 22-27 Jaipur, India, at University of Rajasthan 2010-03-19Axel Naumann - SFT2

3. Content 1.Computing Technology for Physics Research 2.Data Analysis - Algorithms and Tools 3.Methodology of Computations in Theoretical Physics And "hot topics", this time: multicore data management 50% plenary, 50% parallel, 2 hot topic panels 2010-03-193Axel Naumann - SFT

4. Location Incredible India 2010-03-194Axel Naumann - SFT

5. Location Incredible People 2010-03-195Axel Naumann - SFT

6. Location 2010-03-19Axel Naumann - SFT6 New Delhi Jaipur

7. Participants About 80 participants Far away: really interested participants Few new people: family But big family, e.g. – CERN, e.g. all main LHC experiments (LHCb?) – Fermilab, BNL, SLAC,… – KEK (Belle II); of course India SFT: Rene, Fons, Gerri, Matevz, Axel 2010-03-19Axel Naumann - SFT7

8. SFT (related) Plenaries Rene: "History of the ROOT System: Conception, Evolution and Experience" Matevz's lecture "Simulation and Visualisation Techniques" 2010-03-19Axel Naumann - SFT8

9. Rene's Plenary Status of ROOT in 2010; future Historical background of alternatives, technological and sociological decisions "Lifetime achievement award" 2010-03-19Axel Naumann - SFT9

10. COMPUTING TECHNOLOGY FOR PHYSICS RESEARCH Languages, Software quality, IDE and User Interfaces Distributed and Parallel Computing New architectures, many and multi-cores Virtualization Online Monitoring and Control 2010-03-1910Axel Naumann - SFT

11. SFT Contributions Fons: PROOF - Best Practices Always fighting bottlenecks – file layout: much improved – merge: multiple mergers – RAM – CPUs: PROOF lite – disks, network: comparing storage solutions Feeding 24 cores not trivial Axel: checking coding rules with LLVM's clang 2010-03-1911Axel Naumann - SFT

12. Clouds From theory to practice to integration – Use cases still investigated – How to justify local batch vs. paying cloud Why Clouds == outsourcing? – Burst resource on peak demands? – Opportunistic resources truly at reach? Understand virtualization. Still open: – is it needed? do we want it? – is it transparent enough for end-users? – integrity, reproducibility? – image management, networking? 2010-03-1912Axel Naumann - SFT

13. GridLite Usability Management Fights are over, reality arrived 1/3 of jobs lost: inherent property of the grid? Mattia Cinquilli 2010-03-1913Axel Naumann - SFT

14. Multi- & Other-Cores x86_64 understood, optimizing An occasion to optimize / re-think our code Finally again competition across chips designs / architectures! What will be the surviving architecture? – Lots of dynamic … 2010-03-1914Axel Naumann - SFT

15. Tools & Languages Many tools, only some mastered. Do we need new non-expert tools? – New compilers for parallelization – New tools for detecting language constructs / best practice / code analysis – Library / extension helping novice to develop parallel applications (OpenCL) Languages vs. optimizations / architectures: do we sell our souls? Standards! C++ 0x not a topic yet, unlike 64bit CPUs when they came out, Larrabee,… 2010-03-1915Axel Naumann - SFT

16. Data Equilibrium money - CPU - I/O: alchemy CPU focus swinging to I/O: did we overestimate relevance of CPU (interpreter in event loop)? Cache hierarchy: tape, disks, SSDs, RAM – All of the above? – Throw a WAN in? – Need algorithms for data lifetime across tiers Latency vs. cooperation / concurrency, theory! 24 core (“wow!”) but no data coming through! 2010-03-1916Axel Naumann - SFT

17. DATA ANALYSIS – ALGORITHMS, TOOLS Machine Learning Advanced Data Analysis Environments Simulation, Reconstruction and Visualisation Techniques Advanced Computing 2010-03-1917Axel Naumann - SFT

18. Data Analysis – Algorithms, Tools Patterns 2010-03-19Axel Naumann - SFT18

19. Data Analysis – Algorithms, Tools Parallelization of reco algos Still exploring new algos for data analysis Evolutionary algos * quantim computing Code generators for data analysis Lots of ROOT; special presentations on TMVA, RooStats 2010-03-19Axel Naumann - SFT19

20. COMPUTATIONS IN THEORETICAL PHYSICS: TECHNIQUES AND METHODS Automatic Systems Higher orders Computer Algebra Techniques and Applications 2010-03-1920Axel Naumann - SFT

21. Methodology of Computations in Theoretical Physics Recursion 2010-03-19Axel Naumann - SFT21

22. Methodology of Computations in Theoretical Physics Very good plenary by Daniel Maître: "Automation of multi-leg one-loop virtual amplitudes" Fortran rules Mixing analytical and numerical approaches Numerical instabilities (>= quad precision) 2010-03-19Axel Naumann - SFT22

23. Conclusion Real workshop atmosphere Very productive discussions resulting in real projects! Small is beautiful (but not sufficient) Everybody took something back 2010-03-1923Axel Naumann - SFT

24. References (Almost) all presentations in Indico: http://indico.cern.ch/conferenceOtherViews.py?confId=59397#all 2010-03-19Axel Naumann - SFT24