Data Preparation Group Summary of the Activities C. Zampolli 7 June 2016

DPG Organization 07/06/16 C. Zampolli - 07 June 2016

Analysis Objects and Tools DPG Structure DPG Coordination PROC Processing QAT QA and Tools AOT Analysis Objects and Tools 07/06/16 C. Zampolli - 07 June 2016

DPG Structure DPG Coordination PROC QAT AOT Data Monte Carlo Processing QAT QA and Tools AOT Analysis Objects and Tools Data preparation and follow-up Monte Carlo preparation and follow-up Processing execution 07/06/16 C. Zampolli - 07 June 2016

DPG Structure DPG Coordination QAT AOT Data Monte Carlo QA and Tools AOT Analysis Objects and Tools preparation and follow-up Data Monte Carlo preparation and follow-up Processing execution Quality Assurance planning and execution Tools for Quality Assurance and validation PROC Processing 07/06/16 C. Zampolli - 07 June 2016

DPG Structure DPG Coordination AOT Quality Assurance Tools Data Analysis Objects and Tools Quality Assurance planning and execution for Quality Assurance and validation Tools preparation and follow-up Data Monte Carlo preparation and follow-up Processing execution AOD definition and maintenance Event properties Global Tracks properties PROC Processing QAT QA and Tools 07/06/16 C. Zampolli - 07 June 2016

DPG Structure DPG Coordination Quality Assurance Monte Carlo planning and execution for Quality Assurance and validation Tools preparation and follow-up Data definition and maintenance AOD Global Tracks properties Monte Carlo preparation and follow-up Processing execution Event properties PROC Processing QAT QA and Tools AOT Analysis Objects and Tools 07/06/16 C. Zampolli - 07 June 2016

DPG People DPG Coordination PROC QAT AOT Processing QA and Tools Chiara Zampolli PROC Processing Roberto Preghenella Catalin-Lucian Ristea (*) Chiara Zampolli QAT QA and Tools Marie Germain Jacek Otwinowski (*) AOT Analysis Objects and Tools Catalin-Lucian Ristea (*), Constantin Loizides Andrea Dainese, Andrea Rossi (*) detectors PWGs detectors detectors PWGs (*) Institutional responsibilities Collaboration with members of old PWGPP (event selection, track selection, centrality) 07/06/16 C. Zampolli - 07 June 2016

DPG organization 2 Coordination weekly meetings, 1h long Wednesday, 13-14, dedicated to productions, to prepare for PB on Thu Friday, 13-14, general coordination meeting, to discuss DPG activities, and prepare for CB on Mon Dedicated coordination meetings to focus on specific topics organized ad-hoc General meeting during Mini-Weeks Tuesday morning (overlapping with PWG-DQ though) Agenda will include: Presentation(s) of DPG activities Topical talks Input from detectors, PWGs, … PWGPP-calibration meeting still used to discuss production-related technical issues DPG has one contact per detector (same as for Computing Board) and per PWG, plus external contacts (HLT, BTG, RC…) 07/06/16 C. Zampolli - 07 June 2016

DPG activities …in addition to continuous data production, Monte Carlo production, and QA activities… 07/06/16 C. Zampolli - 07 June 2016

Repository AliDPG repository created: https://github.com/alisw/AliDPG AOD MC QA bin Macros/scripts to process data to be added 07/06/16 C. Zampolli - 07 June 2016

Thanks to Giulio and Dario Repository AliDPG repository created: https://github.com/alisw/AliDPG Tagging strategy: Tagging for main AliRoot/AliPhysics version: E.g.: AliDPG-05-07-XX should work for all the AliPhysics/AliRoot oftype v5-07 Needs discussion within Offline AliRoot/AliPhysics tags need more stability for data production Release validation helps, but many pieces change and may interfere with data production Thanks to Giulio and Dario 07/06/16 C. Zampolli - 07 June 2016

Monte Carlo Simulations Setting up of Monte Carlo simulations in a new fashion: One steering script (dpgsim.sh) can trigger several options: OCDB snapshot creation  also for MC Simulation Reconstruction QA AOD production All the above dpgsim.sh takes as input the mode (above), generator (9 predefined + custom possible), run, energy, system, detector configuration (default or custom), B field, simulation config, reconstruction config, number of events, QA config, AOD config, UID (for seeding), bmin, bmax, … Detector configuration separated from generator configuration Custom configuration defined in separate files Roberto, Catalin 07/06/16 C. Zampolli - 07 June 2016

Monte Carlo Simulations Setting up of Monte Carlo simulations in a new fashion: One steering script (dpgsim.sh) can trigger several options: OCDB snapshot creation  also for MC Simulation Reconstruction QA AOD production All the above dpgsim.sh takes as input the mode (above), generator (9 predefined + custom possible), run, energy, system, detector configuration (default or custom), B field, simulation config, reconstruction config, number of events, QA config, AOD config, UID (for seeding), bmin, bmax, … Detector configuration separated from generator configuration Custom configuration defined in separate files Roberto, Catalin LHC16e3: first official production with AliDPG: many thanks to Costin! 07/06/16 C. Zampolli - 07 June 2016

DPG interface/database Brainstorming started on the “DPG interface” The goal is to have a tool that allows people (all ALICE users) to easily retrieve the information about the data produced and available in ALICE It will be, as first layer, an interface to several databases MonALISA, functional tests, QA… Should allow people to Relate datasets Retrieve run lists for specific analysis Verify usage of datasets Check the quality of a dataset As a whole, or in terms of single runs … The requirements are being defined, the implementation will come next Very demanding task! 07/06/16 C. Zampolli - 07 June 2016

QA tools Better interface to QA, more functionalities One single entry point for QA Correlations Comparisons Trending Visualization Easy/fast retrieval of information/data Scalability Exploration of what is on the market ElasticSearch + Kibana Jihyun Jacek Dynamicity 07/06/16 C. Zampolli - 07 June 2016

QA scheduling QA activities very demanding Marie Many productions (data, MC, reprocessing) always ongoing Might have different processing life and timings (e.g.: feedback on data might be crucial for data taking) Typically one person per detector assigned to all QA activities for that detector Effort to re-think the QA organization aiming at: More involvement of ALICE collaboration Faster feedback But: better to have good (or reliable) data slowly, than bad (or unreliable) data fast Requires: Robust and easy QA interfaces and tools, more automatization Could affect time scheduling, reshuffling of QA-ed systems For now, trying to improve what we have with as little changes as possible Changes in scheduling Active feedback from QA experts required More automatization Easier feedback mechanism (digest, table) Marie More discussions within the QA group Thanks to Costin for the technical support! 07/06/16 C. Zampolli - 07 June 2016

Physics Selection Recent changes in the Physics Selection to work also with AOD New cuts introduced for pp data Detailed presentation by Evgeny at the next Physics Forum Evgeny Constantin 07/06/16 C. Zampolli - 07 June 2016

Summary and conclusions The structure of the DPG is now defined Many activities are being followed, avoiding any rupture with PWGPP, and any hic-ups in the data and Monte Carlo processing flow Tools for ALICE users are being discussed and implemented, the challenge is in coupling simplicity (use) with complexity (content) If you want to reach us: alice-dpg-coordination@cern.ch alice-dpg-general@cern.ch alice-dpg-qa@cern.ch alice-dpg-aot-event-props@cern.ch alice-dpg-external-contacts@cern.ch alice-dpg-pwg-contacts@cern.ch 07/06/16 C. Zampolli - 07 June 2016