European Organization for Nuclear Research Organisation Européenne pour la Recherche Nucléaire High-Energy Physics Data Delivering Data in Science ICSTI.

Slides:



Advertisements
Similar presentations
1 AMY Detector (eighties) A rather compact detector.
Advertisements

Computing for LHC Dr. Wolfgang von Rüden, CERN, Geneva ISEF students visit CERN, 28 th June - 1 st July 2009.
26/07/2002C.Palomares / ICHEP02 Search for  b in two-photon collisions with L3 Detector at LEP Carmen Palomares CERN On behalf of L3 Collaboration.
Jos Engelen CERN HEP and its data What is the problem? A possible way forward Permanent Access to the Records of Science Brussels - November 15 th 2007.
Oliver Gutsche - CMS / Fermilab Analyzing Millions of Gigabyte of LHC Data for CMS - Discover the Higgs on OSG.
Jet and Jet Shapes in CMS
The LHC Computing Grid – February 2008 The Worldwide LHC Computing Grid Dr Ian Bird LCG Project Leader 15 th April 2009 Visit of Spanish Royal Academy.
Peter Loch University of Arizona Tucson, Arizona USA
DATA PRESERVATION IN ALICE FEDERICO CARMINATI. MOTIVATION ALICE is a 150 M CHF investment by a large scientific community The ALICE data is unique and.
Regional Computing Centre for Particle Physics Institute of Physics AS CR (FZU) TIER2 of LCG (LHC Computing Grid) 1M. Lokajicek Dell Presentation.
CERN/IT/DB Multi-PB Distributed Databases Jamie Shiers IT Division, DB Group, CERN, Geneva, Switzerland February 2001.
LHC’s Second Run Hyunseok Lee 1. 2 ■ Discovery of the Higgs particle.
1. 2 CERN European Organization for Nuclear Research Founded in 1954 by 12 countries – Norway one of them Today: 20 member states, around 2500 staff –
Tev4LHC Workshop, QCD, Emily Nurse, UCL for the CEDAR collaboration (Andy Buckley, Jon Butterworth, James Monk, Ben Waugh, Mike Whalley,
European Organization for Nuclear Research Organisation Européenne pour la Recherche Nucléaire CDS Invenio CERN’s open source digital library information.
CERN – IT Department CH-1211 Genève 23 Switzerland t CERN Open Source Collaborative tools: Digital Library Software Tim Smith CERN/IT.
1 Chasing the Higgs boson with a worldwide distributed trigger system Sander Klous NIKHEF VENI proposal 2006.
Advanced Computing Services for Research Organisations Bob Jones Head of openlab IT dept CERN This document produced by Members of the Helix Nebula consortium.
Chinorat Kobdaj SPC May  What is heavy ion physics?  What is ALICE?
European Organization for Nuclear Research Organisation Européenne pour la Recherche Nucléaire Digital Library and Conferencing update HEPiX at Cornell.
LARGE HADRON COLLIDER Cooperation between the Russian Federation and the European Union : LARGE HADRON COLLIDER Anastasia Andrianova Ilia Dorchanov Department.
Physics Steven Gottlieb, NCSA/Indiana University Lattice QCD: focus on one area I understand well. A central aim of calculations using lattice QCD is to.
1 Kittikul Kovitanggoon*, Burin Asavapibhop, Narumon Suwonjandee, Gurpreet Singh Chulalongkorn University, Thailand July 23, 2015 Workshop on e-Science.
Jet Studies at CMS and ATLAS 1 Konstantinos Kousouris Fermilab Moriond QCD and High Energy Interactions Wednesday, 18 March 2009 (on behalf of the CMS.
Finnish DataGrid meeting, CSC, Otaniemi, V. Karimäki (HIP) DataGrid meeting, CSC V. Karimäki (HIP) V. Karimäki (HIP) Otaniemi, 28 August, 2000.
Shaping the practice and measuring the impact of Open Science Gentner Day 2014 Patricia Herterich Humboldt-Universität zu Berlin & CERN.
ALICE Upgrade for Run3: Computing HL-LHC Trigger, Online and Offline Computing Working Group Topical Workshop Sep 5 th 2014.
R. Cherkaoui March 2010 EU-MED 3 Brussels High-performance networking in the context of the ATLAS particle physics experiment Prof. Rajaa Cherkaoui.
Data Preservation in High Energy Physics Towards a Global Effort for Sustainable Long-Term Data Preservation in HEP
EGEE is a project funded by the European Union under contract IST HEP Use Cases for Grid Computing J. A. Templon Undecided (NIKHEF) Grid Tutorial,
Prompt J/  and b ➝ J/  X production in pp collisions at LHCb Patrick Robbe, LAL Orsay & CERN, 7 Dec 2010 For the LHCb Collaboration KRUGER 2010 Workshop.
HERA-LHC, CERN Oct Preliminary study of Z+b in ATLAS /1 A preliminary study of Z+b production in ATLAS The D0 measurement of  (Z+b)/  (Z+jet)
Indexing and Selection of Data Items Using Tag Collections Sebastien Ponce CERN – LHCb Experiment EPFL – Computer Science Dpt Pere Mato Vila CERN – LHCb.
The LHCb CERN R. Graciani (U. de Barcelona, Spain) for the LHCb Collaboration International ICFA Workshop on Digital Divide Mexico City, October.
Les Les Robertson LCG Project Leader High Energy Physics using a worldwide computing grid Torino December 2005.
CERN – IT Department CH-1211 Genève 23 Switzerland t Working with Large Data Sets Tim Smith CERN/IT Open Access and Research Data Session.
WLCG and the India-CERN Collaboration David Collados CERN - Information technology 27 February 2014.
FSU Experimental HEP Faculty Todd Adams Susan Blessing Harvey Goldman S Sharon Hagopian Vasken Hagopian Kurtis Johnson Harrison Prosper Horst Wahl.
Top quark IIHE Future interests  Towards data taking → new software  Have a broader physics output  Link theory-experiment  Calibration and.
Predrag Buncic Future IT challenges for ALICE Technical Workshop November 6, 2015.
CERN – IT Department CH-1211 Genève 23 Switzerland t Data Publishing Tim Smith CERN/IT.
Computing for LHC Physics 7th March 2014 International Women's Day - CERN- GOOGLE Networking Event Maria Alandes Pradillo CERN IT Department.
LHC Computing, CERN, & Federated Identities
Computing Issues for the ATLAS SWT2. What is SWT2? SWT2 is the U.S. ATLAS Southwestern Tier 2 Consortium UTA is lead institution, along with University.
tons, 150 million sensors generating data 40 millions times per second producing 1 petabyte per second The ATLAS experiment.
Ian Bird Overview Board; CERN, 8 th March 2013 March 6, 2013
LHCbComputing Computing for the LHCb Upgrade. 2 LHCb Upgrade: goal and timescale m LHCb upgrade will be operational after LS2 (~2020) m Increase significantly.
1 A collision in the CMS detector Particle trajectories are reconstructed with precision of few microns (1 μ = m)
International Collaboration for Data Preservation and Long Term Analysis in High Energy Physics RECODE - Final Workshop - January.
Dr Tim Smith CERN/IT For the visit of the Alliance of German Science Organizations.
Search for a Standard Model Higgs Boson in the Diphoton Final State at the CDF Detector Karen Bland [ ] Department of Physics,
Big Data for Big Discoveries How the LHC looks for Needles by Burning Haystacks Alberto Di Meglio CERN openlab Head DOI: /zenodo.45449, CC-BY-SA,
Joint Institute for Nuclear Research Synthesis of the simulation and monitoring processes for the data storage and big data processing development in physical.
The ATLAS detector … … is composed of cylindrical layers: Tracking detector: Pixel, SCT, TRT (Solenoid magnetic field) Calorimeter: Liquid Argon, Tile.
1 Particle Physics Data Grid (PPDG) project Les Cottrell – SLAC Presented at the NGI workshop, Berkeley, 7/21/99.
Grid technologies for large-scale projects N. S. Astakhov, A. S. Baginyan, S. D. Belov, A. G. Dolbilov, A. O. Golunov, I. N. Gorbunov, N. I. Gromova, I.
LEP DATA PRESERVATION 11 years of data taking 4 Experiments Large Luminosity ~1200 Scientific Papers ALEPH Raw data 5 Terabytes DST 800 Gigabytes Mini.
Introducing High Energy Physics Computing to the Secondary Classroom
Ian Bird WLCG Workshop San Francisco, 8th October 2016
Grid site as a tool for data processing and data analysis
The LHC Computing Grid Visit of Mtro. Enrique Agüera Ibañez
Philippe Charpentier CERN – LHCb On behalf of the LHCb Computing Group
Dagmar Adamova (NPI AS CR Prague/Rez) and Maarten Litmaath (CERN)
Opening Big Data; in small and large chunks
Vision for CERN IT Department
Plans for checking hadronic energy
Katarzyna Kowalik (LBNL) For the STAR Collaboration
The ATLAS Experiment at the LHC
The LHC Computing Grid Visit of Professor Andreas Demetriou
BES III Software: Short-term Plan ( )
Presentation transcript:

European Organization for Nuclear Research Organisation Européenne pour la Recherche Nucléaire High-Energy Physics Data Delivering Data in Science ICSTI Winter Workshop Tim Smith – CERN/IT Department

Tim ICSTI Workshop, Mar 2012 Delivering Data in HEP Data Storage and Stewardship Distribution and Access Interpretability, Reusability and Citability

Tim ICSTI Workshop, Mar 2012 LHC and the Data Deluge 150 million sensors 40 million times /sec 22 PB in 2012

Tim ICSTI Workshop, Mar Just a Drop in the Ocean! …Selection Particle Protons/bunch10 11 Crossing rate40 Million /sec Collision rate1 Billion /sec Parton (quark, gluon) Proton Bunch Filter to 200 /sec

Tim ICSTI Workshop, Mar 2012 Data Storage 6 GB/s

Tim ICSTI Workshop, Mar 2012 Data Stewardship: Migration LHC era 60 PB LEP era 100 TB

Tim ICSTI Workshop, Mar 2012 Data Distribution & Access 11 T1 140 T2 T3s Worldwide LHC Computing Grid

Tim ICSTI Workshop, Mar 2012 Data Access Publication data Derived physics data Analysis Object Data Reconstructed Data Raw Data / Simulated Data 70 PB Worldwide x N x tens x few 22 PB T0 T1 T2 T3

Tim ICSTI Workshop, Mar 2012 Data Access ≠ Data Usability

Tim ICSTI Workshop, Mar 2012 Data Reuse: Raw/Processed Data Reuse of the Reconstructed & Analysis Object Data –Calibrations, Configurations –Conditions DBs: tens of TBs –Reconstruction and identification algorithms –Detector response parameterizations –Software: millions of lines-of-code

Tim ICSTI Workshop, Mar 2012 Data Reuse: Publication Data Published observables –Model-independent measurements –Distributions and cross-sections –HEPData: tabular –DOIs Rivet routines –Parameterize analysis acceptance –Compare simulated & measured data –

Tim ICSTI Workshop, Mar 2012 Data Reuse: Derived Physics Data Access, ability to reinterpret –Reanalysis with new QCD calculations –Combination with data from future colliders –…serendipitous discovery Pitfalls: Large investment of effort required –Correlations, efficiencies, systematic uncertainties –Backgrounds estimated from data driven techniques Intertwined with event selection criteria Searches…

Tim ICSTI Workshop, Mar 2012 Data Reuse: Derived Physics Data RECAST –Limits of an existing search for an alternative hypothesis –Brokering service –Collaboration Archives the analysis code Provides authority Digital Preservation in HEP –

Tim ICSTI Workshop, Mar 2012 WLCG Delivering HEP data to scientists around the world

Tim ICSTI Workshop, Mar 2012 Questions ?

Tim ICSTI Workshop, Mar 2012 Abstract Particle accelerators such as the LHC generate an ever increasing flow of high-energy physics data. Each year the LHC experiments record large data sets which dwarf those of previous years. Moreover, with analysis teams around the globe, this data must be distributed worldwide for processing, reduction and near-time analysis. The challenges of managing and distributing this data deluge have been addressed by successive eInfrastructure projects over the years which have created and refined the Worldwide LHC Computing Grid. Tim will describe the way CERN data is stored and shared within the community, and touch on the challenges of expanding this outside for universal access and reuse.