open access portal Mihaela Gheata ALICE offline week 19 Nov 2014.

Slides:



Advertisements
Similar presentations
Usage of the memoQ web service API by LSP – a case study
Advertisements

XHTML Presenters : Jarkko Lunnas Sakari Laaksonen.
Data Grids: Globus vs SRB. Maturity SRB  Older code base  Widely accepted across multiple communities  Core components are tightly integrated Globus.
ALICE Operations short summary LHCC Referees meeting June 12, 2012.
Students: Ilya Paskhover, Itay Gal Supervisors: Oleg Rokhlenko, Nadav Golbandi.
Web Portal Presentation Some pics to be added.....
CMS Migration to SiteManager Division of Construction Management.
5 November 2001F Harris GridPP Edinburgh 1 WP8 status for validating Testbed1 and middleware F Harris(LHCb/Oxford)
David Adams ATLAS ATLAS Distributed Analysis David Adams BNL March 18, 2004 ATLAS Software Workshop Grid session.
Microsoft SharePoint Server 2010 for the Microsoft ASP.NET Developer Yaroslav Pentsarskyy
MXI Confidential Copyright Material February 11, SAS Clinical Standards Toolkit 2.1 Tutorial Sy Truong, President of MXI.
Shaping the practice and measuring the impact of Open Science Gentner Day 2014 Patricia Herterich Humboldt-Universität zu Berlin & CERN.
ATLAS and GridPP GridPP Collaboration Meeting, Edinburgh, 5 th November 2001 RWL Jones, Lancaster University.
Databases E. Leonardi, P. Valente. Conditions DB Conditions=Dynamic parameters non-event time-varying Conditions database (CondDB) General definition:
ALICE, ATLAS, CMS & LHCb joint workshop on
WebSphere Portal Technical Conference U.S Creating Rich Internet (AJAX) Applications with WebSphere Portlet Factory.
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
Predrag Buncic (CERN/PH-SFT) WP9 - Workshop Summary
LCG Generator Meeting, December 11 th 2003 Introduction to the LCG Generator Monthly Meeting.
Overview of DAQ at CERN experiments E.Radicioni, INFN MICE Daq and Controls Workshop.
David Adams ATLAS DIAL/ADA JDL and catalogs David Adams BNL December 4, 2003 ATLAS software workshop Production session CERN.
PWG3 Analysis: status, experience, requests Andrea Dainese on behalf of PWG3 ALICE Offline Week, CERN, Andrea Dainese 1.
Andrei Gheata, Mihaela Gheata, Andreas Morsch ALICE offline week, 5-9 July 2010.
Analysis trains – Status & experience from operation Mihaela Gheata.
ATLAS is a general-purpose particle physics experiment which will study topics including the origin of mass, the processes that allowed an excess of matter.
IPPOG Steering Committee Meeting [Nov 2013] - 1 IT Vidyo Service Developments Vidyo Unified Client (integrated chat support) –Last beta build received.
ALICE analysis framework References for Analysis Tools used to the ALICE simulated data.
- Early Adopters (09mar00) May 2000 Prototype Framework Early Adopters Craig E. Tull HCG/NERSC/LBNL ATLAS Arch CERN March 9, 2000.
6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.
GLite build and integration system Building and Packaging Robert HARAKALY
2012 Objectives for CernVM. PH/SFT Technical Group Meeting CernVM/Subprojects The R&D phase of the project has finished and we continue to work as part.
SAM Sensors & Tests Judit Novak CERN IT/GD SAM Review I. 21. May 2007, CERN.
Testing and integrating the WLCG/EGEE middleware in the LHC computing Simone Campana, Alessandro Di Girolamo, Elisa Lanciotti, Nicolò Magini, Patricia.
Doug Benjamin Duke University. 2 ESD/AOD, D 1 PD, D 2 PD - POOL based D 3 PD - flat ntuple Contents defined by physics group(s) - made in official production.
K. Harrison CERN, 22nd September 2004 GANGA: ADA USER INTERFACE - Ganga release status - Job-Options Editor - Python support for AJDL - Job Builder - Python.
Agenda: Overview of Agile testing Difference between Agile and traditional Methodology Agile Development Methodologies Extreme Programming Test Driven.
ATLAS-specific functionality in Ganga - Requirements for distributed analysis - ATLAS considerations - DIAL submission from Ganga - Graphical interfaces.
A. Gheata, ALICE offline week March 09 Status of the analysis framework.
Gustavo Conesa ALICE offline week Gamma and Jet correlations analysis framework Short description, Status, HOW TO use and TO DO list 1/9.
1 Offline Week, October 28 th 2009 PWG3-Muon: Analysis Status From ESD to AOD:  inclusion of MC branch in the AOD  standard AOD creation for PDC09 files.
TAGS in the Analysis Model Jack Cranshaw, Argonne National Lab September 10, 2009.
The MEG Offline Project General Architecture Offline Organization Responsibilities Milestones PSI 2/7/2004Corrado Gatto INFN.
PWG3 analysis (barrel)
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
ATLAS Distributed Analysis Dietrich Liko IT/GD. Overview  Some problems trying to analyze Rome data on the grid Basics Metadata Data  Activities AMI.
Analysis train M.Gheata ALICE offline week, 17 March '09.
M. Gheata ALICE offline week, 24 June  A new analysis train macro was designed for production  /ANALYSIS/macros/AnalysisTrainNew.C /ANALYSIS/macros/AnalysisTrainNew.C.
ATLAS Data preservation April 2015 Roger Jones for the ATLAS Collaboration.
David Adams ATLAS ATLAS Distributed Analysis and proposal for ATLAS-LHCb system David Adams BNL March 22, 2004 ATLAS-LHCb-GANGA Meeting.
36 th LHCb Software Week Pere Mato/CERN.  Provide a complete, portable and easy to configure user environment for developing and running LHC data analysis.
The Grid Storage System Deployment Working Group 6 th February 2007 Flavia Donno IT/GD, CERN.
Analysis efficiency Andrei Gheata ALICE offline week 03 October 2012.
Analysis framework plans A.Gheata Offline week 13 July 2011.
ATLAS Physics Analysis Framework James R. Catmore Lancaster University.
SAM architecture EGEE 07 Service Availability Monitor for the LHC experiments Simone Campana, Alessandro Di Girolamo, Nicolò Magini, Patricia Mendez Lorenzo,
CERN IT Department CH-1211 Genève 23 Switzerland t Load testing & benchmarks on Oracle RAC Romain Basset – IT PSS DP.
ANALYSIS TRAIN ON THE GRID Mihaela Gheata. AOD production train ◦ AOD production will be organized in a ‘train’ of tasks ◦ To maximize efficiency of full.
Jacek Otwinowski (Data Preparation Group)
Updatecenter Module 3 Application Server SE/EE 8.1 Installation
Analysis trains – Status & experience from operation
Developments of the PWG3 muon analysis code
Updatecenter Snjezana Sevo-Zenzerovic
Status of the Analysis Task Force
Status of the CERN Analysis Facility
ALICE analysis preservation
Patricia Méndez Lorenzo ALICE Offline Week CERN, 13th July 2007
Savannah to Jira Migration
Data Federation with Xrootd Wei Yang US ATLAS Computing Facility meeting Southern Methodist University, Oct 11-12, 2011.
Analysis framework - status
GLOBAL BIODIVERSITY INFORMATION FACILITY
Presentation transcript:

open access portal Mihaela Gheata ALICE offline week 19 Nov 2014

Open Access General principles of Open Access Provide open access to scientific data, including software and documentation Reproduce any analysis any time in the future by anybody Current implementation at CERN OpenAccess web portal hosting data and applications by experiments Coherent style and organisation for all experiments Possibility to host and make public data releases according each experiment policy Only CMS releases some ~10 Tbytes of data so far Target audience: mainly education Interested citizen, students of physics

CernVM market ALICE open access Documentation VM installation guide ALICE analysis modules … ALICE datasets … opendata.cern.ch CLIENT Execute analysis ATLA S ALICE CMS LHCb Provide a custom VM running masterclass examples Upgrade in future by adding simple analysis examples –Currently the Pt analysis tutorial

opendata.cern.ch Under construction ALICE + CMS started the exercise, the others came after Available already: ALICE: CernVM installation guide + ALICE context, running a GUI where different analysis can be selected Strangeness + RAA masterclasses (including event display) Pt analysis task to demonstrate how to use analysis framework CMS: Masterclasses, visualisation tools and data (2010) CernVM with example code for Z decays to two leptons and ZZ decays to 4 leptons iSpy: a browser-based event display for CMS LHCb & ATLAS: Their masterclass setups Corresponding derived datasets used by masterclasses

Data available via portal Stored on public IT xrootd server ALICE: 2 primary datasets, 1 for pp, and 1 for PbPb, ESD files from run (LHC10h pass2) 2 ESD files from run (LHC10b pass3) Used just to be able to run the inclusive Pt demonstrating the framework 1 VSD derived dataset used for RAA masterclass (10 files) CMS: 14 primary datasets from 2010 Few TBytes each, many triggers 27 derived datasets used by their event display ATLAS & LHCb: Derived datasets needed for masterclasses No MC for any experiment

Metadata for datasets We were asked to provide a metadata representation for the published datasets Containing global and per file information The existing AliEn xml datasets not appropriate since the file catalog not exposed Preferred format: JSON The same format is usable directly by the application embedded in the ALICE VM Embedded JSON parser Providing access to the open access xrootd storage holding the public data

JSON metadata " Dataset": { "name": "LHC2010h_PbPb_ESD_138275", "description": "Pb-Pb ESD data sample at 3.5 TeV", "path": "/eos/opendata/alice/2010/LHC10h/ /ESD", "files": 3, "file_details": [ { "file_path": "/eos/opendata/alice/2010/LHC10h/ /ESD/0000/AliESDs.root", "file_size": , "file_checksum": "41b466d6eb9bbe978ac70bb96c733ae7", "file_timestamp": " :32:31" }, { "file_path": "/eos/opendata/alice/2010/LHC10h/ /ESD/0001/AliESDs.root", "file_size": , "file_checksum": "1548a2f4ffab8015c04f378ece2c9442", "file_timestamp": " :32:35" }, { "file_path": "/eos/opendata/alice/2010/LHC10h/ /ESD/0002/AliESDs.root", "file_size": , "file_checksum": "c0a463c41b3629b2eff e93", "file_timestamp": " :32:38" } ]

Portal organisation

Have a look! The style is common, but suggestions on the content are welcome

Plans Portal will be advertised to public soon Still few issues on format and content to be fixed until the alpha release ALICE: waiting for the PB decision for adding few more datasets Few runs for pp and PbPb 2010 Will allow running more complex examples Gradually adding more analysis modules Preferably reproducing published results Without need of OCDB/AliEn Preferably AOD data