use of the CernVM and CVMFS

Slides:



Advertisements
Similar presentations
Harnessing GridPP for student-driven research T. Whyntie*, † *Langton Star Centre, †PPRC - Queen Mary, University of London GridPP30, University.
Advertisements

1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
Technology on the NGS Pete Oliver NGS Operations Manager.
S/W meeting 18 October 2007RSD 1 Remote Software Deployment Nick West.
DataGrid Kimmo Soikkeli Ilkka Sormunen. What is DataGrid? DataGrid is a project that aims to enable access to geographically distributed computing power.
Knowledge Transfer | Accelerating Innovation G. Anelli, Giovanni Anelli Knowledge Transfer Group Leader CERN.
1 Bridging Clouds with CernVM: ATLAS/PanDA example Wenjing Wu
14 July 2004GridPP Collaboration BoardSlide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
QCDgrid Technology James Perry, George Beckett, Lorna Smith EPCC, The University Of Edinburgh.
GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.
The Grid Prof Steve Lloyd Queen Mary, University of London.
A long tradition. e-science, Data Centres, and the Virtual Observatory why is e-science important ? what is the structure of the VO ? what then must we.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks C. Loomis (CNRS/LAL) M.-E. Bégin (SixSq.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Cern.ch/knowledgetransfer. Knowledge Transfer | Accelerating Innovation HEPTech Workshop on Technology Licensing CERN Knowledge Transfer Group: MEDIPIX.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
NETWORK ADMINISTRATOR. EXAMPLES OF SOME COMPUTING RELATED CAREERS Multimedia Artist / Graphics Artist Information System Manager Computer Scientist Network.
3 June 2004GridPP10Slide 1 GridPP Dissemination Sarah Pearce Dissemination Officer
What do all these numbers mean?.  Get your computers!
SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
Knowledge Transfer | Accelerating Innovation Turkey – CERN Industry Day, , D. Mazur David Mazur IP Dissemination Section Leader Knowledge Transfer.
Silicon Module Tests The modules are tested in the production labs. HIP is is participating in the rod quality tests at CERN. The plan of HIP CMS is to.
ATLAS is a general-purpose particle physics experiment which will study topics including the origin of mass, the processes that allowed an excess of matter.
Cern.ch/knowledgetransfer. Knowledge Transfer | Accelerating Innovation Giovanni Anelli, CERN KT Training,
Your university or experiment logo here What is it? What is it for? The Grid.
Knowledge Transfer | Accelerating Innovation G. Anelli, CMS CB Networking Event, Giovanni Anelli Head of Knowledge Transfer Group CERN.
AN ORGANISATION FOR A NATIONAL EARTH SCIENCE INFRASTRUCTURE PROGRAM Virtual Geophysics Laboratory (VGL): Scientific workflows Exploiting the Cloud Josh.
Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Tools and techniques for managing virtual machine images Andreas.
Knowledge Transfer | Accelerating Innovation G. Anelli, Giovanni Anelli Knowledge Transfer Group Leader CERN.
The GridPP DIRAC project DIRAC for non-LHC communities.
Prof. Christer Fröjdh Radiation detector research at Mid Sweden University.
1 DMS-DQS-SUPSC03-PRE-12-E © DEIMOS Space S.L., 2007 A Semantic Data Grid for Satellite Mission Quality Analysis Reuben Wright Deimos Space.
Predrag Buncic (CERN/PH-SFT) Software Packaging: Can Virtualization help?
Research organization technology David Groep, October 2007.
The GridPP DIRAC project DIRAC for non-LHC communities.
ETICS An Environment for Distributed Software Development in Aerospace Applications SpaceTransfer09 Hannover Messe, April 2009.
7/8/2016 OAF Jean-Jacques Gras Stephen Jackson Blazej Kolad 1.
@3 rd DPLTA CERN 7 December 2009 by Homer Neal ( ) BaBar Computing rd DPLTA CERN 7 December 2009 by Homer Neal ( )
Scientific Data Processing Portal and Heterogeneous Computing Resources at NRC “Kurchatov Institute” V. Aulov, D. Drizhuk, A. Klimentov, R. Mashinistov,
UK Outreach update Peter Watkins Institute for Research in Schools.
Knowledge Transfer at CERN
Running LHC jobs using Kubernetes
ALICE & Clouds GDB Meeting 15/01/2013
Knowledge Transfer at CERN
Introduction to CERN F. Hahn / CERN PH-DT1 10. May 2007.
Grid site as a tool for data processing and data analysis
Virtualisation for NA49/NA61
Dag Toppe Larsen UiB/CERN CERN,
Progress on NA61/NA49 software virtualisation Dag Toppe Larsen Wrocław
Dag Toppe Larsen UiB/CERN CERN,
Software Development Approaches
The Quest for a Pocket-sized Bubble Chamber
ATLAS Cloud Operations
Supporting particle physics research in schools
Collaboration Meeting
WLCG experiments FedCloud through VAC/VCycle in the EGI
Virtualisation for NA49/NA61
Performance of the Medipix and Timepix devices for the recognition of electron-gamma radiation fields C. Teyssier1,3, J. Bouchami1, F. Dallaire1, J. Idarraga1,
INTRODUCTION TO CERN INDUCTION PROGRAMME
1 - Paul Scherrer Institut, 2 – SpaceIT, 3 - European Space Agency
N. Stoffle University of Houston
CernVM Status Report Predrag Buncic (CERN/PH-SFT).
WLCG Collaboration Workshop;
Open Source Toolkit for Turn-Key AI Cluster (Introduction)
High Energy Physics Computing Coordination in Pakistan
 YongPyong-High Jan We appreciate that you give an opportunity to have this talk. Our Belle II computing group would like to report on.
Deploy Software with Group Policy
Python/TensorFlow Installation
Presentation transcript:

CERN@school’s use of the CernVM and CVMFS Will Furnell The Institute for Research in Schools The University of Kent mail@willfurnell.com 2018-01-31 CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop CERN@school Programme designed to inspire the next generation of scientists and engineers Secondary school students (ages 11-18) carry out their own research projects using Timepix detectors, provided by IRIS http://researchinschools.org/CERN 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop Timepix Detector 256 x 256 pixel hybrid silicon pixel detector Used to detect individual particles of ionising radiation Created by the Medipix Collaboration at CERN (https://medipix.web.cern.ch/) 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop https://tapas.researchinschools.org/view/frame/42731/

Langton Ultimate Cosmic ray Intensity Detector (LUCID) Payload on TechDemoSat-1 (Surrey Satellite Technology) - launched in late 2014, LUCID ended operations in mid 2017. 5 Timepix detectors on board Used to study the radiation environment in Low Earth Orbit Cosmic rays, South Atlantic Anomaly, Coronal Mass Ejections 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop LUCID 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

The Virtual Organisation Very small Only a handful of users Also (relatively) small requirements for storage & compute on GridPP... 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

The Virtual Organisation Very small Only a handful of users Also (relatively) small requirements for storage & compute on GridPP… … but we still need to deploy our own software and submit jobs! Limited or no access to SL6 systems 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop Primarily used to interact with GridPP Job management, data transfer, testing software, uploading to CVMFS Standardised environment - easier to introduce new users Only a small amount of setup and resources needed 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop CVMFS researchinschools.egi.eu We use CVMFS for Python and dependencies Python 3 is provided by Conda (https://conda.io) Mix between software such as NumPy, SciPy, Tensorflow and our own https://github.com/InstituteForResearchInSchools https://github.com/amshenoy/lucid_neural_analysis https://github.com/willfurnell/lucid-grid https://github.com/willfurnell/grid-analysis 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop CVMFS Has made it very easy for us to deploy software Lets us use exactly the same software on the CernVM and GridPP worker nodes Also means users don’t need to install software themselves … however long delay (for us) – not as suited for software in active development 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop CernVM – future use? Linux based platform for students to work on Easy to set up Python programming environment for CERN@school (and other IRIS projects) Customisable image for education CVMFS could be useful for software deployment 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop

mail@wilfurnell.com – CernVM Users Workshop Summary We use the CernVM to interact with GridPP We use CVMFS to deploy our custom Python software and its dependencies Thank you for the excellent software! 2018-01-31 mail@wilfurnell.com – CernVM Users Workshop