A quick introduction to CamGrid University Computing Service Mark Calleja.

Slides:

Advertisements

Similar presentations

NGS computation services: API's,

Advertisements

Condor use in Department of Computing, Imperial College Stephen M c Gough, David McBride London e-Science Centre.

CamGrid Mark Calleja Cambridge eScience Centre. What is it? A number of like minded groups and departments (10), each running their own Condor pool(s),

Current methods for negotiating firewalls for the Condor ® system Bruce Beckles (University of Cambridge Computing Service) Se-Chang Son (University of.

© University of Reading IT Services e-Research workshop Mike Roch, Director of IT Services 17 June 2009.

Ixonos Plc Marko “Narsu” Rintamäki Senior Test Engineer NEST-IX V1.1 Project platform in Test Management.

4/2/2002HEP Globus Testing Request - Jae Yu x Participating in Globus Test-bed Activity for DØGrid UTA HEP group is playing a leading role in establishing.

Overview of Wisconsin Campus Grid Dan Bradley Center for High-Throughput Computing.

McFarm: first attempt to build a practical, large scale distributed HEP computing cluster using Globus technology Anand Balasubramanian Karthik Gopalratnam.

Introduction to CamGrid Mark Calleja Cambridge eScience Centre

John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley

1 CIS450/IMSE450/ECE478 Operating Systems Winter 2003 Professor Jinhua Guo.

Grid Services at NERSC Shreyas Cholia Open Software and Programming Group, NERSC NERSC User Group Meeting September 17, 2007.

Jaeyoung Yoon Computer Sciences Department University of Wisconsin-Madison Virtual Machine Universe in.

Infrastructure Provision for Users at CamGrid Mark Calleja Cambridge eScience Centre

SICSA student induction day, 2009Slide 1 Social Simulation Tutorial Session 6: Introduction to grids and cloud computing International Symposium on Grid.

Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.

Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.

PCGRID ‘08 Workshop, Miami, FL April 18, 2008 Preston Smith Implementing an Industrial-Strength Academic Cyberinfrastructure at Purdue University.

INTRODUCTION TO CLOUD COMPUTING CS 595 LECTURE 2.

PHP With Oracle 11g XE By Shyam Gurram Eastern Illinois University.

Computing and LHCb Raja Nandakumar. The LHCb experiment  Universe is made of matter  Still not clear why  Andrei Sakharov’s theory of cp-violation.

A short introduction to GRID Gabriel Amorós IFIC.

Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.

MaterialsHub - A hub for computational materials science and tools.  MaterialsHub aims to provide an online platform for computational materials science.

| nectar.org.au NECTAR TRAINING Module 10 Beyond the Dashboard.

Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.

CCPR Workshop Introduction to the Cluster March 2, 2005.

Using ICENI to run parameter sweep applications across multiple Grid resources Murtaza Gulamali Stephen McGough, Steven Newhouse, John Darlington London.

Grids, Clouds and the Community. Cloud Technology and the NGS Steve Thorn Edinburgh University Matteo Turilli, Oxford University Presented by David Fergusson.

Condor Birdbath Web Service interface to Condor

Wenjing Wu Computer Center, Institute of High Energy Physics Chinese Academy of Sciences, Beijing BOINC workshop 2013.

DOSAR Workshop, Sao Paulo, Brazil, September 16-17, 2005 LCG Tier 2 and DOSAR Pat Skubic OU.

Grid MP at ISIS Tom Griffin, ISIS Facility. Introduction About ISIS Why Grid MP? About Grid MP Examples The future.

Using Virtual Servers for the CERN Windows infrastructure Emmanuel Ormancey, Alberto Pace CERN, Information Technology Department.

Electronic Portfolios By Lyle Roberts and Alaina Campbell.

SouthGrid SouthGrid SouthGrid is a distributed Tier 2 centre, one of four setup in the UK as part of the GridPP project. SouthGrid.

“Grids and eScience” Mark Hayes Technical Director - Cambridge eScience Centre GEFD Summer School 2003.

The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.

CEOS WGISS-21 CNES GRID related R&D activities Anne JEAN-ANTOINE PICCOLO CEOS WGISS-21 – Budapest – 2006, 8-12 May.

GAAIN Virtual Appliances: Virtual Machine Technology for Scientific Data Analysis Arihant Patawari USC Stevens Neuroimaging and Informatics Institute July.

Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.

Open Science Grid OSG Engagement Strategy and Status ETP Conference Call Oct ; 5:30PM EST Bringing additional non-physicists onto OSG John McGee.

Grid and Cloud Computing Alessandro Usai SWITCH Sergio Maffioletti Grid Computing Competence Centre - UZH/GC3

1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,

John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.

Oxford eScience OxGrid: Virtualisation at Oxford Rhys Newman Manager of Interdisciplinary Grid Development, Oxford University Campus Grid Workshop – Edinburgh.

Purdue RP Highlights TeraGrid Round Table May 20, 2010 Preston Smith Manager - HPC Grid Systems Rosen Center for Advanced Computing Purdue University.

LIGO-G Z1 Using Condor for Large Scale Data Analysis within the LIGO Scientific Collaboration Duncan Brown California Institute of Technology.

EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.

EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Software Licensing in the EGEE Grid infrastructure.

Condor Project Computer Sciences Department University of Wisconsin-Madison Condor Introduction.

Collaborative Tools for the Grid V.N Alexandrov S. Mehmood Hasan.

Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 22 February 2006.

Building on virtualization capabilities for ExTENCI Carol Song and Preston Smith Rosen Center for Advanced Computing Purdue University ExTENCI Kickoff.

Expertsfromindia for Joomla Development. Introduction Joomla is an open source and free content management system (CMS) for publishing content on the.

Outline  XAMPP  XAMPP Install  Put php and HTML documents  Windows and Mac Version  Security.

A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.

1 Support for Scientific Computing People: Bruce Beckles Nick Maclaren Services: Courses Advice.

UCS D OSG School 11 Grids vs Clouds OSG Summer School Comparing Grids to Clouds by Igor Sfiligoi University of California San Diego.

Our New Submit Server. chtc.cs.wisc.edu One thing out of the way... Your science is King! We need rules to facilitate resource sharing. Given good reasons.

DEPARTMENT OF COMPUTER SCIENCE AND ENGINEERING CLOUD COMPUTING

Volunteer Computing for Science Gateways

MaterialsHub - A hub for computational materials science and tools.

Developing Web-Based Applications

University of Wisconsin – Stout

Semiconductor Manufacturing (and other stuff) with Condor

GLOW A Campus Grid within OSG

EGI High-Throughput Compute

Introduction to research computing using Condor

Presentation transcript:

A quick introduction to CamGrid University Computing Service Mark Calleja

CamGrid : a federated collection of computers CamGrid in a nutshell: A few hundred machines, giving ~1,200 cores, spread around the university. Coordinated by the University Computing Service (UCS). Uses the Condor software to weave the machines together. Batch system – i.e. jobs run unattended. All Linux (various distributions), mainly 64 bit. There are currently 13 groups, each of which provide their own “pool”, which is then allowed to cooperate (“flock”) with the other pools.

CamGrid: participating groups Astrophysics Biological Sciences Biological and Soft Systems Cambridge eScience Centre Chemistry Earth Sciences High Energy Physics Materials Science National Institute for Environmental eScience Oncology Plant Sciences Semiconductor Physics University Computing Service

CamGrid: what are the benefits? Currently free at point of use. Ideal for parameter sweeps (i.e. many independent jobs). A couple of users have churned through millions of CPU hours. Great for pump priming research, even student project work. Supports checkpointing (with caveats) for long running jobs. Users need access to only one machine, i.e. a submit host (this is an example of the grid computing paradigm). Job submission is achieved by writing a simple text submit-file (don’t worry: the documentation is comprehensive and I run regular introductory courses). So far we’ve had >20M CPU hours, with ~100 attributed publications.

CamGrid: contacts Mark Calleja: Online documentation at:

(How) can the UCS help my research? University Computing Service Paul Mazumdar

Training for Scientific Computing Python o Introductory courses o Numerical programming o Regular expressions o [Building Condor jobs] MPI MATLAB Mathematica Fortran, R, Stata…

Managed Virtualised Machines Xen farm Installation images for various Linux distributions or recent versions of Windows Server

Cloud/IaaS storage Built using Openstack Scalable, resilient, robust… Coming soon!

Managed Web Service Apache/Solaris with MySQL, PHP, Perl, Raven… group.cam.ac.uk namespace provides ‘neutral territory’ for collaborators

Further information If you want to know more, contact