© 2006 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.1: Cluster and Grid Computing: Case Studies Building a Roll August.

Slides:



Advertisements
Similar presentations
Developing in CAS. Why? As distributed you edit CAS 3 with Eclipse and build with Maven 2 – Best Practice for Release Engineering – Difficult edit-debug.
Advertisements

Customizing a Cluster. What We’ll Be Doing Discuss how to add new packages to compute nodes Discuss frontend and compute node partitioning Discuss how.
Software Configuration Management Donna Albino LIS489, December 3, 2014.
Version Control What it is and why you want it. What is Version Control? A system that manages changes to documents, files, or any other stored information.
Software installation Chapter 7. Software installation Numerous software options Usually free Open source Several sources Installation CD Websites sourceforge.net.
Introduction to CVS 7/3/20151UMBC CMSC 341. Outline Introduction to Source Code Management What is CVS? CVS for Project Submission Basic commands Checkout,
G51FSE Version Control Naisan Benatar. Lecture 5 - Version Control 2 On today’s menu... The problems with lots of code and lots of people Version control.
NDT Tools Tutorial: How-To setup your own NDT server Rich Carlson Summer 04 Joint Tech July 19, 2004.
Julie McEnery1 Installing the ScienceTools The release manager automatically compiles each release of the Science Tools, it creates a set of wrapper scripts.
Rocks Clusters SUN HPC Consortium November 2004 Federico D. Sacerdoti Advanced CyberInfrastructure Group San Diego Supercomputer Center.
V Avon High School Tech Crew Agenda Old Business –Delete Files New Business –Week 10 Topics: Coming up: –Yearbook Picture: Feb 7 12:20PM.
Rocks cluster : a cluster oriented linux distribution or how to install a computer cluster in a day.
WebFOCUS Developer Studio Update Dimitris Poulos Technical Director September 3, 2015 Copyright 2009, Information Builders. Slide 1.
Training Course 2 User Module Training Course 3 Data Administration Module Session 1 Orientation Session 2 User Interface Session 3 Database Administration.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 WP4 hands-on workshop: EDG LCFGng exercises
1 THE UNIX FILE SYSTEM By Chokechai Chuensukanant ID COSC 513 Operating System.
Dustin Harman VM Workshop 2015 RPM Basics. What is RPM? Red Hat Package Manager Native package manager on RHEL, Fedora, SUSE, some Mandriva RPM/SRPM files.
70-294: MCSE Guide to Microsoft Windows Server 2003 Active Directory Chapter 12: Deploying and Managing Software with Group Policy.
Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.
CSN08101 Digital Forensics Lecture 1B: Essential Linux and Caine Module Leader: Dr Gordon Russell Lecturers: Robert Ludwiniak.
Rocks ‘n’ Rolls An Introduction to Programming Clusters using Rocks © 2008 UC Regents Anoop Rajendra.
CERN Manual Installation of a UI – Oxford July - 1 LCG2 Administrator’s Course Oxford University, 19 th – 21 st July Developed.
Tutorial build Main ideas –Reuse as much previously obtained configuration information as possible: from Babel, cca-spec-babel, etc. –Extract all irrelevant.
Drexel University Software Engineering Research Group Git for SE101 1.
Managing Software Patches 10/15/ Introducing Solaris OE Patches A patch contains collection of files and directories Patch replaces existing files.
1 Chapter Overview Publishing Resources in Active Directory Service Redirecting Folders Using Group Policies Deploying Applications Using Group Policies.
July 2011CMSC 341 CVS/Ant 1 CMSC 341 Java Packages Ant CVS Project Submission.
CVS – concurrent versions system Network Management Workshop intERlab at AIT Thailand March 11-15, 2008.
1Offline Weekly Meeting May May 2006 AliRoot Build Integration and (Testing) System Peter Hristov Vagner Morais.
Partner Logo German Cancio – WP4-install LCFG HOW-TO - n° 1 LCFGng configuration examples Updated 10/2002
1 / 22 AliRoot and AliEn Build Integration and Testing System.
EDG Testbed installation and configuration with LCFGng Maite Barroso - WP4
UMD TIER-3 EXPERIENCES Malina Kirn October 23, 2008 UMD T3 experiences 1.
© 2007 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 1.1: Introduction to Cluster and Grid Computing July 31, 2007 Wilfred.
9th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS E-infrastructure shared between Europe and Latin America CE + WN installation and configuration.
Roll Screen Development Debugging assistance for building Rocks Rolls with screens OSGC, May 2008 Nadya Williams University of Zurich.
Packaging for Voracity Solutions Control Panel David Turner.
Module 6: Deploying and Managing Software by Using Group Policy.
Status of Florida Tier2 Center A mini tutorial on ROCKS appliances Jorge L. Rodriguez February 2003.
CVS – concurrent versions system AROC Guatemala July 19-23, 2010 Guatemala City, Guatemala.
Module 8 : Configuration II Jong S. Bok
E-infrastructure shared between Europe and Latin America Introduction to the tutorial for site managers Vanessa Hamar Universidad de Los.
Capabilities and Process Application Integration.
Deploying Software with Group Policy Chapter Twelve.
J.P. Wellisch, CERN/EP/SFT SCRAM Information on SCRAM J.P. Wellisch, C. Williams, S. Ashby.
12 CVS Mauro Jaskelioff (originally by Gail Hopkins)
Yannick Patois - Datagrid Software Repository Presentation - March, n° 1 Datagrid Software Repository Presentation CVS, packages and automatic.
March, PROOF - Parallel ROOT Facility Maarten Ballintijn Bring the KB to the PB not the PB to the KB.
12th EELA TUTORIAL - USERS AND SYSTEM ADMINISTRATORS FP6−2004−Infrastructures−6-SSA E-infrastructure shared between Europe and Latin.
DataGrid is a project funded by the European Commission under contract IST EDG Baseline API Document Document build description and current.
Installing VERITAS Cluster Server. Topic 1: Using the VERITAS Product Installer After completing this topic, you will be able to install VCS using the.
C Copyright © 2006, Oracle. All rights reserved. Oracle Secure Backup Additional Installation Topics.
Using Subversion for Source Code Control Michael McLennan HUBzero® Platform for Scientific Collaboration Purdue University This work licensed under Creative.
Sitecore upgrades The Past, The Present, The Future.
Getting Started with Linux
Introduction to ClearCase
1.1.2 OneOs Downloading Software Upgrade
Hadoop Architecture Mr. Sriram
Build process of ovirt-node and the plugins
CVS – concurrent versions system
CVS – concurrent versions system
Subversion Reasons to use How it works Subversion important commands
Cluster Disks and Cluster File Storage
UAA Operator Issues 25 Feb 2013.
June 2011 David Front Weizmann Institute
Lab 1 introduction, debrief
Figure 6-4: Installation and Patching
SAP R/3 Installation on WIN NT-ORACLE
Cordova & Cordova Plugin Installation and Management
Lab 2: Terminal Basics.
Presentation transcript:

© 2006 UC Regents1 Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.1: Cluster and Grid Computing: Case Studies Building a Roll August 9, 2006 Nadya Williams

© 2006 UC Regents2 Prepare for the build  Check out CVS Rocks distribution:  cvs - login  cvs - checkout -r ROCKS_4_1 rocks  Go to the top-level rolls directory:  # cd rocks/src/roll  # ls bin/ cacl/ etc/ hpc/ patch/ birn/ condor/ gfarm/ intel/ nbcr/ birn-oracle1/ CVS/ grid/ java/ ninf/ …

© 2006 UC Regents3 Create new roll directory  Prerequisites  name  version (or defaults to 1) a-17beta  color (or random choice from X colors)  Creation  # cd rocks/src/roll  # bin/make-roll-dir.py -n cacao -v c chocolate  # ls cacao graphs/ Makefile nodes/ src/ version.mk

© 2006 UC Regents4 cacao/ contents graphs/ nodes/ src/ default/ version.mk cacao.xml Makefile cacao/ usersguide/ Makefile patch-files/ Makefile version.mk images/ Makefile version.mk *.sgml *.sgml.in

© 2006 UC Regents5 Clean new roll directory  Remove template’s id entries old: # $Id: Makefile,v /12/01 01:31:55 nadya Exp $ new: # $Id: $  Remove template’s log entries old: # $Log: Makefile,v $ # Revision /12/01 01:31:55 nadya # baseline new: # $Log: $

© 2006 UC Regents6 What to clean?  Makefile  graphs/default/cacao.xml  nodes/cacao.xml  src/Makefile  src/cacao/Makefile  src/usersguide/Makefile  src/usersguide/roll-cacao-usersguide.in

© 2006 UC Regents7 File graphs/default/cacao.xml  the file describes how all the files in the nodes directory are linked together in the kickstart graph  specify edges from known nodes to cacao node  for graph file syntax see guide/4.1/kickstart-xml.html

© 2006 UC Regents8 Add edges in graphs/default/cacao.xml cacao Roll $Log: cacao.xml,v $ root client cacaointel server …… condor

© 2006 UC Regents9 File nodes/cacao.xml  the files in nodes/ are used to install packages and to configure their respective services  for nodes files syntax see guide/4.1/kickstart-xml.html

© 2006 UC Regents10 Add packages in nodes/cacao.xml Extension to Java beans, for internal consumption only. $Log: cacao.xml,v $ cacao roll-cacao-usersguide package name equals spec file name

© 2006 UC Regents11 src/cacao/  # cp /Venezuela/Chuao/cacao tar.gz. Makefile cacao tar.gz cacao.spec.in version.mk  Makefile PKGROOT=/opt/cacao … install:: mkdir -p $(ROOT)/$(PKGROOT) ( cd $(NAME)-$(VERSION); make prefix=$(ROOT)/$(PKGROOT) install; ) build: gunzip -c $(NAME)-$(VERSION).tar.gz | tar -x ( cd $(NAME)-$(VERSION);./configure --prefix=$(PKGROOT); make; )  version.mk NAME = cacao RELEASE = 0 VERSION = 15.44

© 2006 UC Regents12 Caution!  Naming convention is important cacao tar.gz will fail !  Why? $(NAME)-$(VERSION) combo NAME = cacao cacao VERSION =  Fix  NAME = cacao VERSION = cacao_15.44.tar.gz ---> cacao_15.44/ $(NAME)_$(VERSION)  NAME = Cacao VERSION = 15.44

© 2006 UC Regents13 Adding the fortune packages in nodes/cacao.xml $Log: cacao.xml,v $ cacao fortune fortune-starwars fortune-simpsons-homer

© 2006 UC Regents14 Using ‘fortune’. /usr/bin/fortune

© 2006 UC Regents15 Linking cacao into the Graph The cacao Roll cacao

© 2006 UC Regents16 Building  Build rpms - debugging  # cd rocks/src/roll/cacao/src/cacao; make rpm  Build roll - for real  # cd rocks/src/roll/cacao; make roll  Result /home/cacao/rocks/redhat/RPMS/noarch/roll-cacao-kickstart noarch.rpm /home/cacao/rocks/redhat/RPMS/noarch/roll-cacao-usersguide noarch.rpm /home/cacao/rocks/redhat/RPMS/i386/cacao i386.rpm /home/cacao/rocks/redhat/SRPMS/cacao src.rpm /home/cacao/rocks/redhat/SRPMS/roll-cacao-usersguide src.rpm cacao i386.disk1.iso