High Performance Computing and TupleSpaces

Slides:



Advertisements
Similar presentations
Wintouch eCRM A Customer Relationship Management Solution designed specifically for AS/400 or iSeries Users.
Advertisements

Copyright © 2011 Pearson Education, Inc. or its affiliates. All rights reserved.1 PowerSchool 7.0 PowerSchool Application Architecture –PowerSchool 7.0.
XS - Platform What is XS – Manager ?
1 Applications Virtualization in VPC Nadya Williams UCSD.
Copyright GeneGo CONFIDENTIAL »« MetaCore TM (System requirements and installation) Systems Biology for Drug Discovery.
Hydra Partners Meeting March 2012 Bill Branan DuraCloud Technical Lead.
Cacti Workshop Tony Roman Agenda What is Cacti? The Origins of Cacti Large Installation Considerations Automation The Current.
One.box Distributed home service interface. Core Components Pop3 client Router Storage Pop3 Server.
(NHA) The Laboratory of Computer Communication and Networking Network Host Analyzer.
Matt Bertrand Building GIS Apps in the Cloud. Infrastructure - Provides computer infrastructure, typically a platform virtualization environment, as a.
Introduction to DoC Private Cloud
Chapter 7 WORKING WITH GROUPS.
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
Bob Thome, Senior Director of Product Management, Oracle SIMPLIFYING YOUR HIGH AVAILABILITY DATABASE.
Customized cloud platform for computing on your terms !
Cluster currently consists of: 1 Dell PowerEdge Ghz Dual, quad core Xeons (8 cores) and 16G of RAM Original GRIDVM - SL4 VM-Ware host 1 Dell PowerEdge.
Implementation - Deployment Methods of deployment –User PC –Network shared (workstation install) –Terminal server –Web Deployment (ActiveX) (Note: this.
Goodbye rows and tables, hello documents and collections.
Windows Azure Conference 2014 Deploy your Java workloads on Windows Azure.
CN1176 Computer Support Kemtis Kunanuraksapong MSIS with Distinction MCTS, MCDST, MCP, A+
Client – Server Application Can you create a client server application: The server will be running as a service: does not have a GUI The server will run.
Block1 Wrapping Your Nugget Around Distributed Processing.
IBM TSpaces Lab 1 Introduction. Summary TSpaces Overview Basic Definitions Basic primitive operations Reading/writing tuples in tuplespace HelloWorld.
CERN-PH-SFT-SPI August Ernesto Rivera Contents Context Automation Results To Do…
Page 1 © 2001, Epicentric - All Rights Reserved Epicentric Modular Web Services Alan Kropp Web Services Architect WSRP Technical Committee – March 18,
Bio-Linux 3.0 An integrated bioinformatics solution for the EG community ClustalX showing DNA polymerase alignment GeneSpring showing yeast transcriptome.
INTRUSION DETECTION SYSYTEM. CONTENT Basically this presentation contains, What is TripWire? How does TripWire work? Where is TripWire used? Tripwire.
IBM TSpaces Lab 2 Customizing tuples and fields. Summary Blocking commands Tuple Expiration Extending Tuples (The SubclassableTuple) Reading/writing user.
Computational Research in the Battelle Center for Mathmatical medicine.
A Technical Overview Bill Branan DuraCloud Technical Lead.
Cloud Computing project NSYSU Sec. 1 Demo. NSYSU EE IT_LAB2 Outline  Our system’s architecture  Flow chart of the hadoop’s job(web crawler) working.
Ole’ Miss DOSAR Grid Michael D. Joy Institutional Analysis Center.
Launch Amazon Instance. Amazon EC2 Amazon Elastic Compute Cloud (Amazon EC2) provides resizable computing capacity in the Amazon Web Services (AWS) cloud.
Hands-On Microsoft Windows Server Implementing User Profiles A local user profile is automatically created at the local computer when you log on.
Planning Server Deployments Chapter 1. Server Deployment When planning a server deployment for a large enterprise network, the operating system edition.
Claudio Grandi INFN Bologna Virtual Pools for Interactive Analysis and Software Development through an Integrated Cloud Environment Claudio Grandi (INFN.
UFIT Infrastructure Self-Service. Service Offerings And Changes Virtual Machine Hosting Self service portal Virtual Machine Backups Virtual Machine Snapshots.
A Web Based Job Submission System for a Physics Computing Cluster David Jones IOP Particle Physics 2004 Birmingham 1.
The world’s libraries. Connected. The Benefits of CONTENTdm Hosting Services OCLC’s Digital Lifecycle Webinar Series April 9, 2013.
Information Screen Different options to realize. Idea one – You want this if: It should be easy to provide information ◦ Even for non-technical advanced.
Advanced Network Administration Computer Clusters.
Introducing MagicInfo Premium S 4.1
Brief introduction about “Grid at LNS”
Progress Apama Fundamentals
Course: Cluster, grid and cloud computing systems Course author: Prof
Basharat Institute of Higher Education
RHEV Platform at LHCb Red Hat at CERN 17-18/1/17
Simulation Production System
InGenius Connector Enterprise Microsoft Dynamics CRM
Installation 1. Installation Sources
Cluster / Grid Status Update
VI-SEEM Data Discovery Service
ACTIVE DIRECTORY ADMINISTRATION
Windows Server 2008 and SQL 2008 Windows Server 2008.
Partner Status HPCL-University of Cyprus
Tools and Services Workshop Overview of Atmosphere
NGS Oracle Service.
MaterialsHub - A hub for computational materials science and tools.
Virtualization in the gLite Grid Middleware software process
CS101 Bigger Networks.
HC Hyper-V Module GUI Portal VPS Templates Web Console
Introducing MagicInfo Premium S 6.0
Time Gathering Systems Secure Data Collection for IBM System i Server
Windows Server Administration Fundamentals
Earthquake Early Warning – Testing and Certification Platform
Implementing and Managing Group and Computer Accounts
Hitachi Storage Service Manager
OpenStack Summit Berlin – November 14, 2018
Instructor Materials Chapter 5: Windows Installation
Introducing MagicInfo Premium S 6
Presentation transcript:

High Performance Computing and TupleSpaces Student: Jeremy Kemp Advisor: Hong Lin

High Performance Computing Our cluster : Grid Rocks 5.1 64-bit What TSpaces uses

What is Grid?

Images courtesy of Intel.com What is Grid? Cabinet 0 Cabinet 1 17 Nodes 3.06 GHz 1GB RAM 17 Nodes 1.8 GHz 2GB RAM Images courtesy of Intel.com

Images courtesy of Intel.com What is Grid? Head Node – Grid itself Dual Socket Quad Core Xeon Workstation 8 cores total Jobs are Started Here Hosts all the data (for now) 12GB of RAM Images courtesy of Intel.com

What is Grid?

What is Rocks? Developed at UCSD using an NSF grant It allows a cluster to be installed and running in under a day Comes with Cluster infrastructure tools Contains all of the things a cluster needs

What does TSpaces use? Network File System Pre-configured public key authentication Automatic user account creation DNS allows easy access to the same TSpaces Server

Tspaces TSpaces is a Java package that contains: Tspaces server Java module containing methods and data structures used in programming a tspaces program Used primarily as a cross-platform communications platform

TupleSpaces This is what TSpaces is named after Runs on one host All data is stored here Programmer uses TSpace methods to access Full of Tuples

The Tuple All data stored in a TSpace must be inside a Tuple Can hold primitives and classes, including user defined classes Tuples can be nested Tuples are a subclass of superTuple

Tspaces Methods read() take() waitToread() waitToTake() write() countN() delete() deleteAll()

Configuring TSpaces Unpack the tarball to the NFS Using GNU Screen, open a persistent instance of the TSpaces server Add the location of the TSpaces files to the user's classpath Run the program on the number of nodes desired

GammaSort An Example program modeled after the Chemical Reaction Model Is parallelizable to n/2 nodes 4 Other programs written to debug/run gammaSort: dataGenerator.java dataViewer.java dataCleaner.java dataReset.java

GammaSort Data elements consist of a tuple: tuple dataTemplate = new Tuple(new Field(Integer.class), new Field(Double.class)); The integer is the index of the search The above is the template, used to 'search' for the desired tuple using read() and take()

GammaSort Data elements are pulled from the TupleSpace by the compute node and compared If they are “out of order” they are switched The Data elements are then written back to a tuplespace

GamaSort and Synchronization In order to synchronize the data, 4 counters are used 4 tupleSpaces are used Two TupleSpaces for the data elements being read (one even and one odd) Two TupleSpaces for the data elements being written (one even and one odd) All data must be handled in pairs to determine when to Terminate the program.

Future Improvements Consolidate all of the support applications in to one, customizable GUI application to help build future programs in TSpaces Use more of the Features and Customizations to provided by TSpaces Automated Startup tool/script