A Comparison of Job Duration Utilizing High Performance Computing on a Distributed Grid Team Members JerNettie Burney Robyn Evans Michael Austin Mentor.

Slides:



Advertisements
Similar presentations
Copyright © 2008 SAS Institute Inc. All rights reserved. SAS and all other SAS Institute Inc. product or service names are registered trademarks or trademarks.
Advertisements

Building Campus HTC Sharing Infrastructures Derek Weitzel University of Nebraska – Lincoln (Open Science Grid Hat)
GPU Computing with Hartford Condor Week 2012 Bob Nordlund.
Mersenne (Titanic) PrimeModulusVikeGridTerminal/Command LineCondorSieve of Eratosthenes.
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
STAT 2120 Tim Keaton. ANalysis Of VAriance (ANOVA) ANOVA is a generalization of the comparison of two population means In ANOVA, we compare k population.
Bryce Carmichael Lee Godley III Diaminatou Goudiaby Unquiea Wade Mentor: Dr. Eric Akers.
CSTEP Cluster Sampling for Tail Estimation of Probability.
AStudy on the Viability of Hadoop Usage on the Umfort Cluster for the Processing and Storage of CReSIS Polar Data Mentor: Je’aime Powell, Dr. Mohammad.
Process Improvement in Healthcare: Volunteer Clinic Case Study Nonparametric Statistics ISE 491 Fall 2009 Dr. Joan Burtner Associate Professor, Department.
Chapter 3 Analysis of Variance
Every achievement originates from the seed of determination. 1Random Effect.
Hypothesis testing for the mean [A] One population that follows a normal distribution H 0 :  =  0 vs H 1 :    0 Suppose that we collect independent.
Statistical Methods in Computer Science Hypothesis Testing II: Single-Factor Experiments Ido Dagan.
Utilizing Condor and HTC to address archiving online courses at Clemson on a weekly basis Sam Hoover 1 Project Blackbird Computing,
Brain Campbell Bryce Carmichael Unquiea Wade Mentor: Dr. Eric Akers.
The Center for Remote Sensing of Ice Sheets (CReSIS) has been compiling Greenland ice sheet thickness data since The airborne program utilizes a.
12-1 Chapter Twelve McGraw-Hill/Irwin © 2005 The McGraw-Hill Companies, Inc., All Rights Reserved.
The Glidein Service Gideon Juve What are glideins? A technique for creating temporary, user- controlled Condor pools using resources from.
Temple University Goals : 1.Down sample 20 khz TIDigits data to 16 khz. 2. Use Down sample data run regression test and Compare results posted in Sphinx-4.
12-1 Chapter Twelve McGraw-Hill/Irwin © 2006 The McGraw-Hill Companies, Inc., All Rights Reserved.
Grid Appliance – On the Design of Self-Organizing, Decentralized Grids David Wolinsky, Arjun Prakash, and Renato Figueiredo ACIS Lab at the University.
Chapter 11 HYPOTHESIS TESTING USING THE ONE-WAY ANALYSIS OF VARIANCE.
Research Tools and Techniques The Research Process: Step 7 (Data Analysis Part C) Lecture 30.
© FPT SOFTWARE – TRAINING MATERIAL – Internal use 04e-BM/NS/HDCV/FSOFT v2/3 Working with MSSQL Server Code:G0-C# Version: 1.0 Author: Pham Trung Hai CTD.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Multi-Channel Radar Depth Sounder (MCRDS) Signal Processing: A Distributed Computing Approach Je’aime Powell 1, Dr. Linda Hayden 1, Dr. Eric Akers 1, Richard.
TEAS prep course trends YOUR FUTURE BEGINS TODAY Joel Collazo, MD Maria E Guzman, MPM.
Chapter 14 – 1 Chapter 14: Analysis of Variance Understanding Analysis of Variance The Structure of Hypothesis Testing with ANOVA Decomposition of SST.
Implementation of a Polycom VSX 8000 Teleconferencing System: Developing Standards and Practices for Participating in Virtual Conferences.
Chapter 19 Analysis of Variance (ANOVA). ANOVA How to test a null hypothesis that the means of more than two populations are equal. H 0 :  1 =  2 =
Voltron A Peer To Peer Grid Networking Client Rice University Software Construction Methodology Dr. Stephen Wong, Instructor.
Using Microsoft Visual Studio C++ Express 2005 Name: Dr Ju Wang Ashwin Belle Course Resource:
Integration with a Web Application to Create Navigational Instructions for Locations on the Campus of Elizabeth City State University.
14- 1 Chapter Fourteen McGraw-Hill/Irwin © 2006 The McGraw-Hill Companies, Inc., All Rights Reserved.
Intermediate Condor: Workflows Rob Quick Open Science Grid Indiana University.
Analysis of Variance (One Factor). ANOVA Analysis of Variance Tests whether differences exist among population means categorized by only one factor or.
Copyright © 2013, 2009, and 2007, Pearson Education, Inc. Chapter 14 Comparing Groups: Analysis of Variance Methods Section 14.1 One-Way ANOVA: Comparing.
1 ANALYSIS OF VARIANCE (ANOVA) Heibatollah Baghi, and Mastee Badii.
© 2002 Six Sigma Academy0 Define Point one Point two Point three Increase Market Share.
A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting.
Chapter 13 Design of Experiments. Introduction “Listening” or passive statistical tools: control charts. “Conversational” or active tools: Experimental.
 Does the addition of computing cores increase the performance of the CReSIS Synthetic Aperture Radar Processor (CSARP)?  What MATLAB toolkits and/or.
Chapter 4 Analysis of Variance
LSSG Green Belt Training Overview of Charts and Graphs: Mini Case.
Copyright © 2016, 2013, 2010 Pearson Education, Inc. Chapter 10, Slide 1 Two-Sample Tests and One-Way ANOVA Chapter 10.
Copyright © 2004 by The McGraw-Hill Companies, Inc. All rights reserved.
Effects of Different Mediums on Short Term Memory Rachel Barclay Aberdeen Central High School Purpose Hypothesis Methods Data Analysis 1)Explain to the.
Title of the study. Principal investigator and co workers names Organization/College name.
Formula for Linear Regression y = bx + a Y variable plotted on vertical axis. X variable plotted on horizontal axis. Slope or the change in y for every.
The Ability of Different Brands of Contact Solution on Preventing Contacts from Dehydrating Katlyn Gelling Aberdeen Central High School Purpose Hypothesis.
Chapter 12 Inference on the Least-squares Regression Line; ANOVA 12.3 One-way Analysis of Variance.
CIS-NG CASREP Information System Next Generation Shawn Baugh Amy Ramirez Amy Lee Alex Sanin Sam Avanessians.
BUS 308 Entire Course (Ash Course) FOR MORE CLASSES VISIT BUS 308 Week 1 Assignment Problems 1.2, 1.17, 3.3 & 3.22 BUS 308 Week 1.
Slide 1 DESIGN OF EXPERIMENT (DOE) OVERVIEW Dedy Sugiarto.
VO Experiences with Open Science Grid Storage OSG Storage Forum | Wednesday September 22, 2010 (10:30am)
15/02/2006CHEP 061 Measuring Quality of Service on Worker Node in Cluster Rohitashva Sharma, R S Mundada, Sonika Sachdeva, P S Dhekne, Computer Division,
The 2 nd to last topic this year!!.  ANOVA Testing is similar to a “two sample t- test except” that it compares more than two samples to one another.
Summary of presentation Introduction of the dissertation.
Two way ANOVA with replication
Two way ANOVA with replication
Post Hoc Tests on One-Way ANOVA
DUCKS – Distributed User-mode Chirp-Knowledgeable Server
One-Way Analysis of Variance
Chapter 11 Analysis of Variance
Chapter 11: The ANalysis Of Variance (ANOVA)
Simple Linear Regression
Analysis of Variance Objective
Generation of Titanic Prime Numbers Through High Performance Computing
Presentation transcript:

A Comparison of Job Duration Utilizing High Performance Computing on a Distributed Grid Team Members JerNettie Burney Robyn Evans Michael Austin Mentor Je’aime Powell

Nature and Background of the Study

Abstract The Polar Grid team was tasked with testing the VikeGrid system to ensure it was ready for grid computing. This was achieved by installing the Condor client on the iMac computers located in Dixon hall, Lane hall, and E.V Wilkins on the campus of Elizabeth City State University. Condor allowed jobs to be submitted to VikeGrid and distributed to one or more nodes. The job that the team submitted to Condor was the compiled Sieve of Eratosthenes C++ code. This code generated prime numbers between 0 to 500,000 and was essential in testing the job submission process. The compiled code that was used in the script file was submitted to VikeGrid through Condor. These jobs were then distributed to available nodes for processing. After each successful job submission, log files were created to record statistical data of the elapsed time it took to process its entire submission along with the time it took to process each individual job. The data from these tables were imported to Mini Tab, which is statistical analysis software. An analysis of variance was then performed to determine if the elapsed time of the submissions varied within a 5 percent level of significance. From that a determination of if increasing the number of nodes decreased the elapsed time thereby showing a performance increase.

Background of the Problem The Polar Grid team’s ultimate goal was to find a Titanic prime. Finding a prime number generator Test the grid

Key Terms Cluster Grid Script Condor Node VikeGrid Kitoto ANOVA

Hypothesis The team hypothesized that the elapsed time for a single node to complete a submitted job would take much longer than multiple nodes collaborating to complete the same job.

Methodology

Definition of the Population Time it took to process the entire submission Elapsed time data Time it took to process each individual job There were 8 total Individual Job Submission Time

Log files Get the code Compile and rename Make script file Make compiled file the executable Submit the script to condor After the job submission is finished, the log file is created

Definition of Population

Research Design Defined the problem Analyzed a solution Performed experiment Analyzed results

Analysis of Data

Visual Representation of Data

Summary, Conclusions, and Recommendations

Conclusions based off Statistical Analysis of the Data One-way ANOVA: Number of Workers, Elapsed Time Source DF SS MS F P Factor Error Total S = R-Sq = 37.01% R-Sq(adj) = 32.51% Individual 95% CIs For Mean Based on Pooled StDev Level N Mean StDev Number of Workers ( * ) Elapsed Time ( * ) Pooled StDev = 11.90

Challenges VikeGrid incomplete Perl Script ▫Errors were made while installing condor Sbin ▫Sbin paths were not included Xcode ▫Updates required Source code Submission of scripts

Acknowledgements Michael Jefferson ▫For his assistance in correcting the code in Visual Studio. Dr. Eric Akers ▫For his assistance in modifying the code to make primes between 0 to and help with the output of the code.

Future works Titanic Prime Numbers Multiple job submission Test on both Linux and Windows