 Does the addition of computing cores increase the performance of the CReSIS Synthetic Aperture Radar Processor (CSARP)?  What MATLAB toolkits and/or.

Slides:



Advertisements
Similar presentations
Four girls soccer teams took a random sample of players regarding the number of goals scored per game. The results are below. Use a significance level.
Advertisements

Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
Bryce Carmichael Lee Godley III Diaminatou Goudiaby Unquiea Wade Mentor: Dr. Eric Akers.
Probability & Statistical Inference Lecture 7 MSc in Computing (Data Analytics)
AStudy on the Viability of Hadoop Usage on the Umfort Cluster for the Processing and Storage of CReSIS Polar Data Mentor: Je’aime Powell, Dr. Mohammad.
Chapter Seventeen HYPOTHESIS TESTING
ONE SAMPLE t-TEST FOR THE MEAN OF THE NORMAL DISTRIBUTION Let sample from N(μ, σ), μ and σ unknown, estimate σ using s. Let significance level =α. STEP.
Hypothesis Testing Steps of a Statistical Significance Test. 1. Assumptions Type of data, form of population, method of sampling, sample size.
Sample size computations Petter Mostad
Statistics for the Social Sciences Psychology 340 Spring 2005 Within Groups ANOVA.
ANOVA  Used to test difference of means between 3 or more groups. Assumptions: Independent samples Normal distribution Equal Variance.
BCOR 1020 Business Statistics Lecture 20 – April 3, 2008.
Economics 173 Business Statistics Lecture 8 Fall, 2001 Professor J. Petry
Cluster computing facility for CMS simulation work at NPD-BARC Raman Sehgal.
Matlab, R and Other Jobs in CHTC. chtc.cs.wisc.edu No suitable R No Matlab runtime Missing shared libraries Missing compilers … Running On Bare Bones.
Testing Hypotheses about a Population Proportion Lecture 29 Sections 9.1 – 9.3 Tue, Oct 23, 2007.
Guide to Using Excel For Basic Statistical Applications To Accompany Business Statistics: A Decision Making Approach, 6th Ed. Chapter 11: Analysis of Variance.
The Center for Remote Sensing of Ice Sheets (CReSIS) has been compiling Greenland ice sheet thickness data since The airborne program utilizes a.
Copyright © Cengage Learning. All rights reserved. 13 Linear Correlation and Regression Analysis.
XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service.
1 Level of Significance α is a predetermined value by convention usually 0.05 α = 0.05 corresponds to the 95% confidence level We are accepting the risk.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
LOGO Scheduling system for distributed MPD data processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.
Kurochkin I.I., Prun A.I. Institute for systems analysis of RAS Centre for grid-technologies and distributed computing GRID-2012, Dubna, Russia july.
UNIT - 1Topic - 2 C OMPUTING E NVIRONMENTS. What is Computing Environment? Computing Environment explains how a collection of computers will process and.
Trace Generation to Simulate Large Scale Distributed Application Olivier Dalle, Emiio P. ManciniMar. 8th, 2012.
Business Intelligence Appliance Powerful pay as you grow BI solutions with Engineered Systems.
Multi-Channel Radar Depth Sounder (MCRDS) Signal Processing: A Distributed Computing Approach Je’aime Powell 1, Dr. Linda Hayden 1, Dr. Eric Akers 1, Richard.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Economics 173 Business Statistics Lecture 7 Fall, 2001 Professor J. Petry
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
STEP BY STEP Critical Value Approach to Hypothesis Testing 1- State H o and H 1 2- Choose level of significance, α Choose the sample size, n 3- Determine.
LOGO PROOF system for parallel MPD event processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.
And Tier 3 monitoring Tier 3 Ivan Kadochnikov LIT JINR
Chapter 9: Hypothesis Testing Section 3: The P-Value in Hypothesis Testing.
Statistics for Business and Economics 8 th Edition Chapter 11 Simple Regression Copyright © 2013 Pearson Education, Inc. Publishing as Prentice Hall Ch.
CReSIS Data Processing and Analysis Jerome E. Mitchell Indiana University - Bloomington.
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
Forward Observer In-Flight Dual Copy System Richard Knepper, Matthew Standish NASA Operation Ice Bridge Field Support Research Technologies Indiana University.
LOGO Development of the distributed computing system for the MPD at the NICA collider, analytical estimations Mathematical Modeling and Computational Physics.
T3 analysis Facility V. Bucard, F.Furano, A.Maier, R.Santana, R. Santinelli T3 Analysis Facility The LHCb Computing Model divides collaboration affiliated.
© The McGraw-Hill Companies, Inc., Chapter 13 Analysis of Variance (ANOVA)
Logic and Vocabulary of Hypothesis Tests Chapter 13.
A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting.
AP Statistics Section 11.1 B More on Significance Tests.
For her project, Maria bought 50 small bags of jelly beans. The average number of jelly beans in a small bag is 27. It is known that the standard deviation.
Hypothesis Testing Errors. Hypothesis Testing Suppose we believe the average systolic blood pressure of healthy adults is normally distributed with mean.
STEP BY STEP Critical Value Approach to Hypothesis Testing 1- State H o and H 1 2- Choose level of significance, α Choose the sample size, n 3- Determine.
XI HE Computing and Information Science Rochester Institute of Technology Rochester, NY USA Rochester Institute of Technology Service.
A Comparison of Job Duration Utilizing High Performance Computing on a Distributed Grid Team Members JerNettie Burney Robyn Evans Michael Austin Mentor.
Ricardo Garcia Bertin Pablo Eric Gomez Period:
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
© The McGraw-Hill Companies, Inc., Chapter 12 Analysis of Variance (ANOVA)
If we fail to reject the null when the null is false what type of error was made? Type II.
STEP BY STEP Critical Value Approach to Hypothesis Testing 1- State H o and H 1 2- Choose level of significance, α Choose the sample size, n 3- Determine.
Review Chapter 1-3. Exam 1 25 questions 50 points 90 minutes 1 attempt Results will be known once the exam closes for everybody.
Improving the Research Bootstrap of Condor High Throughput Computing for Non-Cluster Experts Based on Knoppix Instant Computing Technology RIKEN Genomic.
Analysis of Variance ANOVA - method used to test the equality of three or more population means Null Hypothesis - H 0 : μ 1 = μ 2 = μ 3 = μ k Alternative.
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
1
Distributed Correlation in Fabric Kiwi Team PSNC.
Learning Objectives Describe the hypothesis testing process Distinguish the types of hypotheses Explain hypothesis testing errors Solve hypothesis testing.
CommLab PC Cluster (Ubuntu OS version)
Hypothesis Theory PhD course.
Recipe for any Hypothesis Test
Initial job submission and monitoring efforts with JClarens
Hypothesis Tests for Proportions
User interaction and workflow management in Grid enabled e-VLBI experiments Dominik Stokłosa Poznań Supercomputing and Networking Center, Supercomputing.
Presentation transcript:

 Does the addition of computing cores increase the performance of the CReSIS Synthetic Aperture Radar Processor (CSARP)?  What MATLAB toolkits and/or expansion kits are necessary to run CSARP ?  What hardware requirements are necessary to store and process CReSIS collected data?  What facility environmental requirements are there to house a cluster of at least 32 cores to process a data set?  What is the process to prepare a cluster from a middle-ware stand- point?  Can an open-source job scheduler replace the MATLAB proprietary Distributed Computing Server currently required by CSARP?

It was believed that the addition of computing cores would increase the performance of CSARP run times within a 10% level of significance.

Height Data GPS Data Raw Data Data File Ice Sheet Imagery

Provided by: Radartutorial.eu Synthetic Aperture Radar Multi-Channel RADAR Depth Sounder Greenland 2008 Deployment

ADMI Cluster Testing – 1 Node

ADMI Cluster Testing – 2 Nodes

ADMI Cluster Testing – 4 Nodes

ADMI Cluster Testing – 8 Nodes

ADMI Cluster Testing – Results

Compute Requirements Storage Requirements Power Requirements Cooling Requirements Operating System

Average Home ~3 Tons 2.75 Tons

Application Scheduler Server Head Node MATLAB Job Manager MATLAB Distributed Computing Environment Condor C++ Compiler Torque Video Compression

Set the number of workers Edit Stage 1aEdit Stage 1a Edit Stage 1bEdit Stage 1b Edit Stage 2Edit Stage 2 Execute Startup.m Execute Parameters File Collect Stage run-times

1 Worker2 Workers4 Workers8 Workers16 Workers32 Workers Madogo Worker Mean Times (minutes) P-value < α therefore we must reject H 0 Statistical Hypothesis and Test Value Collected Data ANOVA Testing Analysis and Decision Analysis of Variance (ANOVA)

There is significant evidence to indicate there is a difference in the performance times of CSARP with the inclusion of additional workers with a 10% level of significance.

128 Node Estimation 32 Nodes 128 Nodes Point at which overhead outweighs distribution benefits

Contact Information: Je’aime H. Powell Web Site: