A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting.

Slides:



Advertisements
Similar presentations
EHarmony in Cloud Subtitle Brian Ko. eHarmony Online subscription-based matchmaking service Available in United States, Canada, Australia and United Kingdom.
Advertisements

Evaluation of Cloud Storage for Preservation and Distribution of Polar Data. Nadirah Cogbill Mentors: Marlon Pierce, Yu (Marie) Ma, Xiaoming Gao, and Jun.
Setting up of condor scheduler on computing cluster Raman Sehgal NPD-BARC.
Mentor: Kaiem Frink Ryan Winder Serenity Pender Benard Lynch, Jr. JerNettie Burney A Study of pH, Salinity, and Clarity of Water Samples from Various Locations.
Our Goal: To develop and implement innovative and relevant research collaboration focused on ice sheet, coastal, ocean, and marine research. NSF: Innovation.
Bryce Carmichael Lee Godley III Diaminatou Goudiaby Unquiea Wade Mentor: Dr. Eric Akers.
AStudy on the Viability of Hadoop Usage on the Umfort Cluster for the Processing and Storage of CReSIS Polar Data Mentor: Je’aime Powell, Dr. Mohammad.
+ Team Members Evaluation and Implementation of Web 2.0 Technologies in Support of CReSIS Polar and Cyberinfrastructure Research Projects at Elizabeth.
1 Incremental Evolution of Autonomous Controllers for Unmanned Aerial Vehicles using Multi-objective Genetic Programming Gregory J. Barlow, Choong K. Oh,
1 PLuSH – Mesh Tree Fast and Robust Wide-Area Remote Execution Mikhail Afanasyev ‧ Jose Garcia ‧ Brian Lum.
1 Supplemental line if need be (example: Supported by the National Science Foundation) Delete if not needed. Supporting Polar Research with National Cyberinfrastructure.
McGraw-Hill/Irwin Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. Business Statistics: Communicating with Numbers By Sanjiv Jaggia.
Analysis Functionality to enhance MATLAB default interpolation schema using mGstat ABSTRACT The Center for Remote Sensing of Ice Sheets (CReSIS) has a.
The Center for Remote Sensing of Ice Sheets (CReSIS) has been compiling Greenland ice sheet thickness data since The airborne program utilizes a.
Fabien Viale 1 Matlab & Scilab Applications to Finance Fabien Viale, Denis Caromel, et al. OASIS Team INRIA -- CNRS - I3S.
GIS Web Application Development Team Team Mentor Joe Ausby Team Members Akeem B. Archer Lee A. Smalls Jr.
Team Member 1 (SCHOOL), Team Member 2 (SCHOOL), Team Member 3 (SCHOOL), Team Member 4 (SCHOOL) Mentor: Dr. Blank Blank (School ) This is the place for.
Construction of a University Navigational Mobile Application Group Members: Patrina Bly, Robyn Evans, Nadirah Cogbill Group Mentor: Jeff Wood.
The Impact of CReSIS Summer Research Programs that Influence Students’ Choice of a STEM Related Major in College By: Alica Reynolds, Jessica.
PolarGrid Geoffrey Fox (PI) Indiana University Associate Dean for Graduate Studies and Research, School of Informatics and Computing, Indiana University.
SMS Science Fair Project 8 North Science Investigation 1.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
Cyberinfrastructure Geoffrey Fox Indiana University with Linda Hayden Elizabeth City State University April Virtual meeting.
Utilizing Data Sets from the CReSIS Data Archives to Visualize Greenland Echograms Information in Google Earth 2012 Research Experience for Undergraduates.
Bennie D Waller, Longwood University Statistics Bennie Waller Longwood University 201 High Street Farmville, VA
C ENTER OF E XCELLENCE IN R EMOTE S ENSING E DUCATION AND R ESEARCH M ULTIMEDIA T EAM Research and Implementation of Data Submission Technologies.
Using ICENI to run parameter sweep applications across multiple Grid resources Murtaza Gulamali Stephen McGough, Steven Newhouse, John Darlington London.
ITS-VIP SPRING 2012 FINAL PRESENTATION DATA MINING GROUP PHP?HTML INTERFACE Mide Ajayi Nakul Dureja Data Miners Rakesh Kumar David Fleischhauer.
Parallel Computing with Matlab CBI Lab Parallel Computing Toolbox TM An Introduction Oct. 27, 2011 By: CBI Development Team.
Multi-Channel Radar Depth Sounder (MCRDS) Signal Processing: A Distributed Computing Approach Je’aime Powell 1, Dr. Linda Hayden 1, Dr. Eric Akers 1, Richard.
AUTOMATING THE TERASCAN IMAGE PROCESS Mentor: Keisha Wilkins Brandi R. Brehon Jameson D. Gibbs.
Blackjack Betting and Playing Strategies: A Statistical Comparison By Jared Luffman MSIM /3/2007.
PROCESSED RADAR DATA INTEGRATION WITH SOCIAL NETWORKING SITES FOR POLAR EDUCATION Jeffrey A. Wood April 19, 2010 A Thesis submitted to the Graduate Faculty.
Implementation of a Polycom VSX 8000 Teleconferencing System: Developing Standards and Practices for Participating in Virtual Conferences.
Abstract The Center for Remote Sensing of Ice Sheets (CReSIS) has collected hundreds of terabytes of radar depth sounder data over the Greenland and Antarctic.
1 of 21 Using CReSIS Radar Data to Determine Ice Thickness and Surface Elevation at Pine Island Glacier Team Members: Nyema Barmore Glenn Michael Koch.
Using a MATLAB/Photoshop Interface to Enhance Image Processing in the Interpretation of Radar Imagery The Center for Remote Sensing of Ice Sheets (CReSIS)
Using Common Core State Standards of Seventh Grade Mathematics in the Application of NXT LEGO® Robotics for CReSIS Middle School Students.
1 CReSIS Lawrence Kansas February Geoffrey Fox (PI) Computer Science, Informatics, Physics Chair Informatics Department Director Digital Science.
This material is based upon work supported by the National Science Foundation under Grant No. ANT Any opinions, findings, and conclusions or recommendations.
Forward Observer In-Flight Dual Copy System Richard Knepper, Matthew Standish NASA Operation Ice Bridge Field Support Research Technologies Indiana University.
Lesson Two-Way ANOVA. Objectives Analyze a two-way ANOVA design Draw interaction plots Perform the Tukey test.
 Does the addition of computing cores increase the performance of the CReSIS Synthetic Aperture Radar Processor (CSARP)?  What MATLAB toolkits and/or.
Team Members: Nyema Barmore (ECSU), Glenn Michael Koch (ECSU) Mentor: Dr. Sridar Anandakrishnan (PSU), Peter Burkett (PSU ) Using CReSIS Radar Data to.
One Way ANOVA In prior notes, we looked at data analysis strategies for when the researcher needs to compare two sample means. But, what if a researcher.
REU Site: Arctic and Antarctic Project (AaA-REU) with Research Experience for Teachers (RET) Component I would also like to create a poster on the IU/ECSU.
A Comparison of Job Duration Utilizing High Performance Computing on a Distributed Grid Team Members JerNettie Burney Robyn Evans Michael Austin Mentor.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
The rise of the planet’s temperature has a very negative impact on the subsurface dynamics of Earth’s Polar Regions. Analyzing the polar subsurface is.
LSF Universus By Robert Stober Systems Engineer Platform Computing, Inc.
This material is based upon work supported by the National Science Foundation under Grant No. ANT Any opinions, findings, and conclusions or recommendations.
Lesson Test to See if Samples Come From Same Population.
Dr. Linda Hayden, Box 672 Elizabeth City State University Elizabeth City, NC Cyberinfrastructure for Remote Sensing.
“Moh’d Sami” AshhabSummer 2008University of Jordan MATLAB By (Mohammed Sami) Ashhab University of Jordan Summer 2008.
Using a MATLAB/Photoshop Interface to Enhance Image Processing in the Interpretation of Radar Imagery.
FLIGHT PATH GUI David Alfego Josh Harrison. PURPOSE  Trials flown in Microsoft Flight Simulator X  Data collected according to coordinates of each flight.
Big Data is a Big Deal!.
HTCondor and TORQUE/Maui
OpenPBS – Distributed Workload Management System
NGS computation services: APIs and Parallel Jobs
Lesson ANOVA - D Two-Way ANOVA.
(Mohammed Sami) Ashhab
Do you know population SD? Use Z Test Are there only 2 groups to
Project Title Watershed Watch 2007 Elizabeth City State University
Using Tensorflow to Detect Objects in an Image
A General Approach to Real-time Workflow Monitoring
Watershed Watch 2007 :: Elizabeth City State University
Undergraduate Research Experience with African Nation Component
Project Title Watershed Watch 2013 Elizabeth City State University
Project Title Watershed Watch 2009 Elizabeth City State University
Presentation transcript:

A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting of CReSIS Flight Path Data Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell

Nature and Background of the Study

Abstract The Polar Grid team was tasked with providing the Center for the Remote Sensing of Ice Sheets (CReSIS) with data that would allow signal processing through the CReSIS Synthetic Aperture RADAR Processor (CSARP) to utilize clustered computing resources without the need of MATLAB’s® proprietary Distributed Computing Environment. This research centered on the use of MATLAB® through command line, and scripted distribution through TORQUE high performance computing scheduling. The team used flight path information from the Greenland 2007 field deployment. This data was imported into MATLAB® so that they could be converted from text files into actual MATLAB® script files. With these MEX files, the team was able to create a script within MATLAB® that could plot the flight path data into a graph with the axes of the graph being labeled latitude for the x-axis and longitude for the y-axis. The team took the master script for the creation of the chart and ran jobs through the command line of MATLAB® to Madogo [Elizabeth City State University’s Cluster] and Quarry [Indiana University’s Cluster]. The team was then able to compare execution times from the jobs of Madogo versus Quarry. A second comparison was then tested with TORQUE job submission versus MATLAB® submission to see which performed with greater efficiency. Lastly the average execution times of all three data sets were statistically compared with a 5% significance level to determine if there was a statistically significant difference between the use of command line jobs verses TORQUE submissions.

Background of the Problem Versatility Affordability Better Efficiency Dr. Prasad Gogineni Director of CReSIS Twin Otter Carrying SAR RADAR

Vocabulary ANOVA Binary Cluster Jobs Linux MATLAB Node Perl Script Ssh key TORQUE

Hypothesis Multiple hypotheses: ▫Submission through TORQUE would be quicker ▫Submission of the scripts through the Quarry’s command line would be the slowest to submit

Methodology

Definition of the Population Types of Data ▫CReSIS Datasets ▫Run times Madogo Quarry

Definition of Population

Research Design Defined the problem Analyzed a solution Performed experiment Analyzed results

Statistical Methods & Tests used ANOVA in Excel ▫Null hypothesis H 0 = μ 1 =μ 2 =μ 3 or H 1 ≠ μ 1 ≠μ 2 ≠μ 3

Analysis of Data

Visual Representation Data Job Submission Trial Time in Seconds

Summary, Conclusions, and Recommendations

Conclusions based off Statistical Analysis of the Data Anova: Single Factor SUMMARY GroupsCountSumAverageVariance ECSU MATLAB ® IU MATLAB ® TORQUE ANOVA Source of VariationSSdfMSFP-valueF crit Between Groups E Within Groups Total

Visual Representation Data

Challenges MATLAB ® complier ▫Libraries TORQUE on Madogo ▫No user shared home directory ▫No shared ssh keys

Future works Create standalone applications using MATLAB® Research why TORQUE submissions were slower Direct comparisons of the clusters MATLAB ® Distributed Computing Toolkit vs. using TORQUE to access MATLAB ® Test using CSARP-Lite

Acknowledgements William Blake of the University of Kansas MathWorks Support Team Je’aime Powell Jefferson Davis of Indiana University