The ATHA Environment: Experience with a User Friendly Environment for Opportunistic Computing M.A.R.Dantas Department of Informatics (INE) University of.

Slides:



Advertisements
Similar presentations
A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
Advertisements

SLA-Oriented Resource Provisioning for Cloud Computing
A Dynamic World, what can Grids do for Multi-Core computing? Daniel Goodman, Anne Trefethen and Douglas Creager
Pei Fan*, Ji Wang, Zibin Zheng, Michael R. Lyu Toward Optimal Deployment of Communication-Intensive Cloud Applications 1.
CLOUD COMPUTING AN OVERVIEW & QUALITY OF SERVICE Hamzeh Khazaei University of Manitoba Department of Computer Science Jan 28, 2010.
1 Virtual Machine Resource Monitoring and Networking of Virtual Machines Ananth I. Sundararaj Department of Computer Science Northwestern University July.
FIT3105 Smart card based authentication and identity management Lecture 4.
Performance Evaluation of Load Sharing Policies on a Beowulf Cluster James Nichols Marc Lemaire Advisor: Mark Claypool.
SPRING 2011 CLOUD COMPUTING Cloud Computing San José State University Computer Architecture (CS 147) Professor Sin-Min Lee Presentation by Vladimir Serdyukov.
CLOUD COMPUTING. A general term for anything that involves delivering hosted services over the Internet. And Cloud is referred to the hardware and software.
A.V. Bogdanov Private cloud vs personal supercomputer.
Abstract Load balancing in the cloud computing environment has an important impact on the performance. Good load balancing makes cloud computing more.
Parallel Computing The Bad News –Hardware is not getting faster fast enough –Too many architectures –Existing architectures are too specific –Programs.
STRATEGIES INVOLVED IN REMOTE COMPUTATION
Distributed Systems. Outline  Services: DNSSEC  Architecture Models: Grid  Network Protocols: IPv6  Design Issues: Security  The Future: World Community.
Profiling Grid Data Transfer Protocols and Servers George Kola, Tevfik Kosar and Miron Livny University of Wisconsin-Madison USA.
M.A.Doman Short video intro Model for enabling the delivery of computing as a SERVICE.
Uncovering the Multicore Processor Bottlenecks Server Design Summit Shay Gal-On Director of Technology, EEMBC.
Recap Technology trends Cost/performance Measuring and Reporting Performance What does it mean to say “computer X is faster than computer Y”? E.g. Machine.
Operating Systems. Without an operating system your computer would be useless! A computer contains an Operating System on its Hard Drive. This is loaded.
C++ Programming Language Lecture 1 Introduction By Ghada Al-Mashaqbeh The Hashemite University Computer Engineering Department.
Y. Kotani · F. Ino · K. Hagihara Springer Science + Business Media B.V Reporter: 李長霖.
SUMA: A Scientific Metacomputer Cardinale, Yudith Figueira, Carlos Hernández, Emilio Baquero, Eduardo Berbín, Luis Bouza, Roberto Gamess, Eric García,
Architectures of distributed systems Fundamental Models
Hiding in the Mobile Crowd: Location Privacy through Collaboration.
INVITATION TO COMPUTER SCIENCE, JAVA VERSION, THIRD EDITION Chapter 6: An Introduction to System Software and Virtual Machines.
Evaluation of Agent Teamwork High Performance Distributed Computing Middleware. Solomon Lane Agent Teamwork Research Assistant October 2006 – March 2007.
Example: Sorting on Distributed Computing Environment Apr 20,
Heavy and lightweight dynamic network services: challenges and experiments for designing intelligent solutions in evolvable next generation networks Laurent.
Document Clustering for Forensic Analysis: An Approach for Improving Computer Inspection.
1 Evaluation of Cooperative Web Caching with Web Polygraph Ping Du and Jaspal Subhlok Department of Computer Science University of Houston presented at.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
Nanco: a large HPC cluster for RBNI (Russell Berrie Nanotechnology Institute) Anne Weill – Zrahia Technion,Computer Center October 2008.
Authors – Jeahyuk huh, Doug Burger, and Stephen W.Keckler Presenter – Sushma Myneni Exploring the Design Space of Future CMPs.
Rassul Ayani 1 Performance of parallel and distributed systems  What is the purpose of measurement?  To evaluate a system (or an architecture)  To compare.
6/29/1999PDPTA'991 Performance Prediction for Large Scale Parallel Systems Yuhong Wen and Geoffrey C. Fox Northeast Parallel Architecture Center (NPAC)
Big traffic data processing framework for intelligent monitoring and recording systems 學生 : 賴弘偉 教授 : 許毅然 作者 : Yingjie Xia a, JinlongChen a,b,n, XindaiLu.
COMP381 by M. Hamdi 1 Clusters: Networks of WS/PC.
Different Microprocessors Tamanna Haque Nipa Lecturer Dept. of Computer Science Stamford University Bangladesh.
Copyright ©2003 Dell Inc. All rights reserved. Scaling-Out with Oracle® Grid Computing on Dell™ Hardware J. Craig Lowery, Ph.D. Software Architect and.
Department of Computer Science 6 th Annual Austin CAS Conference – 24 February 2005 Ricardo Portillo, Diana Villa, Patricia J. Teller The University of.
Quality Is in the Eye of the Beholder: Meeting Users ’ Requirements for Internet Quality of Service Anna Bouch, Allan Kuchinsky, Nina Bhatti HP Labs Technical.
HNC COMPUTING - Network Concepts 1 Network Concepts Network Concepts Network Operating Systems Network Operating Systems.
Background Computer System Architectures Computer System Software.
PRAGMA18 Demonstration 2-4 March 2010 Kei Kokubo, Yasuyuki Kusumoto, Susumu Date Osaka University, Cybermedia Center Wen-Wai Yim, Jason Haga Department.
Computer Science and Engineering Parallelizing Feature Mining Using FREERIDE Leonid Glimcher P. 1 ipdps’04 Scaling and Parallelizing a Scientific Feature.
INTRODUCTION TO HIGH PERFORMANCE COMPUTING AND TERMINOLOGY.
BAHIR DAR UNIVERSITY Institute of technology Faculty of Computing Department of information technology Msc program Distributed Database Article Review.
Clouds , Grids and Clusters
Green cloud computing 2 Cs 595 Lecture 15.
CLUSTER COMPUTING Presented By, Navaneeth.C.Mouly 1AY05IS037
Grid Computing.
Design and Implementation of Spacecraft Avionics Software Architecture based on Spacecraft Onboard Interface Services and Packet Utilization Standard Beijing.
Cloud Computing By P.Mahesh
Cloud Computing.
Department of Computer Science University of California, Santa Barbara
Parallel and Multiprocessor Architectures – Shared Memory
Performance of computer systems
CLUSTER COMPUTING.
Chapter 3 Hardware and software 1.
Grid Computing Done by: Shamsa Amur Al-Matani.
Architectures of distributed systems Fundamental Models
Pei Fan*, Ji Wang, Zibin Zheng, Michael R. Lyu
Architectures of distributed systems Fundamental Models
Chapter 3 Hardware and software 1.
By Brandon, Ben, and Lee Parallel Computing.
Architectures of distributed systems
Architectures of distributed systems Fundamental Models
Department of Computer Science University of California, Santa Barbara
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

The ATHA Environment: Experience with a User Friendly Environment for Opportunistic Computing M.A.R.Dantas Department of Informatics (INE) University of Santa Catarina (UFSC) – Florianopolis – Brazil A. Hosken Department of Computer Science (CIC) University of Brasilia (UnB) Brasilia – Brazil

Agenda I.RESEARCH MOTIVATION II.OPPORTUNISTIC COMPUTING III.The ATHA ENVIRONMENT IV.EXPERIMENTAL RESULTS V.CONCLUSIONS AND FUTURE WORK

Agenda I.RESEARCH MOTIVATION II.OPPORTUNISTIC COMPUTING III.The ATHA ENVIRONMENT IV.EXPERIMENTAL RESULTS V.CONCLUSIONS AND FUTURE WORK

I.RESEARCH MOTIVATION It is observed that the number of computers connected to the Internet is growing for a long period of time ; Researches mentions that it is difficult to estimate when this trend will reverse; Similar to the Internet, the same phenomenon is verified inside several organisations; Many researchers investigate the possibility of using a large amount of resources as a useful metacomputer.

I.RESEARCH MOTIVATION Several distributed packages have demonstrated the efficiency to execute complex problems, even considering the ordinary Internet as a distributed computing configuration; It is interesting to observe that some aspects of the computational environment, such as latency of the network and co-execution of processes, may preclude the use of opportunistic computing for certain applications.

The opportunistic computing approach considers the use of spare computational resources to execute applications which could not be solved locally. The main goal of this paradigm is to gather available heterogeneous distributed resources in computer network environments to execute distributed and/or parallel applications. I.RESEARCH MOTIVATION

In this talk, we present experience with a user friendly environment for opportunistic computing for parallel and distributed applications in a computer network. The configuration is called as ATHA. I.RESEARCH MOTIVATION

Agenda I.RESEARCH MOTIVATION II.OPPORTUNISTIC COMPUTING III.The ATHA ENVIRONMENT IV.EXPERIMENTAL RESULTS V.CONCLUSIONS AND FUTURE WORK

II - OPPORTUNISTIC COMPUTING In the literature it is possible to find several research projects, where the main focus is the efficient utilization of spare loosely couple resources. These projects different from a cluster (or grid) approach target to gather available disposable computing resources from users (i.e. other users and organizations) free of charge. In other words, when we consider the use of a cluster (or a grid) configuration we understand that we pay for it.

II - OPPORTUNISTIC COMPUTING In the opportunistic approach we plan to execute our applications considering available spare resources from other users. This approach can be interesting even inside an organization, using the private Internet of the institution. In addition to that, it is important to mention that some patterns are required for this utilization. Special parameters such as operating system, memory and disk space requirements are some metrics that an opportunistic framework needs to address. The goal is to have enough information to form dynamic configurations to execute parallel applications.

Agenda I.RESEARCH MOTIVATION II.OPPORTUNISTIC COMPUTING III.The ATHA ENVIRONMENT IV.EXPERIMENTAL RESULTS V.CONCLUSIONS AND FUTURE WORK

III - The ATHA ENVIRONMENT The ATHA environment for opportunistic computing is an enhanced configuration based in our previous research work. In the configuration we use Java language, because of the portability and it allows some interesting classes (e.g. JCE, Java cryptography extension) that help with digital signature and cryptography.

ATHA environment for opportunistic computing

Following our initial goal, we built an interface which could allow users to submit several services to servers, examples are: process new tasks, gather load information, provide information of executed applications, inform about the system availability.

The main ATHA interface

Agenda I.RESEARCH MOTIVATION II.OPPORTUNISTIC COMPUTING III.The ATHA ENVIRONMENT IV.EXPERIMENTAL RESULTS V.CONCLUSIONS AND FUTURE WORK

In order to verify our proposed opportunistic framework, we tested the package in a large organization during a daytime period. The target was to gather as much as possible spare machines to execute the RSAChallenge parallel application. IV - EXPERIMENTAL RESULTS

The Distributed Environment Processor ArchitectureIA32 Clocks450,700,800,1800 MHz Cache512kB Memory64,128, 256 MB Switch Throughput MBPS Operating SystemsWindows 98, 2000 e XP

One feature that is present in the ATHA interface is a non intrusion characteristic for the owner of local resources. In other words, we avoided disturbing owners of the available resources. Therefore, we start to apply this concept executing a serial Linpack benchmark to provide each machine with a weight parameter for performance. In other words, we built a table of load indices for the machines of the environment. Next figure shows individual performance of processors that we choose to gather resources.

The next figure presents some details when machines enter into the pool of available resources (i.e. idle status), and when these computers become heavy loaded (i.e. busy) to execute our benchmark. It is interesting to note that the ATHA environment considers every available machine when it was possible to provide computation aggregation. However, when a local user starts to use their machines the processor was no longer consider into the configuration.

The amount of keys that were tested are shown in the next figure, considering the use of our opportunistic approach. This figure illustrates that we were able to test more then a million keys of the RSAChallenge parallel application. Without the ATHA environment a special (or dedicated) machine should be available to execute this application. The environment was able to process at a peak a number of million and seven thousand keys.

Agenda I.RESEARCH MOTIVATION II.OPPORTUNISTIC COMPUTING III.The ATHA ENVIRONMENT IV.EXPERIMENTAL RESULTS V.CONCLUSIONS AND FUTURE WORK

The ATHA environment has proved to be successful executing a parallel application in a real organization and obtained interesting results. As an improvement for the framework we are building new mechanisms to analyze more precisely workloads of the machines. CONCLUSIONS

We are considering : execute several other applications from the organization; a version of the ATHA framework for executing in mobile devices; FUTURE WORK

Questions ?