Economic and On Demand Brain Activity Analysis on Global Grids A case study.

Slides:



Advertisements
Similar presentations
A Lightweight Platform for Integration of Mobile Devices into Pervasive Grids Stavros Isaiadis, Vladimir Getov University of Westminster, London {s.isaiadis,
Advertisements

Nimrod/G GRID Resource Broker and Computational Economy
Pricing for Utility-driven Resource Management and Allocation in Clusters Chee Shin Yeo and Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS)
Designing Services for Grid-based Knowledge Discovery A. Congiusta, A. Pugliese, Domenico Talia, P. Trunfio DEIS University of Calabria ITALY
Kensington Oracle Edition: Open Discovery Workflow Meets Oracle 10g Professor Yike Guo.
SLA-Oriented Resource Provisioning for Cloud Computing
1 Project Overview EconomyGrid Economic Paradigm For “Resource Management and Scheduling” for Service-Oriented Grid Computing Presenter Name: Sama GovindaRamanujam.
Building a Distributed Full-Text Index for the Web S. Melnik, S. Raghavan, B.Yang, H. Garcia-Molina.
High Performance Parametric Modeling with Nimrod/G: A Killer Application for the Global Grid ? David Abramson, Jon Giddy and Lew Kotler Presentation By:
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
Resource Management of Grid Computing
Universität Dortmund Robotics Research Institute Information Technology Section Grid Metaschedulers An Overview and Up-to-date Solutions Christian.
Aneka: A Software Platform for .NET-based Cloud Computing
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
CSS434 Grid Computing1 Textbook No Corresponding Chapters Professor: Munehiro Fukuda A portion of these slides were compiled from The Grid: Blueprint for.
MASPLAS ’02 Creating A Virtual Computing Facility Ravi Patchigolla Chris Clarke Lu Marino 8th Annual Mid-Atlantic Student Workshop On Programming Languages.
Understanding Operating Systems 1 Overview Introduction Operating System Components Machine Hardware Types of Operating Systems Brief History of Operating.
Institut für Softwarewissenschaft - Universität WienP.Brezany 1 Toward Knowledge Discovery in Databases Attached to Grids Peter Brezany Institute for Software.
Workload Management Massimo Sgaravatto INFN Padova.
On Fairness, Optimizing Replica Selection in Data Grids Husni Hamad E. AL-Mistarihi and Chan Huah Yong IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,
EMBEDDED SOFTWARE Team victorious Team Victorious.
Computer Science and Engineering A Middleware for Developing and Deploying Scalable Remote Mining Services P. 1DataGrid Lab A Middleware for Developing.
Computer System Lifecycle Chapter 1. Introduction Computer System users, administrators, and designers are all interested in performance evaluation. Whether.
Gridbus Resource Broker for Application Service Costs-based Scheduling on Global Grids: A Case Study in Brain Activity Analysis Srikumar Venugopal 1, Rajkumar.
COLLABORATIVE EXECUTION ENVIRONMENT FOR HETEROGENEOUS PARALLEL SYSTEMS Aleksandar Ili´c, Leonel Sousa 2010 IEEE International Symposium on Parallel & Distributed.
Introduction and Overview Questions answered in this lecture: What is an operating system? How have operating systems evolved? Why study operating systems?
Gridbus Toolkit for Belle Analysis Data Grid and Utility Computing Rajkumar Buyya Grid Computing and Distributed Systems (GRIDS) Lab. Dept. of Computer.
A Lightweight Platform for Integration of Resource Limited Devices into Pervasive Grids Stavros Isaiadis and Vladimir Getov University of Westminster
Nimrod/G GRID Resource Broker and Computational Economy David Abramson, Rajkumar Buyya, Jon Giddy School of Computer Science and Software Engineering Monash.
DISTRIBUTED COMPUTING
Daniel Vanderster University of Victoria National Research Council and the University of Victoria 1 GridX1 Services Project A. Agarwal, A. Berman, A. Charbonneau,
Cloud Distributed Computing Platform 2 Content of this lecture is primarily from the book “Hadoop, The Definite Guide 2/e)
1 678 Topics Covered (1) Part A: Foundation Socket Programming Thread Programming Elements of Parallel Computing Part B: Cluster Computing Elements of.
Young Suk Moon Chair: Dr. Hans-Peter Bischof Reader: Dr. Gregor von Laszewski Observer: Dr. Minseok Kwon 1.
1 520 Student Presentation GridSim – Grid Modeling and Simulation Toolkit.
Nimrod & NetSolve Sathish Vadhiyar. Nimrod Sources/Credits: Nimrod web site & papers.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
A performance evaluation approach openModeller: A Framework for species distribution Modelling.
1 Sergio Maffioletti Grid Computing Competence Center GC3 University of Zurich Swiss Grid School 2012 Develop High Throughput.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
Perspectives on Grid Technology Ian Foster Argonne National Laboratory The University of Chicago.
Job scheduling algorithm based on Berger model in cloud environment Advances in Engineering Software (2011) Baomin Xu,Chunyan Zhao,Enzhao Hua,Bin Hu 2013/1/251.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
CLRC and the European DataGrid Middleware Information and Monitoring Services The current information service is built on the hierarchical database OpenLDAP.
Globus Toolkit Massimo Sgaravatto INFN Padova. Massimo Sgaravatto Introduction Grid Services: LHC regional centres need distributed computing Analyze.
Service-oriented Resource Broker for QoS-Guaranteed in Grid Computing System Yichao Yang, Jin Wu, Lei Lang, Yanbo Zhou and Zhili Sun Centre for communication.
Authors: Rajkumar Buyya, David Abramson & Jonathan Giddy
Aneka Cloud ApplicationPlatform. Introduction Aneka consists of a scalable cloud middleware that can be deployed on top of heterogeneous computing resources.
2. WP9 – Earth Observation Applications ESA DataGrid Review Frascati, 10 June Welcome and introduction (15m) 2.WP9 – Earth Observation Applications.
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Performance guided scheduling in GENIE through ICENI
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-2.
1 Architecture and Behavioral Model for Future Cognitive Heterogeneous Networks Advisor: Wei-Yeh Chen Student: Long-Chong Hung G. Chen, Y. Zhang, M. Song,
Millions of Jobs or a few good solutions …. David Abramson Monash University MeSsAGE Lab X.
Enabling Grids for E-sciencE CMS/ARDA activity within the CMS distributed system Julia Andreeva, CERN On behalf of ARDA group CHEP06.
Euro-Par, HASTE: An Adaptive Middleware for Supporting Time-Critical Event Handling in Distributed Environments ICAC 2008 Conference June 2 nd,
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
Joint Institute for Nuclear Research Synthesis of the simulation and monitoring processes for the data storage and big data processing development in physical.
LIOProf: Exposing Lustre File System Behavior for I/O Middleware
Holding slide prior to starting show. Scheduling Parametric Jobs on the Grid Jonathan Giddy
INTRODUCTION TO GRID & CLOUD COMPUTING U. Jhashuva 1 Asst. Professor Dept. of CSE.
Software Architecture of Sensors. Hardware - Sensor Nodes Sensing: sensor --a transducer that converts a physical, chemical, or biological parameter into.
Workload Management Workpackage
Clouds , Grids and Clusters
GWE Core Grid Wizard Enterprise (
What is Pattern Recognition?
Cloud Distributed Computing Environment Hadoop
Scientific Workflows Lecture 15
Presentation transcript:

Economic and On Demand Brain Activity Analysis on Global Grids A case study

Need for grid Two major problems commonly observed in scientific disciplines: scientific data The distribution of knowledge and technologies

Cont.. One such scientific discipline: Brain science The analysis of brain activity data gathered from the MEG (Magnetoencephalography) instrument is an important research topic in medical science

Introduction computational grids : Aggregations of such distributed resources, called computational grids. Biological science: Brain Activity is one such application Brain activity is measured by the Magnetoencephalography (MEG) measures the magnetic fields generated by the electrical activity in the brain.

Brain Activity Analysis - Advantage of MEG MEG instrument: consists of a number of sensors which record information about brain activity MEG helmets with over 200 sensors detect magnetic brain fields by means of a sensitive transducer technology called Superconducting Quantum Interference Device (SQUID)

limitation The high cost of equipment There are only limited numbers of MEG instruments around the world For example, a 64-sensor MEG instrument would produce 0.9GB of data over a period of an hour. Such a task generates 7,257,600 analysis jobs and would take 102 days on a commodity computer with a PentiumIII/500MHz processor and 256MB of memory.

Grid-based Analysis Model NeuroGrid project aims to convert the existing brain activity analysis application into a parameter sweep application for executing jobs which perform wavelet cross-correlation analysis for each pair of sensors in parallel on distributed resources

A Model for Brain Activity Analysis on Global Grids.

steps: 1. medical staff who is dealing with the diagnosis orders a MEG scan of the patient’s brain 2. request is sent to instrument which takes a MEG scan and collects data about the activity in the brain 3. This data is then collected and presented to the Grid Resource Broker for analyzing on the Grid QOS- deadline and the budget optimization method could be one of the three: cost, time or cost-time. 4,5- data and analysis code are dispatched to remote node and results collected

Architecture

Components parameterization tools (Nimrod-G parameter specification language) resource broker(Nimrod-G with Gridbus scheduler) grid market directory (Gridbus GMD) low-level grid middleware (Globus) Grid Enabling process: resources - Globus software deployed on them. application - parameter sweep application using the Nimrod-G parameter specification language. GMD used as a register for publication of resource providers and services.

Analysis Code developed by the Cybermedia Centre, Osaka University, Japan two phases Phase 1: raw data from the brain goes through wavelet transform operation time-frequency data of the output Phase 2: cross-correlation analysis is performed for each pair of wavelet transforms. output displays the similarity between a pair of brain data for every frequency spectrum.

Wavelet Cross Correlation Analysis

Grid Resource Broker and Scheduler Resource Broker – Nimrod G + Globus middleware. Gridbus Scheduler. performs resource discovery, selection, and dispatching of MEG jobs to remote resources. It also starts and manages the execution of jobs and gathers the results back at the home node. Components of Nimrod G A persistent task farming engine. A grid explorer for resource discovery.

Grid bus Scheduler Plugin scheduler- designed to use GMD. Nimrod G- Processing cost based on CPU Time. GMD allows GSP Ao Service+ Service Price. Gridbus Scheduler resource allocation based on Ao Cost model.

Gridbus Scheduler Algorithms Cost minimization. Time minimization. Cost – Time Optimization. Uses past performance of machines. Average job completion rates.

Grid Market Discovery Allows service providers to publish services with costs. Built on standard web service technologies. Client API.

Grid Enabling The Application Nimrod-G farming engine and dispatcher along with Gridbus scheduler used for deploying and processing it on Global Grids 2 programs. raw2wavelet. wavelet2cross. Meta meg. Time_offset_step.

Pseudo code for meta program

Nimrod –G plan for SPMD..$OS $HOME $HOME/alphawave

Plan file for brain activity analysis on the Grid.

Application Deployment and Evaluation

Scheduling Experiments and Result Deadline= 2 hrs. Budget=1990 Grid $. Summary of Experiment Statistics.

Scheduling with Time Minimization

Scheduling with Cost- optimization

Scheduling with Cost-Time optimization

Visualisation of wavelet analysis results for selected sensors.

Conclusion The economy based approach of processing brain activity data as illustrated in this paper would help in enforcing QoS requirements of medical applications Hence would enable adoption of Grid technologies by the bio-instrumentation field.