UlabGrid Framework for Computationally Intensive Remote and Collaborative Learning Laboratories O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo,

Slides:



Advertisements
Similar presentations
Building a CFD Grid Over ThaiGrid Infrastructure Putchong Uthayopas, Ph.D Department of Computer Engineering, Faculty of Engineering, Kasetsart University,
Advertisements

Prof. Natalia Kussul, PhD. Andrey Shelestov, Lobunets A., Korbakov M., Kravchenko A.
High Performance Computing Course Notes Grid Computing.
MTA SZTAKI Hungarian Academy of Sciences Grid Computing Course Porto, January Introduction to Grid portals Gergely Sipos
DataGrid is a project funded by the European Union 22 September 2003 – n° 1 EDG WP4 Fabric Management: Fabric Monitoring and Fault Tolerance
Cracow Grid Workshop, November 5-6, 2001 Towards the CrossGrid Architecture Marian Bubak, Marek Garbacz, Maciej Malawski, and Katarzyna Zając.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
1 GRID D. Royo, O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Universitat Politècnica de Catalunya.
On-Demand Media Streaming Over the Internet Mohamed M. Hefeeda, Bharat K. Bhargava Presented by Sam Distributed Computing Systems, FTDCS Proceedings.
Catnet “Catallactic Mechanisms for Service Control and Resource Allocation in Large Scale Dynamic Application Networks” EU project: IST Partners:
Picture Users Making Art Chat An interactive communication tool.
EJSApp: Using Virtual and Remote Laboratories in Moodle Luis de la Torre 1, Ruben Heradio 2, José Sánchez 1, Sebastian Dormido 1 1 Dept. of Computer Science.
Massive Ray Tracing in Fusion Plasmas on EGEE J.L. Vázquez-Poletti, E. Huedo, R.S. Montero and I.M. Llorente Distributed Systems Architecture Group Universidad.
A Web Services Based Streaming Gateway for Heterogeneous A/V Collaboration Hasan Bulut Computer Science Department Indiana University.
23 September 2004 Evaluating Adaptive Middleware Load Balancing Strategies for Middleware Systems Department of Electrical Engineering & Computer Science.
Collaboration and Grid Technologies Parvati Dev, PhD Director, SUMMIT Stanford University School of Medicine.
SUN HPC Consortium, Heidelberg 2004 Grid(Lab) Resource Management System (GRMS) and GridLab Services Krzysztof Kurowski Poznan Supercomputing and Networking.
ULabGrid, an infrastructure to develop distant laboratories for undergraduate students over a Grid O.Ardiaz, D.Royo et al. Dept. of Computer Architecture.
National Center for Supercomputing Applications The Computational Chemistry Grid: Production Cyberinfrastructure for Computational Chemistry PI: John Connolly.
2008/2/191 Customizing a Geographical Routing Protocol for Wireless Sensor Networks Proceedings of the th International Conference on Information.
Testovid - an environment for testing almost any aspect of student assignments I. Pribela, S. Tošić, M. Ivanović, Z. Budimac Risan, September 2007.
Active Monitoring in GRID environments using Mobile Agent technology Orazio Tomarchio Andrea Calvagna Dipartimento di Ingegneria Informatica e delle Telecomunicazioni.
Data Analysis using Java Mobile Agents Mark Dönszelmann, Information, Process and Technology Group, IT, CERN ATLAS Software Workshop Analysis Tools Meeting,
Topaz : A GridFTP extension to Firefox M. Taufer, R. Zamudio, D. Catarino, K. Bhatia, B. Stearn University of Texas at El Paso San Diego Supercomputer.
What is Cyberinfrastructure? Russ Hobby, Internet2 Clemson University CI Days 20 May 2008.
Loosely Coupled Parallelism: Clusters. Context We have studied older archictures for loosely coupled parallelism, such as mesh’s, hypercubes etc, which.
Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.
ACMSE’04, ALDepartment of Electrical and Computer Engineering - UAH Execution Characteristics of SPEC CPU2000 Benchmarks: Intel C++ vs. Microsoft VC++
An Overlay Network Providing Application-Aware Multimedia Services Maarten Wijnants Bart Cornelissen Wim Lamotte Bart De Vleeschauwer.
The Grid computing Presented by:- Mohamad Shalaby.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Advanced Spectrum Management in Multicell OFDMA Networks enabling Cognitive Radio Usage F. Bernardo, J. Pérez-Romero, O. Sallent, R. Agustí Radio Communications.
Measuring Interactive Performance with VNCplay Nickolai Zeldovich, Ramesh Chandra Stanford University.
Institute For Digital Research and Education Implementation of the UCLA Grid Using the Globus Toolkit Grid Center’s 2005 Community Workshop University.
Commodity Grid Kits Gregor von Laszewski (ANL), Keith Jackson (LBL) Many state-of-the-art scientific applications, such as climate modeling, astrophysics,
A Collaborative Framework for Scientific Data Analysis and Visualization Jaliya Ekanayake, Shrideep Pallickara, and Geoffrey Fox Department of Computer.
GVis: Grid-enabled Interactive Visualization State Key Laboratory. of CAD&CG Zhejiang University, Hangzhou
The Earth System Grid (ESG) Computer Science and Technologies DOE SciDAC ESG Project Review Argonne National Laboratory, Illinois May 8-9, 2003.
Cactus/TIKSL/KDI/Portal Synch Day. Agenda n Main Goals:  Overview of Cactus, TIKSL, KDI, and Portal efforts  present plans for each project  make sure.
BOINC: Progress and Plans David P. Anderson Space Sciences Lab University of California, Berkeley BOINC:FAST August 2013.
Enabling e-Research in Combustion Research Community T.V Pham 1, P.M. Dew 1, L.M.S. Lau 1 and M.J. Pilling 2 1 School of Computing 2 School of Chemistry.
Mantid Stakeholder Review Nick Draper 01/11/2007.
A Grid-enabled Multi-server Network Game Architecture Tianqi Wang, Cho-Li Wang, Francis C.M.Lau Department of Computer Science and Information Systems.
Globus and PlanetLab Resource Management Solutions Compared M. Ripeanu, M. Bowman, J. Chase, I. Foster, M. Milenkovic Presented by Dionysis Logothetis.
Networking: Applications and Services Antonia Ghiselli, INFN Stu Loken, LBNL Chairs.
Simula Research Laboratory Lokaliteter & Forskning
Tool Integration with Data and Computation Grid “Grid Wizard 2”
EGEE-II INFSO-RI Enabling Grids for E-sciencE Storage Accounting for Grid Environments Fabio Scibilia INFN - Catania.
Miron Livny Computer Sciences Department University of Wisconsin-Madison Condor and (the) Grid (one of.
Amsterdam December 4-6, 2006 eScience 2006 A Grid-based Architecture for the Composition and the Execution of Remote Interactive Measurements Andrea BagnascoAriannaPoggi,
Migrating Desktop Uniform Access to the Grid Marcin Płóciennik Poznan Supercomputing and Networking Center Poland EGEE’08 Conference, Istanbul, 24 Sep.
Architecture for Resource Allocation Services Supporting Interactive Remote Desktop Sessions in Utility Grids Vanish Talwar, HP Labs Bikash Agarwalla,
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
Wednesday NI Vision Sessions
ENEA GRID & JPNM WEB PORTAL to create a collaborative development environment Dr. Simonetta Pagnutti JPNM – SP4 Meeting Edinburgh – June 3rd, 2013 Italian.
Installation Guacamole Is a web application that provides access to desktop environments using remote desktop protocols (such as VNC or RDP); Installation.
When you cannot be there Remote access and collaboration Raul Suarez Dec 2009.
Virtual Network Computing
Clouds , Grids and Clusters
Globus —— Toolkits for Grid Computing
VirtualGL.
Collaborations and Interactions with other Projects
Grid Computing.
Comparison of LAN, MAN, WAN
Wide Area Workload Management Work Package DATAGRID project
Experiences in Running Workloads over OSG/Grid3
New Tools In Education Minjun Wang
Simulation for Cache Mesh Design
L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher
Presentation transcript:

UlabGrid Framework for Computationally Intensive Remote and Collaborative Learning Laboratories O. Ardaiz, L. Díaz de Cerio, R. Meseguer, A. Gallardo, K. Sanjeevan Computer Architecture Department Politecnic University Catalunya, Spain

Outline Out botton-up approach. Taking advantage of grid. Ulab framework. Experimentation. Future Work.

Our Botton-up approach Objetive: “develope new collaborative learning applications of grid technology” First step: deploy Grid testbed.  Linux resources, GTK2.4, GT3.0, mini-CA. Second step: evaluate grid technology capabilities.  Test demo application, develop small scientific application. Third step: Look for collaborative learning applications that can benefit for grid.  In our teaching (programming, computer networking), in nearby schools (aeronautics engineering school). Fourth step: Implement and evaluate.

Taking advantage of Grids ¿New educational applications, methods,…? ¿Students learning to use scientist new grid tools, or learning while using them?  Grid.edu Workshop. Equal benefits as scientists:  Resource sharing for “cost” sharing: Reducing education costs is good.  Computationally intensive applications: Computer network simulator, (but to learn networking, only small simulations are required) 3D flight simulator, graphical 3D simulations consume 100% CPU ---->Lets try it!!!!

Ulab Framework We are not interested in a particular application, but to provide support for multiple collaborative application ->  Design a framework, “generic libraries to develop applications”. Requirements:  Built on “de facto” grid standards: -> Use GTK2.4.  Use some existing application code: -> Gridification of applications.  “thin” clients for remote visualization and interaction: -> Use VNCviewer.  Support for collaborative learning groups: ->Implement session manager.

GSIFTPServer Globus-Gatekeeper Pentium IV pcmartino.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc3.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc5.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc4.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc6.ac.upc.es ULab Grid VNC Protocol Grid-Proxy GassServer GlobusPortal User Directory File Server Pcribes.ac..upc.es ReplicaMgr MetadataDirector yServer Session Manager Grid Manager GSIFTPServer avant.upc.es GSIFTP Protocol GRAM Protocol Session Control Protocol Ulab Framework (I): VNC for app access Student 1 VNC client Session client App1 App2 App3 Student 2 VNC client Session client App1 App2 App3 %VNC-server:1 %FS &

GSIFTPServer Globus-Gatekeeper Pentium IV pcmartino.ac.upc.es %Vnc-server:1 %FS & GSIFTPServer Globus-Gatekeeper Pentium IV pc3.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc5.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc4.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc6.ac.upc.es ULab Grid VNC Protocol (Session 1) Grid-Proxy GassServer GlobusPortal User Directory File Server Pcribes.ac..upc.es ReplicaMgr MetadataDirector yServer Session Manager Grid Manager GSIFTPServer avant.upc.es GSIFTP Protocol GRAM Protocol Session Control Protocol Ulab Framework(II): Multiple application access Student 1 VNC client Session client App1 App2 App3 Student 2 VNC client Session client App1 App2 App3 %VNC-server:1 %FS & VNC Protocol (Session 2) %VNC-server:1 %Net-Sim-2 &

GSIFTPServer Globus-Gatekeeper Pentium IV pcmartino.ac.upc.es %Vnc-server:1 %FS & GSIFTPServer Globus-Gatekeeper Pentium IV pc3.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc5.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc4.ac.upc.es GSIFTPServer Globus-Gatekeeper Pentium IV pc6.ac.upc.es ULab Grid VNC Protocol (Session 1) Grid-Proxy GassServer GlobusPortal User Directory File Server Pcribes.ac..upc.es ReplicaMgr MetadataDirector yServer Session Manager Grid Manager GSIFTPServer avant.upc.es GSIFTP Protocol GRAM Protocol Session Control Protocol Ulab Framework (III): Visual Session Sharing Student 1 VNC client Session client App1 App2 App3 Student 2 VNC client Session client App1 App2 App3 %VNC-server:1 %FS & VNC Protocol (Session 2) %VNC-server:1 %Net-Sim-2 & Student 1 Co-pilot Observe

Implementation Session manager:  Several applications available to each student,  Students can share applications,  Several students on same session, Resource manager:  All grid resources available to each student,  Controls resource status and implements resource scheduling,  Control resources used by each student, “Comunication between Rsc Mgr and Session Mgr permits to share sessions”.

Experiment Results (I) Globus Toolkit:  GTK2.4 is OK,  GTK3.0 takes upto 20 seconds to launch processes. Gridification Flight Simulator :  only required an scriptable configuration file.  Special VNC server for OpenGL application: xf4vnc. Resource usage:  High network traffic: peaks of 12 Mbits, average of 1Mbit.  CPU consumption: VNCserver requires CPU to compress data.

Experiment Results (II) Collaborative learning sessions:  Session manager also provides chat rooms.  VNC permits to share screen.  Mouse sharing modes: 1 user controls, shared control. 2 students piloting same aircraft. 1 student piloting + 1 instructor observing.

Further Work (I) Scheduling algorithm for interactive applications:  Network latency and BW between grid nodes and clients has to be taken into account. Session migration:  If a node fails, state of flight session must be transfered. Pedagogical evaluation:  Experiments with students in a real course.  Problems they find.

Further Work (II) Servidor 1Servidor 2 Servidor 4 Servidor 3 Client 1 VNC Divide rendering between “n” grid nodes:  Paralelise application.  VNC client receiving “n” screens.

Further requirements (after talking with some teachers) Demand resources in advance:  “Tomorrow there will be a session at 9 AM”. Save student sessions and logs for:  Re-playing sessions to learn from previous errors.  Student evaluation. Only for flight learning:  Coordination among several planes on same air space.

Other applications grids for bio-chemistry students.  Molecular docking,  and remote 3-D visualization.

Conclusions Some work need for a functional framework:  Interactive scheduling algorithm, A lot more work for an operational system:  Students are very demanding: if something fails, learning session has to post-pone. To collaborate, us:  Your students use a CPU-intensive app.  Find educational applications of your grid. Thanks for your attention !!!!