Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing.

Slides:



Advertisements
Similar presentations
Network II.5 simulator ..
Advertisements

LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
TeraGrid Deployment Test of Grid Software JP Navarro TeraGrid Software Integration University of Chicago OGF 21 October 19, 2007.
1 OBJECTIVES To generate a web-based system enables to assemble model configurations. to submit these configurations on different.
: Executable Extensions of the Bookshelf Igor Markov University of Michigan, EECS DARPA.
ProActive Task Manager Component for SEGL Parameter Sweeping Natalia Currle-Linde and Wasseim Alzouabi High Performance Computing Center Stuttgart (HLRS),
Technical Architectures
It’s always better live. MSDN Events Security Best Practices Part 2 of 2 Reducing Vulnerabilities using Visual Studio 2008.
Design of Web-based Systems IS Development: lecture 10.
March 2002 update for GSRC Igor L. Markov University of Michigan.
MIT iCampus iLabs Software Architecture Workshop June , 2006.
DUSD(Labs) GSRC bX update December 2002 Aaron Ng, Marius Eriksen and Igor Markov University of Michigan.
Vending Machine FSM Benjamin Welton 03/20/2010 CS 480.
“Bookshelf.exe”: Executable Extensions of the Bookshelf Igor Markov University of Michigan, EECS DARPA.
Progress Report 11/1/01 Matt Bridges. Overview Data collection and analysis tool for web site traffic Lets website administrators know who is on their.
CS CS 5150 Software Engineering Lecture 13 System Architecture and Design 1.
Introduction to Web Based Application. Web-based application TCP/IP (HTTP) protocol Using WWW technology & software Distributed environment.
The World Wide Web and the Internet Dr Jim Briggs 1WUCM1.
Stanford University / PEER K.H. Law and J. Peng Law, Peng 2000 A Software Platform for Collaborative Development of OpenSees Jun Peng and Kincho H. Law.
Systems Architecture, Fourth Edition1 Internet and Distributed Application Services Chapter 13.
Jun Peng Stanford University – Department of Civil and Environmental Engineering Nov 17, 2000 DISSERTATION PROPOSAL A Software Framework for Collaborative.
CGI Programming: Part 1. What is CGI? CGI = Common Gateway Interface Provides a standardized way for web browsers to: –Call programs on a server. –Pass.
Talend 5.4 Architecture Adam Pemble Talend Professional Services.
TOPIC 1 – SERVER SIDE APPLICATIONS IFS 234 – SERVER SIDE APPLICATION DEVELOPMENT.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
INTRODUCTION TO WEB DATABASE PROGRAMMING
NETWORK CENTRIC COMPUTING (With included EMBEDDED SYSTEMS)
Beyond DHTML So far we have seen and used: CGI programs (using Perl ) and SSI on server side Java Script, VB Script, CSS and DOM on client side. For some.
1 HTML and CGI Scripting CSC8304 – Computing Environments for Bioinformatics - Lecture 10.
CSS/417 Introduction to Database Management Systems Workshop 5.
GDT V5 Web Services. GDT V5 Web Services Doug Evans and Detlef Lexut GDT 2008 International User Conference August 10 – 13  Lake Las Vegas, Nevada GDT.
OracleAS Reports Services. Problem Statement To simplify the process of managing, creating and execution of Oracle Reports.
ITIS 1210 Introduction to Web-Based Information Systems Chapter 23 How Web Host Servers Work.
K. Harrison CERN, 20th April 2004 AJDL interface and LCG submission - Overview of AJDL - Using AJDL from Python - LCG submission.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
Network Monitoring Through Mobile (MOBTOP) Developed By : Akanksha Jain. (102199) Deepika Reddy (102210) Team Name: Beans Guided By: Prof. Robert Zhu SUBMITTED.
An application architecture specifies the technologies to be used to implement one or more (and possibly all) information systems in terms of DATA, PROCESS,
Mainframe (Host) - Communications - User Interface - Business Logic - DBMS - Operating System - Storage (DB Files) Terminal (Display/Keyboard) Terminal.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Giuseppe Codispoti INFN - Bologna Egee User ForumMarch 2th BOSS: the CMS interface for job summission, monitoring and bookkeeping W. Bacchi, P.
Database Systems: Design, Implementation, and Management Eighth Edition Chapter 14 Database Connectivity and Web Technologies.
1 MSCS 237 Overview of web technologies (A specific type of distributed systems)
Overview Web Session 3 Matakuliah: Web Database Tahun: 2008.
INTRODUCTION TO WEB APPLICATION Chapter 1. In this chapter, you will learn about:  The evolution of the Internet  The beginning of the World Wide Web,
IS-907 Java EE World Wide Web - Overview. World Wide Web - History Tim Berners-Lee, CERN, 1990 Enable researchers to share information: Remote Access.
INFSO-RI Enabling Grids for E-sciencE Ganga 4 – The Ganga Evolution Andrew Maier.
Module: Software Engineering of Web Applications Chapter 2: Technologies 1.
Simple Object Access Protocol
ASP. ASP is a powerful tool for making dynamic and interactive Web pages An ASP file can contain text, HTML tags and scripts. Scripts in an ASP file are.
WWW4MAIL Past, present and future Onime, Clement E Scientific Computing Section The Abdus Salam ICTP Trieste, Italy.
Online Voting System by Sanghun Chi ECE345. Introduction Traditional voting system inefficient. Takes time and human resources. Does not give an instant.
NCBI Grid Presentation. NCBI Grid Structure NetCache NetSchedule Load Balancer (LBSM) Load Balancer (LBSM) Worker Nodes CGI Gateway.
A System for Monitoring and Management of Computational Grids Warren Smith Computer Sciences Corporation NASA Ames Research Center.
6/28/ A global mesh of interconnected networks (internetworks) meets these human communication needs. Some of these interconnected networks are.
Python Driven Sensor Observation Service Benjamin Welton NASA USRP.
1 Chapter 1 INTRODUCTION TO WEB. 2 Objectives In this chapter, you will: Become familiar with the architecture of the World Wide Web Learn about communication.
Internet/Web Databases
BOSS: the CMS interface for job summission, monitoring and bookkeeping
BOSS: the CMS interface for job summission, monitoring and bookkeeping
Tiers vs. Layers.
NetChat Communications Framework
Production Manager Tools (New Architecture)
Production client status
Web Application Development Using PHP
DIBBs Brown Dog BDFiddle
Intro to Web Services Consuming the Web.
Presentation transcript:

Bookshelf.EXE - BX A dynamic version of Bookshelf –Automatic submission of algorithm implementations, data and benchmarks into database Distributed computing –Distribution of execution of algorithms Scripting with data dependencies –Allows for control and data flows for a sequence of executed algorithm implementations

Bookshelf.EXE - BX Nomenclature –Vicereine; main controlling server software –Diplomat; client (computational hosts) software Network backend –XML RPC RPC standard –XML data encoding –HTTP network transport C/C++, Perl, Python, etc. compatible All communications between modules Key: Implemented In progress

Web interface –PERL CGI; communicates to BX via XML RPC –Preliminary interface: –Submit job and data –Results Bookshelf.EXE – BX

Scheduler –Basic “least load” scheduler Plan: Add several heuristics as provided by user Data logistics and storage –Berkeley DB2 backend for internal state –NFS for network transport Plan: A URL scheme to specify locations Data consistency –Callbacks/delegations from server

Bookshelf.EXE Data properties –Executables Architecture, binary format Input and output formats –Data/Benchmarks MIME-like type –Creates affinity with executables Current client (Diplomat) functionality –Start job, kill job, query client Current server (Vicereine) functionality –Authenticate (insecure), start job, kill job, submit executable, submit benchmark

Bookshelf.EXE – BX Architecture overview: