PGP Grid NeSC Review 18 March 2004. Description and Aims Apply real time 3D vision technology to animation production. Apply remote parallel processing.

Slides:



Advertisements
Similar presentations
GridPP July 2003Stefan StonjekSlide 1 SAM middleware components Stefan Stonjek University of Oxford 7 th GridPP Meeting 02 nd July 2003 Oxford.
Advertisements

Distributed Data Processing
Linn OHLSSON, IATI Secretariat Rudolphe PETRAS, Development Co-operation Directorate, OECD IATI Steering Committee, 3 October 2013 The Common Standard.
1 RUP Workshop By George Merguerian Senior Partner Business Management Consultants
1 GRID Workshop – Toulouse IAS – October 20th Ground segment & products Department Globus TK4 experiment for image data processing : security architecture,
David Adams ATLAS DIAL Distributed Interactive Analysis of Large datasets David Adams BNL March 25, 2003 CHEP 2003 Data Analysis Environment and Visualization.
Minimum intrusion GRID. Build one to throw away … So, in a given time frame, plan to achieve something worthwhile in half the time, throw it away, then.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
Minimum intrusion GRID. Build one to throw away … So, in a given time frame, plan to achieve something worthwhile in half the time, throw it away, then.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
Lecture 2 Web application architecture. Themes Architecture : The large scale structure of a system, especially a computer system Design choice: The need.
K.Harrison CERN, 23rd October 2002 HOW TO COMMISSION A NEW CENTRE FOR LHCb PRODUCTION - Overview of LHCb distributed production system - Configuration.
Business Intelligence Dr. Mahdi Esmaeili 1. Technical Infrastructure Evaluation Hardware Network Middleware Database Management Systems Tools and Standards.
Globus Computing Infrustructure Software Globus Toolkit 11-2.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse 2.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
BaBar WEB job submission with Globus authentication and AFS access T. Adye, R. Barlow, A. Forti, A. McNab, S. Salih, D. H. Smith on behalf of the BaBar.
Databases and the Internet. Lecture Objectives Databases and the Internet Characteristics and Benefits of Internet Server-Side vs. Client-Side Special.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
Chapter 6 Operating System Support. This chapter describes how middleware is supported by the operating system facilities at the nodes of a distributed.
Robot Autonomous Perception Model For Internet-Based Intelligent Robotic System By Sriram Sunnam.
Grid Computing - AAU 14/ Grid Computing Josva Kleist Danish Center for Grid Computing
GT Components. Globus Toolkit A “toolkit” of services and packages for creating the basic grid computing infrastructure Higher level tools added to this.
PGP Grid NeSC Review May Description and Aims Apply real time 3D vision technology to animation production. Apply remote parallel processing to.
1 EPCC Sun Data and Compute Grids Project Using Sun Grid Engine and Globus to Schedule Jobs Across a Combination of Local.
3rd June 2004 CDF Grid SAM:Metadata and Middleware Components Mòrag Burgon-Lyon University of Glasgow.
QCDGrid Progress James Perry, Andrew Jackson, Stephen Booth, Lorna Smith EPCC, The University Of Edinburgh.
Tanenbaum & Van Steen, Distributed Systems: Principles and Paradigms, 2e, (c) 2007 Prentice-Hall, Inc. All rights reserved DISTRIBUTED SYSTEMS.
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
Unit – I CLIENT / SERVER ARCHITECTURE. Unit Structure  Evolution of Client/Server Architecture  Client/Server Model  Characteristics of Client/Server.
Topaz : A GridFTP extension to Firefox M. Taufer, R. Zamudio, D. Catarino, K. Bhatia, B. Stearn University of Texas at El Paso San Diego Supercomputer.
DataGrid Applications Federico Carminati WP6 WorkShop December 11, 2000.
© 2008 Open Grid Forum Independent Software Vendor (ISV) Remote Computing Primer Steven Newhouse.
DORII Joint Research Activities DORII Joint Research Activities Status and Progress 6 th All-Hands-Meeting (AHM) Alexey Cheptsov on.
1 st December 2003 JIM for CDF 1 JIM and SAMGrid for CDF Mòrag Burgon-Lyon University of Glasgow.
1 st -4 th December st BioXHIT Annual Meeting WorkPackage 5.2: Implementation of Data management and Project Tracking in Structure Solution Peter.
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
Introduction to dCache Zhenping (Jane) Liu ATLAS Computing Facility, Physics Department Brookhaven National Lab 09/12 – 09/13, 2005 USATLAS Tier-1 & Tier-2.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
Responsibilities of ROC and CIC in EGEE infrastructure A.Kryukov, SINP MSU, CIC Manager Yu.Lazin, IHEP, ROC Manager
GridPP Deployment & Operations GridPP has built a Computing Grid of more than 5,000 CPUs, with equipment based at many of the particle physics centres.
出處 :2010 2nd International Conference on Signal Processing Systems (ICSPS) 作者 :Zhidong Shen 、 Qiang Tong 演講者 : 碩研資管一甲 吳俊逸.
28 March 2001F Harris LHCb Software Week1 Overview of GGF1 (Global Grid Forum) and Datagrid meeting, NIKHEF, Mar 5-9 F Harris(Oxford)
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
1 Media Grid Initiative By A/Prof. Bu-Sung Lee, Francis Nanyang Technological University.
End-to-End Efficiency (E 3 ) Integrating Project of the EC 7 th Framework Programme General View of the E3 Prototyping Environment for Cognitive and Self-x.
PGP Project Viktor Yarmolenko Lewis Mackenzie Paul Cockshott Ewan Borland.
Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.
Introduction to Grids By: Fetahi Z. Wuhib [CSD2004-Team19]
Website: Answering Continuous Queries Using Views Over Data Streams Alasdair J G Gray Werner.
Portal Update Plan Ashok Adiga (512)
JS (Java Servlets). Internet evolution [1] The internet Internet started of as a static content dispersal and delivery mechanism, where files residing.
AMQP, Message Broker Babu Ram Dawadi. overview Why MOM architecture? Messaging broker like RabbitMQ in brief RabbitMQ AMQP – What is it ?
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Securing the Grid & other Middleware Challenges Ian Foster Mathematics and Computer Science Division Argonne National Laboratory and Department of Computer.
Data Transfer Service Challenge Infrastructure Ian Bird GDB 12 th January 2005.
10 May 2001WP6 Testbed Meeting1 WP5 - Mass Storage Management Jean-Philippe Baud PDP/IT/CERN.
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
INFSOM-RI ETICS: E-infrastructure for Testing, Integration and Configuration of Software Alberto Di Meglio Project Manager.
Shibboleth Use at the National e-Science Centre Hub Glasgow at collaborating institutions in the Shibboleth federation depending.
INFSO-RI Enabling Grids for E-sciencE File Transfer Software and Service SC3 Gavin McCance – JRA1 Data Management Cluster Service.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
#01 Client/Server Computing
LO2 - Be Able to Design IT Systems to Meet Business Needs
Technical Capabilities
Wide Area Workload Management Work Package DATAGRID project
Grid Computing Software Interface
#01 Client/Server Computing
Presentation transcript:

PGP Grid NeSC Review 18 March 2004

Description and Aims Apply real time 3D vision technology to animation production. Apply remote parallel processing to real time 3D vision. Apply remote parallel processing to hyper- realistic rendering of imaginary environments Propose best practice for Animation Virtual Organisations

Description PGP Ltd GlasgowEPCC WP1: VO Study WP6: Distributed Rendering WP4: Grid enabling S/Correlator WP5: Image streaming WP2: Capture of sequences WP3: Specialisation of software

Status Progress against plan All participants currently on schedule EPCC:  Finished Resource Locator  Working on Remote Rendering Service (due end October) GU has  Parallelised matching  Developed video sequence conforming software  Developed Jpie and integrated this with resource locator PGP has  Bult CGA sequences using material produced by GU  Jointly develop approach to remote rendering of sequences

Status Effort against plan 2 full time staff at GU EPCC has exceeded 15PM budget  WP6 (rendering) underestimated in original plan  Staff made available to finish off work Part of time of technical director of PGP GU has budget for 2 months more work on project, but need permission to extend Modifications to plan (letter to DTI) Java interface to π-Calculus instead of multi- stream GridFTP protocols Rendering on PC-farms rather than HPCx

Deliverables due DeliverableDelivered VO reportYes Sequences captured and delivered to Peppers Ghost Yes Resource locator for JPie – new deliverable added Yes GRID enabling of correlatorYes Image stream protocol developed – extended to JPie Yes Tool for conforming bodies to captured sequences Yes

Response to previous review Reviewers thought there is no Grid content in the project ILS and RRS software are both Webservices They are covered in the Technical Achievements section.

Technical Achievements – JPie The versions of GridFTP available do not support memory- to-memory transfer, which is required by our application. Lack of GridFTP server implementations on Windows has been a serious concern, with respect to cross platform use. This is especially the case when more than half the machines available to us are running Windows. Further investigation revealed that the existing GridFTP protocols are not available in pure Java versions. We regard this as desirable to allow our matching harness to have a light software footprint on machines such as teaching lab equipment running Windows. Milner’s π-Calculus provides the ability to transfer communications channels along communications channels in addition to image data itself, which is advantageous to our application for establishing dynamic data-flow graphs in the processing of image streams. We have just finished the incorporation of the resource locator into the Jpie system.

Technical Achievements – ILS As part of its code, each  -Calculus node can solve a problem or pass it to other, willing nodes to do it on its behalf A node can pass its communications channels allowing dynamic configuration of data-flow graphs. Lookup for willing nodes is done through our Resource Locator Service (aka ILS – Initiator, Locator, Servent)  A webservice that allows Servents to register with JPie and Initiators to locate Servents fulfilling their criteria

Technical Achievements – ILS Locator Holds a database of resources Hosts web services for updating and querying the database Brokers resource requests Servent (Server Entity) Contacts the Locator with its resource description Updates the Locator with its resource status Initiator Requests resource(s) from the Locator

Technical Achievements – RRS The Remote Rendering Service (RRS) is a webservice which will allow the submission and monitoring of rendering jobs to a remote farm which runs 3D-StudioMax This will involve: A user-interface integrated to 3D-StudioMax Authentication at the remote farm Seamless transfer of appropriate files to and from the farm

Technical Achievements – RRS Remote Farm (Server-Side) PGP (Client-Side) Animator 3ds max 6 RRS-GUI RRSDOSClient RRSJavaClient Web Server 3ds max 6 Backburner 2 RRSJavaServer GridFTP Farm 1 Rendering config &.max files RRSJavaGftpClient 5 2

Dissemination GGF-March Presentation to All Hands Presentation to be given to 2nd International Workshop on Middleware for Grid Computing, in Toronto Demonstration given to Pinewood Studios of the animation technique Paper submitted to IEE proceedings subsequent to winning A H Reeve Premium. Sources to go onto Nesc CVS server.

Exploitation Presentation to Pinewood Studios. Possible use in Captain Scarlet. Need better handling of eyes and mouth. We are producing a demo sequence to show them on this.

Future plans Technical work: WP1: update VO report to include:  animation-producing VOs  our experiences WP2:Repeat capture runs under better lighting conditions, incorporate sound WP3: improve stabilisation of skeletal components of the head through pose recovery WP4/5: further testing of JPie in conjunction with resource locator

Future plans WP6: software and images  Deliver Webservices-based Remote Rendering Service by end October  Render using 3DS-Max, controlling the farm from animator site, but routing via Webservices

Future plans Development of CPU time trading protocols for the GRID. Areas of future application of the 3D technology: Virtual stunt performers Virtual actors for interactive applications Virtual performers for 'drama' orientated CGI.

Project Participants PGP Productions Ltd: Carl Goodman Peter Stansfield (Wavecrest) Glasgow University: Paul Cockshott Lewis MacKenzie Ewan Borland Viktor Yarmolenko EPCC: Kostas Kavoussanakis Ali Anjomshoaa Paul Graham Gavin Pringle