© Geodise Project, University of Southampton, 2003. Grid middleware for engineering design search and optimisation Graeme Pound.

Slides:



Advertisements
Similar presentations
© Geodise Project, University of Southampton, Applying the Semantic Web to Manage Knowledge on the Grid Feng Tao, Colin.
Advertisements

Legacy code support for commercial production Grids G.Terstyanszky, T. Kiss, T. Delaitre, S. Winter School of Informatics, University.
© Geodise Project, University of Southampton, Semantic Web based Content Enrichment and Knowledge Reuse in e-Science.
© Geodise Project, University of Southampton, Short Message Service Aims Architecture Tools Future Work.
Grid Resource Allocation Management (GRAM) GRAM provides the user to access the grid in order to run, terminate and monitor jobs remotely. The job request.
CERN LCG Overview & Scaling challenges David Smith For LCG Deployment Group CERN HEPiX 2003, Vancouver.
Grid Enabled Optimisation and Design Search for Engineering (G EODISE ) Prof Simon Cox Southampton University 3 rd Annual Workshop on Linux Clusters for.
© Geodise Project, University of Southampton, Geodise: Taking the Grid to the Engineer Graeme Pound International Summer.
© Geodise Project, University of Southampton, Applications and Middleware Hakki Eres, Fenglian Xu & Graeme Pound.
© Geodise Project, University of Southampton, CFD-based Shape Optimisation Using Geodise Toolkits Application Demo of.
USING THE GLOBUS TOOLKIT This summary by: Asad Samar / CALTECH/CMS Ben Segal / CERN-IT FULL INFO AT:
Workload Management Workpackage Massimo Sgaravatto INFN Padova.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
Workload Management Massimo Sgaravatto INFN Padova.
DAME, EuroGrid WP3 and GEODISE Esa Nuutinen. Introduction Dame, EuroGrid WP3 and GEODISE All are Grid based tools for Engineers. Many times engineers.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
The SAM-Grid Fabric Services Gabriele Garzoglio (for the SAM-Grid team) Computing Division Fermilab.
© Geodise Project, University of Southampton, Geodise: A Grid-enabled PSE for design search and optimisation Graeme Pound.
Knowledge Management in Geodise Geodise Knowledge Management Team Liming Chen, Barry Tao, Colin Puleston, Paul Smart University of Southampton University.
Grid Enabled Optimisation and Design Search for Engineering (GEODISE)
© Geodise Project, University of Southampton, Data Management in Geodise Jasmin Wason, Zhuoan Jiao and Marc Molinari Engineering.
Supercomputing, Visualization & eScience1 e-Social Science Grid technologies for Social Science: the Seamless Access to Multiple Datasets (SAMD) project.
Visualisation & Grid Applications of Electromagnetic Scattering from Aircraft Mark Spivack (PI), Andrew Usher, Xiaobo Yang, Mark Hayes CeSC, DAMTP & BAE.
Grid ASP Portals and the Grid PSE Builder Satoshi Itoh GTRC, AIST 3rd Oct UK & Japan N+N Meeting Takeshi Nishikawa Naotaka Yamamoto Hiroshi Takemiya.
Applied Workflows in Geodise e-Science Workflow Services Workshop Edinburgh (Dec 3 rd – 5 th 2003) Dec 4 th 2003 Prof Simon Cox Computational Engineering.
Holding slide prior to starting show. A Grid-based Problem Solving Environment for GECEM Maria Lin and David Walker Cardiff University Yu Chen and Jason.
© Geodise Project 2003 Grid Enabled Optimisation and Design Search for Engineering (G EODISE ) Expo May 12 th Southampton Prof Simon Cox Southampton.
© Geodise Project, University of Southampton, Geodise & GeodiseLAB Simon Cox University of Southampton 21 st April 2005.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
© Geodise Project, University of Southampton, Data Management in Geodise Zhuoan Jiao, Jasmin Wason and Marc Molinari
1 EPCC Sun Data and Compute Grids Project Using Sun Grid Engine and Globus to Schedule Jobs Across a Combination of Local.
Grid Resource Allocation and Management (GRAM) Execution management Execution management –Deployment, scheduling and monitoring Community Scheduler Framework.
TRASC Globus Application Launcher VPAC Development Team Sudarshan Ramachandran.
Tuning GENIE Earth System Model Components using a Grid Enabled Data Management System Andrew Price University of Southampton UK.
© Geodise Project, University of Southampton, GEODISE: Grid-enabled toolkits for the Engineer Andrew Price UK e-Science Programme,
Grid Workload Management Massimo Sgaravatto INFN Padova.
Application portlets within the PROGRESS HPC Portal Michał Kosiedowski
1 Sergio Maffioletti Grid Computing Competence Center GC3 University of Zurich Swiss Grid School 2012 Develop High Throughput.
Grid Technologies for Engineering Applications Marc Molinari e-Science Centre University of Southampton.
The UK eScience Grid (and other real Grids) Mark Hayes NIEeS Summer School 2003.
Holding slide prior to starting show. A Portlet Interface for Computational Electromagnetics on the Grid Maria Lin and David Walker Cardiff University.
Applications & a Reality Check Mark Hayes. Applications on the UK Grid Ion diffusion through radiation damaged crystal structures (Mark Calleja, Mark.
© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.
What is SAM-Grid? Job Handling Data Handling Monitoring and Information.
© Geodise Project, University of Southampton, Knowledge Management in Geodise Geodise Knowledge Management Team Barry Tao, Colin Puleston, Liming.
Grid-Powered Scientific & Engineering Applications Ho Quoc Thuan INSTITUTE OF HIGH PERFORMANCE COMPUTING.
© Geodise Project, University of Southampton, Data Management in Geodise Zhuoan Jiao, Jasmin Wason & Marc Molinari { z.jiao,
© Geodise Project, University of Southampton, CFD-based shape optimisation using Geodise toolkits Nacelle Optimisation.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.
In Vivo Imaging Middleware and Applications RSNA 2007 Berkant Barla Cambazoglu The Ohio State University Department of Biomedical Informatics.
© Geodise Project, University of Southampton, Integrating Data Management into Engineering Applications Zhuoan Jiao, Jasmin.
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
© Geodise Project, University of Southampton, Geodise Compute Toolbox Functions CommandFunctionCommandFunction gd_certinfo.
EGI Technical Forum Amsterdam, 16 September 2010 Sylvain Reynaud.
© Geodise Project, University of Southampton, Workflow Application Fenglian Xu 07/05/03.
Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.
© Geodise Project, Scenario: Design optimisation v Model device, discretize, solve, postprocess, optimise Scripting.
Holding slide prior to starting show. Lessons Learned from the GECEM Portal David Walker Cardiff University
STAR Scheduler Gabriele Carcassi STAR Collaboration.
© Geodise Project, University of Southampton, Applications and Middleware Hakki Eres, Fenglian Xu & Graeme Pound.
© Geodise Project, University of Southampton, Workflow Support for Advanced Grid-Enabled Computing Fenglian Xu *, M.
Intersecting UK Grid & EGEE/LCG/GridPP Activities Applications & Requirements Mark Hayes, Technical Director, CeSC.
Grid Execution Management for Legacy Code Architecture Exposing legacy applications as Grid services: the GEMLCA approach Centre.
© Geodise Project, University of Southampton, Data Management in Geodise Jasmin Wason, Zhuoan Jiao and Marc Molinari 12 May.
Holding slide prior to starting show. GECEM: Grid-Enabled Computational Electromagnetics David W. Walker School of Computer Science Cardiff University.
Workload Management Workpackage
Grid Enabled Optimisation and Design Search for Engineering (GEODISE) Prof Simon Cox Southampton University
GEODISE: Grid-enabled toolkits for the Engineer
Grid Enabled Optimisation and Design Search (GEODISE)
Presentation transcript:

© Geodise Project, University of Southampton, Grid middleware for engineering design search and optimisation Graeme Pound UK e-Science - All Hands Meeting 3 rd September 2003

© Geodise Project, University of Southampton, Grid Enabled Optimisation and Design Search for Engineering (G EODISE ) Simon Cox- Technical Director Southampton e-Science Centre. Grid/ W3C Technologies and High Performance Computing Andy Keane- Director of Rolls Royce/ BAE Systems University Technology Partnership in Design Search and Optimisation Mike Giles- Director of Rolls Royce University Technology Centre for Computational Fluid Dynamics Carole Goble- Ontologies and DARPA Agent Markup Language (DAML) / Ontology Inference Language (OIL) Nigel Shadbolt- Director of Advanced Knowledge Technologies (AKT) IRC BAE Systems- Engineering Rolls-Royce- Engineering Fluent- Computational Fluid Dynamics Microsoft- Software/ Web Services Intel- Hardware Compusys- Systems Integration Epistemics- Knowledge Technologies Condor- Grid Middleware

© Geodise Project, University of Southampton, The GEODISE Team Richard Boardman Sergio Campobasso Liming Chen Mike Chrystall Trevor Cooper-Chadwick Simon Cox Mihai Duta Clive Emberey Hakki Eres Matt Fairman Mike Giles Carole Goble Ian Hartney Tracey Hunt Zhuoan Jiao Andy Keane Marc Molinari Graeme Pound Colin Puleston Nicola Reader Angus Roberts Mark Scott Nigel Shadbolt Wenbin Song Paul Smart Barry Tao Jasmin Wason Fenglian Xu Gang Xue

© Geodise Project, University of Southampton, Computational Fluid Dynamics

© Geodise Project, University of Southampton, Modern engineering firms are global and distributed CAD and analysis tools, user interfaces, PSEs, and Visualization Optimisation methods Data archives (e.g. design/ system usage) Knowledge repositories & knowledge capture and reuse tools. Management of distributed compute and data resources How to … ? … improve design environments … cope with legacy code / systems … integrate large-scale systems in a flexible way … produce optimized designs … archive and re-use design history … capture and re-use knowledge Design Challenges

© Geodise Project, University of Southampton, RSM Construct RSM Evaluate Search Using RSM Best Design Adequate ? RSM Tuning Build Data- Base CFD DoE Initial Geometry CFD … … … … Cluster Parallel Analysis Design of Experiment & Response Surface Modelling

© Geodise Project, University of Southampton, Defining the Objective Function CAD geometry Meshing CFD analysis Post-processing Design Variables x 1 = 0.5, x 2 = 0.25 Objective function y = 42

© Geodise Project, University of Southampton, Scripting languages Why use scripting languages? Flexibility High-level functionality Quick application development Extend the user’s existing PSE Reduce the need for ‘hacks’

© Geodise Project, University of Southampton, Computational Toolbox gd_createproxy.m Creates a Globus proxy certificate for the user's credentials gd_destroyproxy.m Destroys the local copy of the user's Globus proxy certificate gd_certinfo.m Returns information about the user's certificate gd_proxyinfo.m Returns information about the user's proxy certificate gd_proxyquery.m Queries whether a valid proxy certificate exists gd_jobsubmit.m Submits a compute job to a Globus GRAM job manager gd_jobstatus.m Gets the status of a Globus GRAM job gd_jobpoll.m Queries the status of a Globus GRAM job until complete gd_jobkill.m Kills a Globus GRAM specified by job handle gd_putfile.m Puts a remote file using GridFtp gd_getfile.m Retrieves a remote file using GridFtp gd_rmfile.m Deletes a remote file using GridFtp gd_makedir.m Creates a remote directory using GridFtp gd_rmdir.m Deletes a remote directory using GridFtp

© Geodise Project, University of Southampton, Example Script hostname = 'pacifica.iridis.soton.ac.uk' jobmanager = [hostname,'/jobmanager-fork'] rsl = '&(executable="/bin/date")(stdout="remote.txt")' %Create a proxy certificate gd_createproxy %Submitting a globus job and returning handle handle = gd_jobsubmit(rsl,jobmanager) %Polling the job gd_jobpoll(handle) %Getting the standard output gd_getfile(hostname,'remote.txt','local.txt'); %Print the output to screen type('local.txt')

© Geodise Project, University of Southampton, Job Submission Service Client Matlab client to job submission web service User detached from compute endpoint – Condor pool Machines publish available resources: –HasProEngineer = TRUE –ProEngineerVersion = " " –ProEngineerPath = "C:\Program Files\proe2001\bin DIME file transfer over http MATLAB Client Functions: – grid_platform – Describes the platform requirements of the job – grid_submit – Submits the job to the web service, returns a job ID – grid_poll – Polls job ID – grid_status – Queries job status – grid_results – Retrieves the output files

© Geodise Project, University of Southampton, Design Search & Optimisation Tools Objective Function Client –Grid-enabled objective function evaluation –Matlab functions provided:  gd_objsubmit – Transfers required files, submit jobs and returns handle  gd_objvalue – Retrieves function evaluation & cleans up files  gd_objcleanup – Removes remote files OptionsMatlab –Matlab interface to the Options design exploration system –State of the art design search and optimisation algorithms –Objective and constraint functions exposed as Matlab functions –Grid-enabled job brokers easily incorporated

© Geodise Project, University of Southampton, Exploiting the UK e-Science Grid

© Geodise Project, University of Southampton, Conclusions Open standards → Plug & Play resources Transparent access to Grid resources Components to high-level scripting languages Flexibility and scalability to meet engineer’s requirements

© Geodise Project, University of Southampton, Related Presentations Thursday 4 th September CFD-based Shape Optimisation with GEODISE Toolkits Room:Conference Room 3 Session Title: Applications 5 Time: 0950 – 1010 Integrating Data Management into Engineering Applications Room: Conference Room 2 Session Title: Databases and Data Access 2 Time:1015 – 1035