Grid Enabled Pattern Matching within the DAME e-Science Pilot Project Jim Austin Computer Science University of York.

Slides:



Advertisements
Similar presentations
-Grids and the OptIPuter Software Architecture Andrew A. Chien Director, Center for Networked Systems SAIC Chair Professor, Computer Science and Engineering.
Advertisements

Scaling distributed search for diagnostics and prognostics applications Prof. Jim Austin Computer Science, University of York UK CEO Cybula Ltd.
1(#total) CS5038 The Electronic Society Lecture 10: e-Science Lecture Outline Background: Big Science Grid Computing Standards for Grid Computing e-Science.
Pattern Matching against Distributed Datasets within DAME Andy Pasley University of York.
Using search for engineering diagnostics and prognostics Jim Austin.
Jim Austin University of York & Cybula Ltd
Rolls-Royce supported University Technology Centre in Control and Systems Engineering UK e-Science DAME Project Alex Shenfield
Desktop, Mobile & Web Based GIS/ Collaborative GIS
GWDAW 16/12/2004 Inspiral analysis of the Virgo commissioning run 4 Leone B. Bosi VIRGO coalescing binaries group on behalf of the VIRGO collaboration.
Data Grids Jon Ludwig Leor Dilmanian Braden Allchin Andrew Brown.
Decision Support Tools CBR & Modeling Jeff Allan University of Sheffield.
Jim Austin, University of York Grid-based on-line aeroengine diagnostics.
Towards the Design and Implementation of the DAME prototype: OGSA Compliant Grid Services on the White Rose Grid Sarfraz A Nadeem University of Leeds.
1 Abstract This paper presents a novel modification to the classical Competitive Learning (CL) by adding a dynamic branching mechanism to neural networks.
CoLaB 22nd December 2005 Secure Access to Service-based Collaborative Workflow for DAME Duncan Russell Informatics Institute University of Leeds, UK.
1 Regular expression matching with input compression : a hardware design for use within network intrusion detection systems Department of Computer Science.
A Distributed Data Architecture Mark Jessop University of York.
DAME, EuroGrid WP3 and GEODISE Esa Nuutinen. Introduction Dame, EuroGrid WP3 and GEODISE All are Grid based tools for Engineers. Many times engineers.
Inferring the Topology and Traffic Load of Parallel Programs in a VM environment Ashish Gupta Peter Dinda Department of Computer Science Northwestern University.
Computer Science 101 The Virtual Machine: Operating Systems.
An Introduction to Infrastructure Ch 11. Issues Performance drain on the operating environment Technical skills of the data warehouse implementers Operational.
DAME: A Distributed Diagnostics Environment for Maintenance Professor Jim Austin/Dr Tom Jackson University of York.
COMPLEXITY SCIENCE WORKSHOP 18, 19 June 2015 Systems & Control Research Centre School of Mathematics, Computer Science and Engineering CITY UNIVERSITY.
UK GRID Firewall Workshop Matthew J. Dovey Technical Manager Oxford e-Science Centre.
Associative Pattern Memory (APM) Larry Werth July 14, 2007
Pattern Matching in DAME using AURA technology Jim Austin, Robert Davis, Bojian Liang, Andy Pasley University of York.
CS e-Science & Grid Computing - introduction - What is e-Science? What is the Grid? Grid middleware.
DISTRIBUTED COMPUTING
DAME: Distributed Engine Health Monitoring on the Grid
CBR for Fault Analysis in DAME Max Ong University of Sheffield.
CLOUD BASED MACHINE LEARNING APPROACHES FOR LEAKAGE ASSESSMENT AND MANAGEMENT IN SMART WATER NETWORKS Dr. Steve Mounce, Ms. Catalina Pedroza, Dr. Tom Jackson,
CSE 548 Advanced Computer Network Security Document Search in MobiCloud using Hadoop Framework Sayan Cole Jaya Chakladar Group No: 1.
DAME: The route to commercialisation Tom Jackson University of York.
Implementing Codesign in Xilinx Virtex II Pro Betim Çiço, Hergys Rexha Department of Informatics Engineering Faculty of Information Technologies Polytechnic.
UK e-Science DAME Project | UK DTI BROADEN Project All Hands Meeting19 th September 2006 Proxim-CBR: A Scalable Grid Service Network for Mobile Decision.
Rolls-Royce University Technology Centre in Control and Systems Engineering X. Ren, M. Ong, G. Allan, V. Kadirkamanathan, H. A. Thompson and P. J. Fleming.
Grid computinge-Science1 Grid computing and e-Science Lecturer: PhD. Phạm Trần Vũ Presenter: Phan Quang Thiện Trần Phước Hiệp Nguyễn Minh Nhật.
Max Ong University of Sheffield, UK. AHM 2004 Session 2.3: Workflow Composition, Wednesday 1 st September 2004, 4pm. Workflow Advisor in DAME Abstract.
DAME Dependability and Security Study: Progress Report Howard Chivers University of York Practical Security for e-Science Projects 25 November 2003.
An Approach to Persistence of Web Resources Joachim Feise University of California, Irvine Information and Computer Science
The DAME project Professor Jim Austin University of York.
Tool Integration with Data and Computation Grid GWE - “Grid Wizard Enterprise”
Performance Evaluation of a SNAP-based Community Resource Broker Mohammed H. Haji, Peter Dew, Karim Djemame and Iain Gourlay.
DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds.
DAME: A Distributed Diagnostics Environment for Maintenance Dr Tom Jackson University of York.
Overview of the DAME Project Distributed Aircraft Maintenance Environment University of York Martyn Fletcher.
INFSO-RI Enabling Grids for E-sciencE What is Grid Computing? Richard Hopkins Training Outreach and Education National e-Science.
Vector and symbolic processors
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Access Control for Dynamic Virtual Organisations Duncan Russell, Peter Dew & Karim Djemame University of Leeds.
A Scalable Service Architecture for Distributed Search Mark Jessop University of York.
Introduction TO Network Administration
Tool Integration with Data and Computation Grid “Grid Wizard 2”
Fast Lookup for Dynamic Packet Filtering in FPGA REPORTER: HSUAN-JU LI 2014/09/18 Design and Diagnostics of Electronic Circuits & Systems, 17th International.
Grid Remote Execution of Large Climate Models (NERC Cluster Grid) Dan Bretherton, Jon Blower and Keith Haines Reading e-Science Centre
E-Science and Industry Chair: Ian Osborne Grid Computing Now! and Intellect.
+ Support multiple virtual environment for Grid computing Dr. Lizhe Wang.
Team name Team leader name Team leader address, phone number and Rest of team members Team website URL (if any)
United Airlines Implementing a Successful EFB 1/10/07.
Team name Team leader name Team leader address, phone number and Rest of team members Team website URL (if any)
Team name Team leader name Team leader address, phone number and Rest of team members Team website URL (if any)
GWE Core Grid Wizard Enterprise (
Draft-ggf-ghpn-netservices-usecases-2.7
ISAM 5338 Project Business Plan
Databases, Web Pages and Archives
The SADE mini-project of the EGI DARIAH Competence Centre
About Thetus Thetus develops knowledge discovery and modeling infrastructure software for customers who: Have high value data that does not neatly fit.
Chaitali Gupta, Madhusudhan Govindaraju
Proposal for a DØ Remote Analysis Model (DØRAM)
Trace and Logs analysis
Presentation transcript:

Grid Enabled Pattern Matching within the DAME e-Science Pilot Project Jim Austin Computer Science University of York

All hands Rolls-Royce University of Oxford, Lionel Tarassenko. University of Leeds, Peter Dew, Alison McKay. York, J Austin, J McDermid, A Wellings. University of Sheffield, P Fleming. Rolls-Royce, Derby. Data Systems and Solutions. Cybula Ltd.

All hands Introduction Objectives of DAME Diagnostics issues How AURA fits in AURA-G – GRID enabled AURA Where are we now?

All hands DAME Objectives DAME: Distributed Aircraft Maintenance Environment. Demonstrate diagnostic capability on the GRID Examine timeliness properties of the GRID Demonstrate on the RR Aeroengine diagnostic problem

All hands Engine flight data Airline office Maintenance Centre European data center London Airport New York Airport American data center Grid Diagnostics centre

All hands Diagnostic issues The system must analyse and report –Novel engine operation –Identify any cause of events –Do this quickly Data –Large (many Tb)

All hands Data – Zmod plots

All hands Proposed pattern matching process Quote Novelty indication Data used to identify novelty Data reduction processes Features Data stores/ data warehouse Diagnostic station Engine data Data to be searched for Match requests AURA-G Diagnosis

All hands How does AURA contribute Search technology for multi-media data Parallel pattern match engine based on neural networks. Built on Correlation Matrix Memories. High performance Beowulf and dedicated hardware implementations. Commercially sold by Cybula Ltd.

All hands AURA parallel implementation 28 dedicated PCI based processors Beowulf configuration 3.5Gb memory size Cortex-1

All hands Basic CMM inputs  Samples of tracked orders

All hands Data sample DM coding CMM Matching previous events Simple example of processing chain

All hands Typical pre-processing DM coding (1 up 0 down) Fast Preserves information Produces a binary vector Time Frequency

All hands Quote Novelty indication Data used to identify novelty Data reduction processes Features Data stores/ data warehouse Diagnostic station Engine data Data to be searched for Pattern match results Match requests AURA-G GRID Diagnosis

All hands AURA-G This is a Globus enabled AURA implementation. Developed under DAME Will be available end of 2002 for use in other problems.

All hands AURA-G Support of scalable pattern matching Supports distributed search, across multiple CMM engines at different sites OGSA compliant

All hands Conclusions AURA-G enabling fast access to large, complex data. Available for other applications Diagnostic framework in DAME applicable elsewhere. DAME web site: AURA website: – –