A Distributed Data Architecture Mark Jessop University of York.

Slides:

Advertisements

Similar presentations

Data Mining and the Web Susan Dumais Microsoft Research KDD97 Panel - Aug 17, 1997.

Advertisements

Gfarm v2 and CSF4 Osamu Tatebe University of Tsukuba Xiaohui Wei Jilin University SC08 PRAGMA Presentation at NCHC booth Nov 19,

The Replica Location Service In wide area computing systems, it is often desirable to create copies (replicas) of data objects. Replication can be used.

FLIGHT AND DUTY TIME RECORDS INSPECTION. Has operator formulated flight and duty time limitation for flight crew Does flight and duty time limitations.

National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.

Scaling distributed search for diagnostics and prognostics applications Prof. Jim Austin Computer Science, University of York UK CEO Cybula Ltd.

Pattern Matching against Distributed Datasets within DAME Andy Pasley University of York.

Jim Austin University of York & Cybula Ltd

Rolls-Royce supported University Technology Centre in Control and Systems Engineering UK e-Science DAME Project Alex Shenfield

The Storage Resource Broker and.

Peter Berrisford RAL – Data Management Group SRB Services.

Data Grids Jon Ludwig Leor Dilmanian Braden Allchin Andrew Brown.

Jim Austin, University of York Grid-based on-line aeroengine diagnostics.

Grid Enabled Pattern Matching within the DAME e-Science Pilot Project Jim Austin Computer Science University of York.

Grids and Grid Technologies for Wide-Area Distributed Computing Mark Baker, Rajkumar Buyya and Domenico Laforenza.

On Developing Data Grid Workflows using Storage Resource Broker (SRB) and Kepler Tim H. Wong - UC Davis Efrat Frank - SDSC Dr. Bertram Ludäscher - UC Davis.

Versus: A Web Repository Daniel Gomes, João P. Campos, Mário J. Silva XLDB Research Group University of Lisbon [dcg, jcampos, Versus is.

DAME, EuroGrid WP3 and GEODISE Esa Nuutinen. Introduction Dame, EuroGrid WP3 and GEODISE All are Grid based tools for Engineers. Many times engineers.

Computer Science and Engineering A Middleware for Developing and Deploying Scalable Remote Mining Services P. 1DataGrid Lab A Middleware for Developing.

Tools for e-Research Mat Wyatt. 2 e-Research Sensor nets data compute… Models/ software/ workflows colleagues instruments.

DAME: A Distributed Diagnostics Environment for Maintenance Professor Jim Austin/Dr Tom Jackson University of York.

1.5 Problem Solving Using Algebraic Models. Rates: the key word is per time– get some examples: mph, gallon per minute, doughnuts made per hour Be able.

ENR NO: : patel kunal p : patel jaykumar r : pandya devarshi : patel manank d : prajapati.

Peter R. Pietzuch THEMIS: Fairness in Data Stream Processing under Overload Evangelia Kalyvianaki City University London, UK Model-driven.

Hussein Suleman University of Cape Town Department of Computer Science Advanced Information Management Laboratory High Performance.

Pattern Matching in DAME using AURA technology Jim Austin, Robert Davis, Bojian Liang, Andy Pasley University of York.

DAME: Distributed Engine Health Monitoring on the Grid

DAME: The route to commercialisation Tom Jackson University of York.

IMDGs An essential part of your architecture. About me

UK e-Science DAME Project | UK DTI BROADEN Project All Hands Meeting19 th September 2006 Proxim-CBR: A Scalable Grid Service Network for Mobile Decision.

The Global Video Grid: DigitalWell Update & Plan For SRB Integration Myke Smith, Manager Streaming Media Technologies University of Washington / ResearchChannel.

Grid computinge-Science1 Grid computing and e-Science Lecturer: PhD. Phạm Trần Vũ Presenter: Phan Quang Thiện Trần Phước Hiệp Nguyễn Minh Nhật.

The DAME project Professor Jim Austin University of York.

DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds.

Search Dr Ian Boston University of Cambridge Image © University of Cambridge December :30 INTL 6.

Computer Science and Engineering Predicting Performance for Grid-Based P. 1 IPDPS’07 A Performance Prediction Framework.

IRODS: the use of rules and micro services for automatic data conversion and signal pattern searching Martyn Fletcher, Tom Jackson, Bojian Liang, Michael.

CLASS Information Management Presented at NOAATECH Conference 2006 Presented by Pat Schafer (CLASS-WV Development Lead)

What is SAM-Grid? Job Handling Data Handling Monitoring and Information.

DAME: A Distributed Diagnostics Environment for Maintenance Dr Tom Jackson University of York.

Overview of the DAME Project Distributed Aircraft Maintenance Environment University of York Martyn Fletcher.

1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,

Introduction to The Storage Resource.

Supporting Load Balancing for Distributed Data-Intensive Applications Leonid Glimcher, Vignesh Ravi, and Gagan Agrawal Department of ComputerScience and.

Aeronautical Facilities The term aerodrome refers to any area of land or water designated for the arrival, departure, movement and servicing of aircraft.

Economic and On Demand Brain Activity Analysis on Global Grids A case study.

International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.

Open Spatial Adds Scalable Functionality to As Constructed Design Certification Validation Portal Using Microsoft Azure MICROSOFT AZURE APP BUILDER PROFILE:

A Scalable Service Architecture for Distributed Search Mark Jessop University of York.

Types of Data Discrete Data

Big Data Analytics Platforms. Our Team NameApplication Viborov MichaelApache Spark Bordeynik YanivApache Storm Abu Jabal FerasHPCC Oun JosephGoogle BigQuery.

The Storage Resource Broker and.

Cloud Distributed Computing Environment Hadoop. Hadoop is an open-source software system that provides a distributed computing environment on cloud (data.

Developing GRID Applications GRACE Project

September 2003, 7 th EDG Conference, Heidelberg – Roberta Faggian, CERN/IT CERN – European Organization for Nuclear Research The GRACE Project GRid enabled.

Geethanjali College Of Engineering and Technology Cheeryal( V), Keesara ( M), Ranga Reddy District. I I Internal Guide Mrs.CH.V.Anupama Assistant Professor.

Pilot Kafka Service Manuel Martín Márquez. Pilot Kafka Service Manuel Martín Márquez.

Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.

Aeronautical Facilities

PowerPointmaths.com © 2004 all rights reserved

Spark Presentation.

DI4R, 30th September 2016, Krakow

GSAF Grid Storage Access Framework

Alternate methods of analyising the data have to be employed.

SCALABLE OPEN ACCESS Hussein Suleman

The Globus Toolkit™: Information Services

Grouped Data L.O. All pupils understand why grouped data is sometimes used All pupils can find the modal class.

Standards WHG Era 6 – An Age of Global Revolutions, 18th Century-1914

A Grid-Based Middleware for Scalable Processing of Remote Data

L. Glimcher, R. Jin, G. Agrawal Presented by: Leo Glimcher

Presentation transcript:

A Distributed Data Architecture Mark Jessop University of York

Distributed Aircraft Maintenance Environment - DAME Swans

Distributed Aircraft Maintenance Environment - DAME London Tokyo Cape Town Mexico City Grid Enabled Swans

Distributed Aircraft Maintenance Environment - DAME How Big is that Lake? Heathrow capped at 36 landings per hour. If half have 4 engines and half have 2, average aircraft carries 3 engines. Each engine generates around 1GB of data per flight. 36 x 3 x 1 = 108GB raw engine data per hour. Factor in the working day and the rest of the world… …Terabytes and up!

Distributed Aircraft Maintenance Environment - DAME Managing the Flow of Water London Cape Town Tokyo Mexico City

Distributed Aircraft Maintenance Environment - DAME Plumbing Toolkit Data Repository Catalogue Pattern Match Engine

Distributed Aircraft Maintenance Environment - DAME Pattern Match Engine Pattern Match Control Data Extractor/Encoder AURA Encoder AURA-G Back Check

Distributed Aircraft Maintenance Environment - DAME MCAT DATA MCAT Data Repository SDSC Storage Request Broker. Manages distributed storage resources. Meta Data Catalogue. Many configurations. Heterogeneous. Efficient data delivery. C++ and Java APIs. MCAT DATA MCAT DATA MCAT

Distributed Aircraft Maintenance Environment - DAME A Distributed Architecture One node per airport. Single global MCAT. Stream engine data. Global Parallel Search. Present Results. Scalable. Robust. MCAT

Distributed Aircraft Maintenance Environment - DAME Summary Large quantities of data arriving globally. Distributed architecture for data management and search. Scalable and Robust.