Using Bayesian Networks to Predict Water Quality in Sydney Harbour Final Presentation Name: Shannon Watson Supervisors: Ann Nicholson & Charles Twardy.

Slides:



Advertisements
Similar presentations
Bayesian networks Chapter 14 Section 1 – 2. Outline Syntax Semantics Exact computation.
Advertisements

Bayesian Network and Influence Diagram A Guide to Construction And Analysis.
Educational Data Mining Overview Ryan S.J.d. Baker PSLC Summer School 2012.
1 Some Comments on Sebastiani et al Nature Genetics 37(4)2005.
1 Knowledge Engineering for Bayesian Networks Ann Nicholson School of Computer Science and Software Engineering Monash University.
Ira Cohen, Jeffrey S. Chase et al.
1 Knowledge Engineering for Bayesian Networks. 2 Probability theory for representing uncertainty l Assigns a numerical degree of belief between 0 and.
Integrated Systems Understanding using Bayesian Networks: Measuring the Effectiveness of a Weapon System Pretoria Defence, Peace, Safety & Security Alta.
Knowledge Engineering for Bayesian Networks
Data Mining Cardiovascular Bayesian Networks Charles Twardy †, Ann Nicholson †, Kevin Korb †, John McNeil ‡ (Danny Liew ‡, Sophie Rogers ‡, Lucas Hope.
1 Knowledge Engineering for Bayesian Networks Ann Nicholson School of Computer Science and Software Engineering Monash University.
1 Knowledge Engineering for Bayesian Networks Ann Nicholson School of Computer Science and Software Engineering Monash University.
Data Mining Cardiovascular Bayesian Networks Charles Twardy †, Ann Nicholson †, Kevin Korb †, John McNeil ‡ (Danny Liew ‡, Sophie Rogers ‡, Lucas Hope.
1 Using Bayesian networks for Water Quality Prediction in Sydney Harbour Ann Nicholson Shannon Watson, Honours 2003 Charles Twardy, Research Fellow School.
Parameterising Bayesian Networks: A Case Study in Ecological Risk Assessment Carmel A. Pollino Water Studies Centre Monash University Owen Woodberry, Ann.
Knowledge Engineering a Bayesian Network for an Ecological Risk Assessment (KEBN-ERA) Owen Woodberry Supervisors: Ann Nicholson Kevin Korb Carmel Pollino.
Using Bayesian Networks for Water Quality Prediction in Sydney Harbour Interim Presentation Name: Shannon Watson Supervisors: Ann Nicholson & Charles Twardy.
Learning with Bayesian Networks David Heckerman Presented by Colin Rickert.
Bayesian networks Chapter 14 Section 1 – 2.
Bayesian Belief Networks
Proactivity using Bayesian Methods and Learning 3rd UK-UbiNet Workshop, Bath Lukas Sklenar Computing Laboratory, University of Kent.
Information Agents for Autonomous Acquisition of Sensor Network Data A. Rogers and N. R. Jennings University of Southampton, UK M. A. Osborne and S. J.
Part 2 of 3: Bayesian Network and Dynamic Bayesian Network.
Goal: Reconstruct Cellular Networks Biocarta. Conditions Genes.
1 Knowledge Engineering for Bayesian Networks Ann Nicholson School of Computer Science and Software Engineering Monash University.
Knowledge Engineering a Bayesian Network for an Ecological Risk Assessment (KEBN-ERA) Owen Woodberry Supervisors: Ann Nicholson Kevin Korb Carmel Pollino.
Computer Science, Software Engineering & Robotics Workshop, FGCU, April 27-28, 2012 Bayesian Belief Networks in Anomaly Detection, Fault Diagnosis & Failure.
Daphne Koller Bayesian Networks Application: Diagnosis Probabilistic Graphical Models Representation.
An Evaluation of A Commercial Data Mining Suite Oracle Data Mining Presented by Emily Davis Supervisor: John Ebden.
Soft Computing Lecture 17 Introduction to probabilistic reasoning. Bayesian nets. Markov models.
VTT-STUK assessment method for safety evaluation of safety-critical computer based systems - application in BE-SECBS project.
SOFTWARE ENGINEERING1 Introduction. Software Software (IEEE): collection of programs, procedures, rules, and associated documentation and data SOFTWARE.
Leslie Luyt Supervisor: Dr. Karen Bradshaw 2 November 2009.
Appendix: The WEKA Data Mining Software
Analysing Microarray Data Using Bayesian Network Learning Name: Phirun Son Supervisor: Dr. Lin Liu.
Kansas State University Department of Computing and Information Sciences Kansas State University KDD Lab ( cDNA.
TAIC-PART - Cumberland Lodge, UK – 29 Aug 2006 MOTOROLA and the Stylized M Logo are registered in the US Patent & Trademark Office. All other product or.
Bayesian Networks for Data Mining David Heckerman Microsoft Research (Data Mining and Knowledge Discovery 1, (1997))
Lecture on Bayesian Belief Networks (Basics) Patrycja Gradowska Open Risk Assessment Workshop Kuopio, 2009.
Three Approaches to New Product Development Consumer Driven Competition Driven Technology Driven Idea generation Concept development and consumer screening.
U.S. Department of the Interior U.S. Geological Survey.
SOFTWARE ENGINEERING1 Introduction. SOFTWARE ENGINEERING2 Software Q : If you have to write a 10,000 line program in C to solve a problem, how long will.
Learning the Structure of Related Tasks Presented by Lihan He Machine Learning Reading Group Duke University 02/03/2006 A. Niculescu-Mizil, R. Caruana.
Introduction to Quantitative Research Charles Laugharne.
Review: Bayesian inference  A general scenario:  Query variables: X  Evidence (observed) variables and their values: E = e  Unobserved variables: Y.
Dependency Networks for Collaborative Filtering and Data Visualization UAI-2000 발표 : 황규백.
Application of Data Mining Techniques on Survey Data using R and Weka
Using Bayesian Networks to Predict Plankton Production from Satellite Data By: Rob Curtis, Richard Fenn, Damon Oberholster Supervisors: Anet Potgieter,
Introduction on Graphic Models
CSC400W Honors Project Proposal Understanding ocean surface features from satellite images Jared Tilanus Nemanja Spasic.
FNA/Spring CENG 562 – Machine Learning. FNA/Spring Contact information Instructor: Dr. Ferda N. Alpaslan
Chapter 12. Probability Reasoning Fall 2013 Comp3710 Artificial Intelligence Computing Science Thompson Rivers University.
An Algorithm to Learn the Structure of a Bayesian Network Çiğdem Gündüz Olcay Taner Yıldız Ethem Alpaydın Computer Engineering Taner Bilgiç Industrial.
Prediction of Soil Corrosivity Index: A Bayesian Belief Network Approach Gizachew A. Demissie, PhD student Solomon Tesfamariam,
Bayesian Decision Theory Introduction to Machine Learning (Chap 3), E. Alpaydin.
Applying Combinatorial Testing to Data Mining Algorithms
Introduction Edited by Enas Naffar using the following textbooks: - A concise introduction to Software Engineering - Software Engineering for students-
Pekka Laitila, Kai Virtanen
Lecture on Bayesian Belief Networks (Basics)
Bayesian networks Chapter 14 Section 1 – 2.
Pekka Laitila, Kai Virtanen
Introduction SOFTWARE ENGINEERING.
Introduction Edited by Enas Naffar using the following textbooks: - A concise introduction to Software Engineering - Software Engineering for students-
Using Bayesian Networks to Predict Test Scores
First work in AI 1943 The name “Artificial Intelligence” coined 1956
CS639: Data Management for Data Science
Probabilistic Reasoning
Sofia Pediaditaki and Mahesh Marina University of Edinburgh
Chapter 14 February 26, 2004.
Presentation transcript:

Using Bayesian Networks to Predict Water Quality in Sydney Harbour Final Presentation Name: Shannon Watson Supervisors: Ann Nicholson & Charles Twardy

Introduction The application domain Bayesian Networks Knowledge Engineering Weka Results Conclusion and Future Work

The Domain - Sydney Harbour Water Quality for recreational use Beachwatch / Harbourwatch Programs Bacteria samples used as pollution indicators Many variables influencing Bacterial levels – rainfall, tide, wind, sunlight temperature, ph etc

Past studies Hose et al. used multi dimension scaling model of Sydney harbour – low predictive accuracy - unable to handle the noisy bacteria samples Other models developed by the USEPA to model estuaries are: QUAL2E – Steady-state receiving water model WASP – Time Varying dispersion model EFDC – 3D hydrodynamic model EPA in Sydney want a model applying the causal knowledge of the domain

Bayesian Networks Directed acyclic graphs Nodes = random variable/uncertain quantities Links/arcs = casual relationships between variables Strengths of the links are quantified by conditional probabilities Uses Bayes theorem to resolve uncertainties Graphical structure allows non-technical people to understand a technical model.

Bayesian Networks – An Example

Bayesian Networks – An example

Knowledge Engineering Used to keep structure of large projects in software engineering discipline Two major implementations -Spiral model/Waterfall Model Spiral Model can be used in the application of Bayesian Networks to keep in control of the Network as it progresses from a small to large Bayesian network

Problems Encountered Getting the data into a usable format -solved by learning how to use tools such as sed and awk, perl. Understanding the domain – what amount of rainfall would cause high levels of bacteria? Through Netica was unable to determine a clear breaks in the rainfall data

Weka The Weka package is a Java implementation of a number of machine Learners. Implements Industry standard is C4.5 It was hoped that running the machine learners may be able to help understand data Also run other machine Learners Naïve Bayes AODE KeoghTan

Results - Entc. EPA’s Current Model vs. One of My Models

Predicting Water Quality Knowledge of the domain has been greatly advance through use of Netica to Visualise models Machine Learners quickly respond with Experts own ideas that the data is noisy Domain can’t easily be modeled No way to easily state what levels of rainfall determine when there will be high bacterial readings

Conclusion Use Bayesian networks Create a model of Sydney harbour Aim to predict the water quality for EPA Use Spiral Model Machine Learners

Further Work Evaluate the models Add more variables to models and revaluate Recommend models to Sydeny EPA Questions