Anomaly Detection using GAs M. Umer Khan 22-Nov-2005.

Slides:



Advertisements
Similar presentations
Data Mining Techniques Association Rule
Advertisements

Association Rules Spring Data Mining: What is it?  Two definitions:  The first one, classic and well-known, says that data mining is the nontrivial.
FUNGSI MAYOR Assosiation. What Is Association Mining? Association rule mining: –Finding frequent patterns, associations, correlations, or causal structures.
IT 433 Data Warehousing and Data Mining Association Rules Assist.Prof.Songül Albayrak Yıldız Technical University Computer Engineering Department
1 of 25 1 of 45 Association Rule Mining CIT366: Data Mining & Data Warehousing Instructor: Bajuna Salehe The Institute of Finance Management: Computing.
Learning Fuzzy Association Rules and Associative Classification Rules Jianchao Han Computer Science Department California State University Dominguez Hills.
Data Mining Association Analysis: Basic Concepts and Algorithms Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach, Kumar Introduction.
Data Mining Association Analysis: Basic Concepts and Algorithms Lecture Notes for Chapter 6 Introduction to Data Mining by Tan, Steinbach, Kumar © Tan,Steinbach,
1 Anomaly Detection Using GAs Umer Khan 28-sept-2005.
1 Weekly Progress (MAGGIE) Adnan Iqbal Superviser Dr. Waqar Mahmood
Maintenance of Discovered Association Rules S.D.LeeDavid W.Cheung Presentation : Pablo Gazmuri.
Association Rules Presented by: Anilkumar Panicker Presented by: Anilkumar Panicker.
6/23/2015CSE591: Data Mining by H. Liu1 Association Rules Transactional data Algorithm Applications.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Association Rule Mining Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
Association Rule Mining (Some material adapted from: Mining Sequential Patterns by Karuna Pande Joshi)‏
Lecture14: Association Rules
Mining Association Rules
NIDS Using Genetic Algorithms Umer Khan Weekly Progress Review 6-Sept-2005.
Association Discovery from Databases Association rules are a simple formalism for expressing positive connections between columns in a 0/1 matrix. A classical.
Chapter 5 Mining Association Rules with FP Tree Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2010.
『 Data Mining 』 By Jung, hae-sun. 1.Introduction 2.Definition 3.Data Mining Applications 4.Data Mining Tasks 5. Overview of the System 6. Data Mining.
Mining Association Rules between Sets of Items in Large Databases presented by Zhuang Wang.
Basic Data Mining Techniques
Association Rules. 2 Customer buying habits by finding associations and correlations between the different items that customers place in their “shopping.
Ch5 Mining Frequent Patterns, Associations, and Correlations
AR mining Implementation and comparison of three AR mining algorithms Xuehai Wang, Xiaobo Chen, Shen chen CSCI6405 class project.
Association Rule By Kenneth Leung. Data Mining The process of extracting valid, previously unknown, comprehensible, and actionable information from large.
Data Mining By : Tung, Sze Ming ( Leo ) CS 157B. Definition A class of database application that analyze data in a database using tools which look for.
FUZZY DATA MINING AND GENETIC ALGORITHMS APPLIED
ITEC 3220M Using and Designing Database Systems Instructor: Prof. Z. Yang Course Website: 3220m.htm
Data Mining By Dave Maung.
Data Mining: Association Rule By: Thanh Truong. Association Rules In Association Rules, we look at the associations between different items to draw conclusions.
Expert Systems with Applications 34 (2008) 459–468 Multi-level fuzzy mining with multiple minimum supports Yeong-Chyi Lee, Tzung-Pei Hong, Tien-Chin Wang.
Introduction of Data Mining and Association Rules cs157 Spring 2009 Instructor: Dr. Sin-Min Lee Student: Dongyi Jia.
Part II - Association Rules © Prentice Hall1 DATA MINING Introductory and Advanced Topics Part II – Association Rules Margaret H. Dunham Department of.
CS 478 – Tools for Machine Learning and Data Mining Association Rule Mining.
1 What is Association Analysis: l Association analysis uses a set of transactions to discover rules that indicate the likely occurrence of an item based.
Association Rule Mining
DATA MINING By Cecilia Parng CS 157B.
Measuring Association Rules Shan “Maggie” Duanmu Project for CSCI 765 Dec 9 th 2002.
© Tan,Steinbach, Kumar Introduction to Data Mining 4/18/ Data Mining: Association Analysis This lecture node is modified based on Lecture Notes for.
CS Data Mining1 Data Mining The Extraction of useful information from data The automated extraction of hidden predictive information from (large)
Association Rule Mining. 2 Clearly not limited to market-basket analysis Associations may be found among any set of attributes – If a representative.
Mining Frequent Patterns, Associations, and Correlations Compiled By: Umair Yaqub Lecturer Govt. Murray College Sialkot.
CURE Clustering Using Representatives Handles outliers well. Hierarchical, partition First a constant number of points c, are chosen from each cluster.
DATA MINING Using Association Rules by Andrew Williamson.
Data Mining  Association Rule  Classification  Clustering.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
Chapter 8 Association Rules. Data Warehouse and Data Mining Chapter 10 2 Content Association rule mining Mining single-dimensional Boolean association.
Data Mining Association Rules Mining Frequent Itemset Mining Support and Confidence Apriori Approach.
DATA MINING It is a process of extracting interesting(non trivial, implicit, previously, unknown and useful ) information from any data repository. The.
Chapter 3 Data Mining: Classification & Association Chapter 4 in the text box Section: 4.3 (4.3.1),
Data Mining – Introduction (contd…) Compiled By: Umair Yaqub Lecturer Govt. Murray College Sialkot.
DATA MINING and VISUALIZATION Instructor: Dr. Matthew Iklé, Adams State University Remote Instructor: Dr. Hong Liu, Embry-Riddle Aeronautical University.
Mining Association Rules in Large Database This work is created by Dr. Anamika Bhargava, Ms. Pooja Kaul, Ms. Priti Bali and Ms. Rajnipriya Dhawan and licensed.
Mining Dependent Patterns
By Arijit Chatterjee Dr
Data Mining-Association Rule
Spring 2003 Dr. Susan Bridges
A Research Oriented Study Report By :- Akash Saxena
Association rule mining
Association Rules.
Chapter 6 Tutorial.
Market Basket Analysis and Association Rules
Data Mining Association Rules Assoc.Prof.Songül Varlı Albayrak
Amer Zaheer PC Mohammad Ali Jinnah University, Islamabad
ERA Table of Activities
Frequent patterns and Association Rules
Market Basket Analysis and Association Rules
ERA Table of Activities
Presentation transcript:

Anomaly Detection using GAs M. Umer Khan 22-Nov-2005

Important Tasks in Previous Weeks To complete a basic story of the model followed for Anomaly Detection using Gas To complete a basic story of the model followed for Anomaly Detection using Gas To give a presentation, about the study conducted until now, to Dr. Waqar To give a presentation, about the study conducted until now, to Dr. Waqar Final year project discussion. Final year project discussion. Maggie website Management Maggie website Management

Progress Problems in understanding mathematics involved in Fuzzy Association rules & Frequency Episodes. Problems in understanding mathematics involved in Fuzzy Association rules & Frequency Episodes. Website is being updated. Website is being updated. Just some presentations remaining. Just some presentations remaining.

Fuzzy Association Rules Used as a tool for analyses of retail sales. Used as a tool for analyses of retail sales. Piece sales data…..a transaction Piece sales data…..a transaction AR to find correlation among different items in a transaction. AR to find correlation among different items in a transaction. Customer example. Customer example. Let D={T1,T2,……Tn} be the transaction database with n transactions. Let D={T1,T2,……Tn} be the transaction database with n transactions. I ={i1,i2,….im} items I ={i1,i2,….im} items

Fuzzy Association Rules contd. Each Ti in D records items purchased. Each Ti in D records items purchased. An association rule will have the form X  Y, c, s where X belongs to I and Y belongs to I An association rule will have the form X  Y, c, s where X belongs to I and Y belongs to I X and Y are disjoint item sets. X and Y are disjoint item sets. s represents the support of this association rule. s represents the support of this association rule. c represents the confidence. c represents the confidence.

Fuzzy Association Rules contd. n’, number of transactions that contained both X and Y. n’, number of transactions that contained both X and Y. s(XUY)=n’/n and c= support (XUY)/support(X) s(XUY)=n’/n and c= support (XUY)/support(X) Support(X) = occurrence of item X in whole D Support(X) = occurrence of item X in whole D C indicated when X is satisfied, there will be certainty of c that y is also true. C indicated when X is satisfied, there will be certainty of c that y is also true. Thresholds minconfidence and minsupport are used to mine association rules. Thresholds minconfidence and minsupport are used to mine association rules.

Fuzzy Association Rules contd. Such that c>=minconfidence and s>=minsupport Such that c>=minconfidence and s>=minsupport Any item set X is called large item set if support(X) >=minsupport. Any item set X is called large item set if support(X) >=minsupport. Mining algorithm involves 2 steps. Mining algorithm involves 2 steps. 1) find all the large item set 1) find all the large item set 2) Construct association rules for each. 2) Construct association rules for each.

References MINING FUZZY ASSOCIATION RULES MINING FUZZY ASSOCIATION RULES AND FUZZY FREQUENCY EPISODES AND FUZZY FREQUENCY EPISODES FOR INTRUSION DETECTION FOR INTRUSION DETECTION by by Jianxiong Luo Jianxiong Luo Susan M. Bridges1 Susan M. Bridges1

Future Task To study the remaining issues related model. To study the remaining issues related model.