Lecture 9: Knowledge Discovery Systems Md. Mahbubul Alam, PhD Associate Professor Dept. of AEIS Sher-e-Bangla Agricultural University.

Slides:



Advertisements
Similar presentations
Web Mining.
Advertisements

Data Mining in Computer Games By Adib Adam Hussain & Mohammed Sarfraz.
Back to Table of Contents
Web Mining Research: A Survey Authors: Raymond Kosala & Hendrik Blockeel Presenter: Ryan Patterson April 23rd 2014 CS332 Data Mining pg 01.
Data Mining Sangeeta Devadiga CS 157B, Spring 2007.
Overview of Data Mining & The Knowledge Discovery Process Bamshad Mobasher DePaul University Bamshad Mobasher DePaul University.
Chapter 12: Web Usage Mining - An introduction
DATA MINING CS157A Swathi Rangan. A Brief History of Data Mining The term “Data Mining” was only introduced in the 1990s. Data Mining roots are traced.
© Prentice Hall1 DATA MINING TECHNIQUES Introductory and Advanced Topics Eamonn Keogh (some slides adapted from) Margaret Dunham Dr. M.H.Dunham, Data Mining,
Web Mining Research: A Survey
Becerra-Fernandez, et al. -- Knowledge Management 1/e -- © 2004 Prentice Hall Chapter 13 Knowledge Discovery Systems: Systems That Create Knowledge.
Overview of Web Data Mining and Applications Part I
DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.
Chapter 5 Data mining : A Closer Look.
Data Mining By Andrie Suherman. Agenda Introduction Major Elements Steps/ Processes Tools used for data mining Advantages and Disadvantages.
Dr. Awad Khalil Computer Science Department AUC
 Data mining is sorting through data to identify patterns and establish relationships  Sifting through very large amounts of data for useful information.
Consumer Behavior, Market Research
Business Intelligence, Data Mining and Data Analytics/Predictive Analytics By: Asela Thomason IS 495 Summer 2015.
Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.
Kansas State University Department of Computing and Information Sciences CIS 830: Advanced Topics in Artificial Intelligence From Data Mining To Knowledge.
Data Mining Techniques As Tools for Analysis of Customer Behavior
Data Mining Chun-Hung Chou
Enabling Organization-Decision Making
Research paper: Web Mining Research: A survey SIGKDD Explorations, June Volume 2, Issue 1 Author: R. Kosala and H. Blockeel.
Chapter 7 DATA, TEXT, AND WEB MINING Pages , 311, Sections 7.3, 7.5, 7.6.
Overview of Data Mining Methods Data mining techniques What techniques do, examples, advantages & disadvantages.
Data Mining CS157B Fall 04 Professor Lee By Yanhua Xue.
1 1 Slide Introduction to Data Mining and Business Intelligence.
1 Chapter 7: Business Marketing Copyright Cengage Learning 2013 All Rights Reserved Designed & Prepared by Laura Rush B-books, Ltd. Introduction to.
Data Mining Chapter 1 Introduction -- Basic Data Mining Tasks -- Related Concepts -- Data Mining Techniques.
Chapter 7 Neural Networks in Data Mining Automatic Model Building (Machine Learning) Artificial Intelligence.
Copyright © 2013 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill/Irwin Business Plug-In B18 Business Intelligence.
Data MINING Data mining is the process of extracting previously unknown, valid and actionable information from large data and then using the information.
Data Mining By Dave Maung.
Chapter 12: Web Usage Mining - An introduction Chapter written by Bamshad Mobasher Many slides are from a tutorial given by B. Berendt, B. Mobasher, M.
Guest Lecture Introduction to Data Mining Dr. Bhavani Thuraisingham September 17, 2010.
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
Chapter 5: Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization DECISION SUPPORT SYSTEMS AND BUSINESS.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
An Investigation of Commercial Data Mining Presented by Emily Davis Supervisor: John Ebden.
Search Engine using Web Mining COMS E Web Enhanced Information Mgmt Prof. Gail Kaiser Presented By: Rupal Shah (UNI: rrs2146)
1 Introduction to Data Mining C hapter 1. 2 Chapter 1 Outline Chapter 1 Outline – Background –Information is Power –Knowledge is Power –Data Mining.
DATA MINING PREPARED BY RAJNIKANT MODI REFERENCE:DOUG ALEXANDER.
Academic Year 2014 Spring Academic Year 2014 Spring.
Becerra-Fernandez, et al. -- Knowledge Management 1/e -- © 2004 Prentice Hall Week 11 Knowledge Discovery Systems: Systems That Create Knowledge.
Data Mining Copyright KEYSOFT Solutions.
Copyright ©2005 by South-Western, a division of Thomson Learning. All rights reserved. Introduction to Marketing.
Knowledge Discovery and Data Mining 19 th Meeting Course Name: Business Intelligence Year: 2009.
ERP and Related Technologies
DATA MINING It is a process of extracting interesting(non trivial, implicit, previously, unknown and useful ) information from any data repository. The.
Copyright  2007 McGraw-Hill Pty Ltd PPTs t/a Marketing Research 2e by Lukas, Hair, Bush and Ortinau Slides prepared by Judy Rex 19-1 Chapter Nineteen.
Chapter 3 Building Business Intelligence Chapter 3 DATABASES AND DATA WAREHOUSES Building Business Intelligence 6/22/2016 1Management Information Systems.
Data Resource Management – MGMT An overview of where we are right now SQL Developer OLAP CUBE 1 Sales Cube Data Warehouse Denormalized Historical.
Data Mining: Confluence of Multiple Disciplines Data Mining Database Systems Statistics Other Disciplines Algorithm Machine Learning Visualization.
Data mining in web applications
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
KNOWLEDGE MANAGEMENT (KM) Session # 38
DATA MINING © Prentice Hall.
Business Analytics Applications in Budget Modelling
Web Mining Ref:
Knowledge Discovery Systems: Systems That Create Knowledge
Knowledge Discovery Systems: Systems That Create Knowledge
Sangeeta Devadiga CS 157B, Spring 2007
Week 11 Knowledge Discovery Systems & Data Mining :
Supporting End-User Access
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
KNOWLEDGE MANAGEMENT (KM) Session # 37
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Kenneth C. Laudon & Jane P. Laudon
Presentation transcript:

Lecture 9: Knowledge Discovery Systems Md. Mahbubul Alam, PhD Associate Professor Dept. of AEIS Sher-e-Bangla Agricultural University

To explain how knowledge is discovered. To describe knowledge discovery systems, including design considerations, and how they rely on mechanisms and technologies. To explain data mining technologies. Chapter Highlights 2

To discover tacit knowledge Socialization enables the discovery of tacit knowledge through joint activities – between masters and apprentices – between researchers at an academic conference Knowledge Synthesis through Socialization 3

Another name for Knowledge Discovery in Databases is data mining (DM). Data mining systems have made a significant contribution in scientific fields for years. The recent proliferation of e-commerce applications, providing reams of hard data ready for analysis, presents us with an excellent opportunity to make profitable use of data mining. Knowledge Discovery from Data-Data Mining 4

Marketing–Predictive DM techniques, like artificial neural networks (ANN), have been used for target marketing including market segmentation. Direct marketing–customers are likely to respond to new products based on their previous consumer behavior. Retail–DM methods have likewise been used for sales forecasting. Market basket analysis–uncover which products are likely to be purchased together. Banking–Trading and financial forecasting are used to determine derivative securities pricing, futures price forecasting, and stock performance. Insurance–DM techniques have been used for segmenting customer groups to determine premium pricing and predict claim frequencies. Telecommunications–Predictive DM techniques have been used to attempt to reduce churn, and to predict when customers will attrition to a competitor. Operations management–Neural network techniques have been used for planning and scheduling, project management, and quality control. Data Mining Techniques Applications 5

1.Business Understanding–To obtain the highest benefit from data mining, there must be a clear statement of the business objectives. 2.Data Understanding–Knowing the data well can permit the designer to tailor the algorithm or tools used for data mining to his/her specific problem. 3.Data Preparation –Data selection, variable construction and transformation, integration, and formatting. 4.Model building and validation–Building an accurate model is a trial and error process. The process often requires the data mining specialist to iteratively try several options, until the best model emerges. 5.Evaluation and interpretation–Once the model is determined, the validation dataset is fed through the model. 6.Deployment –Involves implementing the ‘live’ model within an organization to aid the decision making process. Designing the Knowledge Discovery Systems 6

Data Mining Process Methodology 7

Iterative Nature of Knowledge Discovery Process 8

1.Predictive Techniques – Classification: Data mining techniques in this category serve to classify the discrete outcome variable. – Prediction or Estimation: DM techniques in this category predict a continuous outcome (as opposed to classification techniques that predict discrete outcomes). 2.Descriptive Techniques – Affinity or association: Data mining techniques in this category serve to find items closely associated in the data set. – Clustering: DM techniques in this category aim to create clusters of input objects, rather than an outcome variable. Data Mining Techniques 9

1.Web structure mining –Examines how the Web documents are structured, and attempts to discover the model underlying the link structures of the Web. It can be useful to categorize Web pages, and to generate relationships and similarities among Web sites. – Intra-page structure mining evaluates the arrangement of the various HTML or XML tags within a page – Inter-page structure refers to hyper-links connecting one page to another. 2.Web usage mining (Clickstream Analysis)–Involves the identification of patterns in user navigation through Web pages in a domain. – Processing, Pattern analysis, and Pattern discovery 3.Web content mining –Used to discover what a Web page is about and how to uncover new knowledge from it. Web Data Mining: Types 10