INTRODUCTION TO DATA MINING MIS2502 Data Analytics.

Slides:



Advertisements
Similar presentations
Data Warehousing and Data Mining J. G. Zheng May 20 th 2008 MIS Chapter 3.
Advertisements

Supporting End-User Access
QMM 384 – Data Mining Data Mining: Introduction Introduction to Predictive Analytics.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 5 Clarifying the Research.
McGraw-Hill/Irwin Business Research Methods, 10eCopyright © 2008 by The McGraw-Hill Companies, Inc. All Rights Reserved. Chapter 5 Clarifying the Research.
1 ACCTG 6910 Building Enterprise & Business Intelligence Systems (e.bis) Introduction to Data Mining Olivia R. Liu Sheng, Ph.D. Emma Eccles Jones Presidential.
Week 9 Data Mining System (Knowledge Data Discovery)
© Prentice Hall1 DATA MINING TECHNIQUES Introductory and Advanced Topics Eamonn Keogh (some slides adapted from) Margaret Dunham Dr. M.H.Dunham, Data Mining,
Data Mining.
Data Mining By Archana Ketkar.
Clarifying the Research Question through Secondary Data and Exploration Chapter 5 組員 黎旭崴 李承霖.
Data Mining Ketaki Borkar CS157A November 29, 2007.
Data Mining – Intro.
CS157A Spring 05 Data Mining Professor Sin-Min Lee.
Data mining By Aung Oo.
DASHBOARDS Dashboard provides the managers with exactly the information they need in the correct format at the correct time. BI systems are the foundation.
TURKISH STATISTICAL INSTITUTE INFORMATION TECHNOLOGIES DEPARTMENT (Muscat, Oman) DATA MINING.
Enterprise systems infrastructure and architecture DT211 4
Data Mining By Andrie Suherman. Agenda Introduction Major Elements Steps/ Processes Tools used for data mining Advantages and Disadvantages.
Data Mining: Concepts & Techniques. Motivation: Necessity is the Mother of Invention Data explosion problem –Automated data collection tools and mature.
OLAM and Data Mining: Concepts and Techniques. Introduction Data explosion problem: –Automated data collection tools and mature database technology lead.
Knowledge Discovery & Data Mining process of extracting previously unknown, valid, and actionable (understandable) information from large databases Data.
Data Mining Techniques
MAKING THE BUSINESS BETTER Presented By Mohammed Dwikat DATA MINING Presented to Faculty of IT MIS Department An Najah National University.
Understanding Data Analytics and Data Mining Introduction.
MD240 - MIS Oct. 4, 2005 Databases & the Data Asset Harrah’s & Allstate Cases.
Data Mining CS157B Fall 04 Professor Lee By Yanhua Xue.
Introduction to Data Mining Group Members: Karim C. El-Khazen Pascal Suria Lin Gui Philsou Lee Xiaoting Niu.
Data Mining Chapter 1 Introduction -- Basic Data Mining Tasks -- Related Concepts -- Data Mining Techniques.
Banking on Analytics Dr A S Ramasastri Director, IDRBT.
Fox MIS Spring 2011 Data Mining Week 9 Introduction to Data Mining.
1 Categories of data Operational and very short-term decision making data Current, short-term decision making, related to financial transactions, detailed.
Data Mining – Intro. Course Overview Spatial Databases Temporal and Spatio-Temporal Databases Multimedia Databases Data Mining.
1 Topics about Data Warehouses What is a data warehouse? How does a data warehouse differ from a transaction processing database? What are the characteristics.
CS157B Fall 04 Introduction to Data Mining Chapter 22.3 Professor Lee Yu, Jianji (Joseph)
EXAM REVIEW MIS2502 Data Analytics. Exam What Tool to Use? Evaluating Decision Trees Association Rules Clustering.
Advanced Database Course (ESED5204) Eng. Hanan Alyazji University of Palestine Software Engineering Department.
1 Categories of data Operational and very short-term decision making data Current, short-term decision making, related to financial transactions, detailed.
CRM - Data mining Perspective. Predicting Who will Buy Here are five primary issues that organizations need to address to satisfy demanding consumers:
Chapter 5: Business Intelligence: Data Warehousing, Data Acquisition, Data Mining, Business Analytics, and Visualization DECISION SUPPORT SYSTEMS AND BUSINESS.
New Developments in Business Intelligence ( Decision Support Systems) BUS 782.
1 What is Data Mining? l Data mining is the process of automatically discovering useful information in large data repositories. l There are many other.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
Secondary Data Searches
MIS2502: Data Analytics Advanced Analytics - Introduction.
DATA MINING PREPARED BY RAJNIKANT MODI REFERENCE:DOUG ALEXANDER.
Copyright © 2003 by The McGraw-Hill Companies, Inc. All rights reserved.
1 Categories of data Operational and very short-term decision making data Current, short-term decision making, related to financial transactions, detailed.
Academic Year 2014 Spring Academic Year 2014 Spring.
Data Resource Management Agenda What types of data are stored by organizations? How are different types of data stored? What are the potential problems.
Data Mining. Overview the extraction of hidden predictive information from large databases Data mining tools predict future trends and behaviors, allowing.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
Waqas Haider Bangyal. 2 Source Materials “ Data Mining: Concepts and Techniques” by Jiawei Han & Micheline Kamber, Second Edition, Morgan Kaufmann, 2006.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
Chapter 3 Building Business Intelligence Chapter 3 DATABASES AND DATA WAREHOUSES Building Business Intelligence 6/22/2016 1Management Information Systems.
Data Resource Management – MGMT An overview of where we are right now SQL Developer OLAP CUBE 1 Sales Cube Data Warehouse Denormalized Historical.
Data Mining – Introduction (contd…) Compiled By: Umair Yaqub Lecturer Govt. Murray College Sialkot.
Data Mining Functionalities
Data Mining – Intro.
Chapter 1 Introduction.
MIS2502: Data Analytics Advanced Analytics - Introduction
DATA MINING © Prentice Hall.
Chapter 1 Introduction.
MIS5101: Data Analytics Advanced Analytics - Introduction
Data Warehousing and Data Mining
Supporting End-User Access
Data Mining: Introduction
MIS2502: Data Analytics Introduction to Advanced Analytics
Welcome! Knowledge Discovery and Data Mining
MIS2502: Data Analytics Introduction to Advanced Analytics and R
Presentation transcript:

INTRODUCTION TO DATA MINING MIS2502 Data Analytics

The Information Architecture of an Organization Transactional Database Analytical Data Store Stores real-time transactional data Stores historical transactional and summary data Data entry Data extraction Data analysis Now we’re here…

The difference between data mining and OLAP Analytical Data Store The (dimensional) data warehouse feed both… OLAP can tell you what is happening, or what has happened Data mining can tell you why it is happening, and help predict what will happen

The Evolution of Data Analytics Evolutionary Step Business QuestionEnabling Technologies Characteristics Data Collection (1960s) "What was my total revenue in the last five years?" Storage: Computers, tapes, disks Retrospective, static data delivery Data Access (1980s) "What were unit sales in New England last March?" Relational databases (RDBMS), Structured Query Language (SQL) Retrospective, dynamic data delivery at record level Data Warehousing/ Decision Support (1990s) "What were unit sales in New England last March?” Now “drill down” to Boston? On-line analytical processing (OLAP), dimensional databases, data warehouses Retrospective, dynamic data delivery at multiple levels Data Mining (2000s and beyond) "What’s likely to happen to Boston unit sales next month? Why?" Advanced algorithms, parallel computing, massive databases Prospective, proactive information delivery

Origins of Data Mining Draws ideas from Artificial intelligence Pattern recognition Statistics Database systems Traditional techniques may not work because of Sheer amount of data High dimensionality of data Heterogeneous, distributed nature of data Artificial intelligence Pattern recognition Statistics Database systems Data Mining

What data mining is… Extraction of implicit, previously unknown and potentially useful information from data Exploration & analysis of large quantities of data in order to discover meaningful patterns

What data mining is not… What are the sales by quarter and region? How do sales compare in two different stores in the same state? Sales analysis Which is the most profitable store in Pennsylvania? Which product lines are the highest revenue producers this year? Which product lines are the most profitable? Profitability analysis Which salesperson produced the most revenue this year? Does salesperson X meet this quarter’s target? Sales force analysis If these aren’t data mining examples, then what are they ? If these aren’t data mining examples, then what are they ?

Data Mining Tasks Use some variables to predict unknown or future values of other variables Likelihood of a particular outcome Prediction Methods Find human-interpretable patterns that describe the data Description Methods from Fayyad et al., Advances in Knowledge Discovery and Data Mining, 1996

Case Study You are a marketing manager for a brokerage company Problem: High churn (i.e., customers leave) Turnover (after 6 month introductory period) is 40% They get a reward (average cost: $160) to open an account Giving more incentives to everyone who might leave is expensive and wasteful And getting a customer back after they leave is difficult and costly

…a solution One month before the end of the introductory period, predict which customers will leave Offer those customers something based on their future value Ignore the ones that are not predicted to churn

Data Mining Tasks Descriptive Clustering Association Rule Discovery Sequential Pattern Discovery Visualization Predictive Classification Regression Neural Networks Deviation Detection

Decision Trees Used to classify data according to a pre-defined outcome Based on characteristics of that data Uses Predict whether a customer should receive a loan Flag a credit card charge as legitimate Determine whether an investment will pay off decision-chart/

Ok…here’s a real one Will a customer buy some product given their demographics? What are the characteristics of customers who are likely to buy?

Clustering Used to determine distinct groups of data Based on data across multiple dimensions Uses Customer segmentation Identifying patient care groups Performance of business sectors from precision-and-response-rates/ Here you have four clusters of web site visitors. What does this tell you?

Association Rules Used to determine which events occur together Usually that “event” is a product purchase Uses Determine which products are bought together Which web sites are likely to be visited in a single session Find sets of customization options that should bundled BasketItems 1 In-seat DVD Upgraded sound 2 Upgraded sound Leather seats 3 Upgraded sound Mud flaps In-seat DVD 4 Premium dashboard trim Upgraded sound In-seat DVD 5 Power moonroof Upgraded sound |In-seat DVD What features should be sold in a discounted bundle?

Bottom line In large sets of data, these patterns aren’t obvious And we can’t just figure it out in our head We need analytics software We’ll be using SAS to perform these three analyses on large sets of data Decision Trees Clustering Association Rules