يادگيري ماشين Machine Learning Lecturer: A. Rabiee

Slides:



Advertisements
Similar presentations
Machine Learning Basics 1. General Introduction
Advertisements

Godfather to the Singularity
Data Mining Classification: Basic Concepts, Decision Trees, and Model Evaluation Lecture Notes for Chapter 4 Part I Introduction to Data Mining by Tan,
INTRODUCTION TO MACHINE LEARNING David Kauchak CS 451 – Fall 2013.
An Introduction of Support Vector Machine
An Overview of Machine Learning
Kansas State University Department of Computing and Information Sciences Laboratory for Knowledge Discovery in Databases (KDD) KDD Group Research Seminar.
WRSTA, 13 August, 2006 Rough Sets in Hybrid Intelligent Systems For Breast Cancer Detection By Aboul Ella Hassanien Cairo University, Faculty of Computer.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Introduction to Machine Learning Anjeli Singh Computer Science and Software Engineering April 28 th 2008.
Data Mining with Decision Trees Lutz Hamel Dept. of Computer Science and Statistics University of Rhode Island.
1 MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING By Kaan Tariman M.S. in Computer Science CSCI 8810 Course Project.
Learning Programs Danielle and Joseph Bennett (and Lorelei) 4 December 2007.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
12 -1 Lecture 12 User Modeling Topics –Basics –Example User Model –Construction of User Models –Updating of User Models –Applications.
INTRODUCTION TO Machine Learning 3rd Edition
Presented To: Madam Nadia Gul Presented By: Bi Bi Mariam.
Introduction to machine learning
Introduction to Data Mining Engineering Group in ACL.
Machine Learning Usman Roshan Dept. of Computer Science NJIT.
CS Machine Learning. What is Machine Learning? Adapt to / learn from data  To optimize a performance function Can be used to:  Extract knowledge.
1 © Goharian & Grossman 2003 Introduction to Data Mining (CS 422) Fall 2010.
University of Toronto 8/30/20151 Data Mining The Art and Science of Obtaining Knowledge from Data Dr. Saed Sayad.
JM - 1 Introduction to Bioinformatics: Lecture VIII Classification and Supervised Learning Jarek Meller Jarek Meller Division.
Intelligent Systems Lecture 23 Introduction to Intelligent Data Analysis (IDA). Example of system for Data Analyzing based on neural networks.
CSCI 347 – Data Mining Lecture 01 – Course Overview.
Short Introduction to Machine Learning Instructor: Rada Mihalcea.
CpSc 881: Machine Learning Introduction. 2 Copy Right Notice Most slides in this presentation are adopted from slides of text book and various sources.
Machine Learning An Introduction. What is Learning?  Herbert Simon: “Learning is any process by which a system improves performance from experience.”
Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.
Machine Learning Lecture 1. Course Information Text book “Introduction to Machine Learning” by Ethem Alpaydin, MIT Press. Reference book “Data Mining.
Some working definitions…. ‘Data Mining’ and ‘Knowledge Discovery in Databases’ (KDD) are used interchangeably Data mining = –the discovery of interesting,
Yazd University, Electrical and Computer Engineering Department Course Title: Advanced Software Engineering By: Mohammad Ali Zare Chahooki 1 Introduction.
Gesture Recognition & Machine Learning for Real-Time Musical Interaction Rebecca Fiebrink Assistant Professor of Computer Science (also Music) Princeton.
Text Feature Extraction. Text Classification Text classification has many applications –Spam detection –Automated tagging of streams of news articles,
1 Machine Learning 1.Where does machine learning fit in computer science? 2.What is machine learning? 3.Where can machine learning be applied? 4.Should.
Learning from observations
CISC Machine Learning for Solving Systems Problems Presented by: Ashwani Rao Dept of Computer & Information Sciences University of Delaware Learning.
Classification Derek Hoiem CS 598, Spring 2009 Jan 27, 2009.
WEEK INTRODUCTION IT440 ARTIFICIAL INTELLIGENCE.
Data Mining: Knowledge Discovery in Databases Peter van der Putten ALP Group, LIACS Pre-University College Bio Informatics January
Artificial Intelligence, simulation and modelling.
Introduction to Machine Learning August, 2014 Vũ Việt Vũ Computer Engineering Division, Electronics Faculty Thai Nguyen University of Technology.
Sotarat Thammaboosadee, Ph.D. EGIT563- Data Mining Course Outline.
FNA/Spring CENG 562 – Machine Learning. FNA/Spring Contact information Instructor: Dr. Ferda N. Alpaslan
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
Machine Learning Usman Roshan Dept. of Computer Science NJIT.
Usman Roshan Dept. of Computer Science NJIT
Brief Intro to Machine Learning CS539
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Machine Learning for Computer Security
Machine Learning overview Chapter 18, 21
Machine Learning overview Chapter 18, 21
Introduction Machine Learning 14/02/2017.
Intro to Machine Learning
School of Computer Science & Engineering
Table 1. Advantages and Disadvantages of Traditional DM/ML Methods
RESEARCH APPROACH.
Estimating Link Signatures with Machine Learning Algorithms
What is Pattern Recognition?
Machine Learning Week 1.
Basic Intro Tutorial on Machine Learning and Data Mining
Prepared by: Mahmoud Rafeek Al-Farra
Prepared by: Mahmoud Rafeek Al-Farra
Machine Learning 101 Intro to AI, ML, Deep Learning
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Dept. of Computer Science University of Liverpool
Presentation transcript:

يادگيري ماشين Machine Learning Lecturer: A. Rabiee azrabiee@gmail.com Rabiee.iauda.ac.ir

منابع و مراجع Main Reference: - Mitchell, T. M. (1997). Machine learning. WCB. Other References: Haykin, S. S. (2009). Neural networks and learning machines (Vol. 3). Upper Saddle River: Pearson Education. Mitchell, T. M. (1999). Machine learning and data mining. Communications of the ACM, 42(11), 30-36. Anderson, J. R. (1986). Machine learning: An artificial intelligence approach(Vol. 2). R. S. Michalski, J. G. Carbonell, & T. M. Mitchell (Eds.). Morgan Kaufmann. Mitchell, M. (1998). An introduction to genetic algorithms. MIT press. Witten, I. H., & Frank, E. (2011). Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann. Hagan, M. T., Demuth, H. B., & Beale, M. H. (1996). Neural network design(pp. 2-14). Boston: Pws Pub.. Kecman, V. (2001). Learning and soft computing: support vector machines, neural networks, and fuzzy logic models. MIT press. - …. http://coel.ecgf.uakron.edu/durkin/esbook.htm

Course Outline Chapter 1: Introduction Chapter 3: Decision tree learning Chapter 4: Artificial Neural Networks Chapter 9: Genetic Algorithms Chapter 13: Reinforcement Learning

ارزشيابي درس Final Exam: 50 Mini Projects (2 to 4): 20 Final Project + Presentation: 30 Paper (optional): +15

Introduction to Machine Learning Chapter 1: Introduction to Machine Learning

Table of Contents Definition & Examples Applications Why ML? ML Problems

Definition (Mitchell 1997) Machine Learning Learn from past experiences Improve the performances of intelligent programs Definition A computer program is said to learn from experience E with respect to some class of tasks T and performance measure P, if its performance at the tasks improves with the experiences

Examples Text Classification (or spam classification) Task T Assigning texts to a set of predefined categories Performance measure P Precision of each category Training experiences E (Dataset) A dataset of texts with their corresponding categories How about Disease Diagnosis? How about Chess Playing?

Two phases Two phases of a learning process: Train Test

Example: Classification of texts based on content Text classifier New text file class Classified text files Text file 1 trade Text file 2 ship … … Training Phase 1: train Phase 2: test

Example: Heart disease diagnosis Disease classifier New patient’s data Presence or absence Database of medical records Patient 1’s data Absence Patient 2’s data Presence … … Training

Example: Chess Playing Strategy of Searching and Evaluating New matrix representing the current board Best move Games played: Game 1’s move list Win Game 2’s move list Lose … … Training

Machine Learning Problems Clustering: Grouping similar instances Dimension Reduction: Image Compression Regression: Tuning the angle of a robot arm

Application: Image Categorization (two phases) Training Labels Training Images Classifier Training Training Image Features Trained Classifier Image Features Testing Test Image Trained Classifier Outdoor Prediction

Feature Extraction Training Training Labels Classifier Training Training Images Classifier Training Training Image Features Trained Classifier

Example: Boundary Detection Is this a boundary?

Training Algorithm Training Training Labels Classifier Training Training Images Classifier Training Training Image Features Trained Classifier The main aim of this course

Classifier Training Example: A 2-class classifier Given some set of features with corresponding labels, learn a function to predict the labels from the features Example: Credit scoring Discriminant (model): IF income > θ1 AND savings > θ2 THEN low-risk ELSE high-risk

Different Learning Algorithms Decision Tree Learning Neural networks Naïve Bayes Genetic Algorithm K-nearest neighbor (clustering) Reinforcement Learning Support Vector Machine (SVM) …

Note The decision to use machine learning is more important than the choice of a particular learning method.

Why Machine Learning Is Possible? Mass Storage More data available Higher Performance of Computer Larger memory in handling the data Greater computational power for calculating and even online learning

Advantages Alleviate Knowledge Acquisition Bottleneck Adaptive Does not require knowledge engineers Scalable in constructing knowledge base Adaptive Adaptive to the changing conditions Easy in migrating to new domains

Success of Machine Learning Almost All the Learning Algorithms Text classification (Dumais et al. 1998) Gene or protein classification optionally with feature engineering (Bhaskar et al. 2006) Reinforcement Learning Backgammon (Tesauro 1995) Learning of Sequence Labeling Speech recognition (Lee 1989) Part-of-speech tagging (Church 1988)

Datasets UCI Repository: http://www.ics.uci.edu/~mlearn/MLRepository.html UCI KDD Archive: http://kdd.ics.uci.edu/summary.data.application.html Statlib: http://lib.stat.cmu.edu/ Delve: http://www.cs.utoronto.ca/~delve/ US government free data: data.gov US government free data (California): data.ca.gov …. for other states and the UK data.gov.uk, as well Stock market softwares Weather forecasting websites Reuters: data set for text classification ….

What I will Talk about Machine Learning Methods Method Details Simple methods Effective methods (state of the art) Method Details Ideas Assumptions Intuitive interpretations

What I won’t Talk about Machine Learning Methods Method Details Classical, but complex and not effective methods (e.g., complex neural networks) Methods not widely used Method Details Theoretical justification Theorem proving

What You will Learn Machine Learning Basics Others Methods Data Assumptions Ideas Others Problem solving techniques Extensive knowledge of modern techniques