CS 445/545 Machine Learning Spring, 2013 See syllabus at

Slides:



Advertisements
Similar presentations
CHAPTER 2: Supervised Learning. Lecture Notes for E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1) 2 Learning a Class from Examples.
Advertisements

CPSC 502, Lecture 15Slide 1 Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 15 Nov, 1, 2011 Slide credit: C. Conati, S.
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.
Learning from Observations Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 18 Spring 2004.
Introduction to Machine Learning Anjeli Singh Computer Science and Software Engineering April 28 th 2008.
CIS 678 Artificial Intelligence problems deduction, reasoning knowledge representation planning learning natural language processing motion and manipulation.
01 -1 Lecture 01 Artificial Intelligence Topics –Introduction –Knowledge representation –Knowledge reasoning –Machine learning –Applications.
1 Lecture 5: Automatic cluster detection Lecture 6: Artificial neural networks Lecture 7: Evaluation of discovered knowledge Brief introduction to lectures.
Learning from Observations Chapter 18 Section 1 – 4.
Learning from Observations Copyright, 1996 © Dale Carnegie & Associates, Inc. Chapter 18 Fall 2004.
1 MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING By Kaan Tariman M.S. in Computer Science CSCI 8810 Course Project.
INTRODUCTION TO Machine Learning ETHEM ALPAYDIN © The MIT Press, Lecture Slides for.
Part I: Classification and Bayesian Learning
Introduction to machine learning
CS Machine Learning. What is Machine Learning? Adapt to / learn from data  To optimize a performance function Can be used to:  Extract knowledge.
CS 478 – Introduction1 Introduction to Machine Learning CS 478 Professor Tony Martinez.
Kansas State University Department of Computing and Information Sciences CIS 830: Advanced Topics in Artificial Intelligence Wednesday, January 19, 2001.
Copyright R. Weber Machine Learning, Data Mining ISYS370 Dr. R. Weber.
Data Mining Joyeeta Dutta-Moscato July 10, Wherever we have large amounts of data, we have the need for building systems capable of learning information.
INTRODUCTION TO MACHINE LEARNING. $1,000,000 Machine Learning  Learn models from data  Three main types of learning :  Supervised learning  Unsupervised.
Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.
CPSC 502, Lecture 15Slide 1 Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 16 Nov, 3, 2011 Slide credit: C. Conati, S.
Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.
Mehdi Ghayoumi MSB rm 132 Ofc hr: Thur, a Machine Learning.
Lecture 10: 8/6/1435 Machine Learning Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Learning from Observations Chapter 18 Through
CHAPTER 18 SECTION 1 – 3 Learning from Observations.
CS 445/545 Machine Learning Winter, 2012 Course overview: –Instructor Melanie Mitchell –Textbook Machine Learning: An Algorithmic Approach by Stephen Marsland.
Overview of Machine Learning RPI Robotics Lab Spring 2011 Kane Hadley.
Learning from observations
Machine Learning, Decision Trees, Overfitting Machine Learning Tom M. Mitchell Machine Learning Department Carnegie Mellon University January 14,
Kernel adaptive filtering Lecture slides for EEL6502 Spring 2011 Sohan Seth.
Concept learning, Regression Adapted from slides from Alpaydin’s book and slides by Professor Doina Precup, Mcgill University.
CS Inductive Bias1 Inductive Bias: How to generalize on novel data.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 A self-organizing map for adaptive processing of structured.
CS 445/545 Machine Learning Winter, 2014 See syllabus at
Data Mining and Decision Support
Machine Learning Chapter 18, 21 Some material adopted from notes by Chuck Dyer.
Artificial Neural Networks for Data Mining. Copyright © 2011 Pearson Education, Inc. Publishing as Prentice Hall 6-2 Learning Objectives Understand the.
Machine Learning Lecture 1: Intro + Decision Trees Moshe Koppel Slides adapted from Tom Mitchell and from Dan Roth.
SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.
Network Management Lecture 13. MACHINE LEARNING TECHNIQUES 2 Dr. Atiq Ahmed Université de Balouchistan.
CMPS 142/242 Review Section Fall 2011 Adapted from Lecture Slides.
Machine Learning with Spark MLlib
Who am I? Work in Probabilistic Machine Learning Like to teach 
CS 445/545 Machine Learning Winter, 2017
Machine Learning for Computer Security
Data-intensive Computing Algorithms: Classification
Machine Learning overview Chapter 18, 21
Machine Learning overview Chapter 18, 21
Machine Learning & Deep Learning
Lecture 3: Linear Regression (with One Variable)
CS 445/545 Machine Learning Spring, 2017
Neural Networks for Machine Learning Lecture 1e Three types of learning Geoffrey Hinton with Nitish Srivastava Kevin Swersky.
Introduction to Data Science Lecture 7 Machine Learning Overview
CH. 1: Introduction 1.1 What is Machine Learning Example:
Dipartimento di Ingegneria «Enzo Ferrari»,
Machine Learning & Data Science
INTRODUCTION TO Machine Learning
Basic Intro Tutorial on Machine Learning and Data Mining
Overview of Machine Learning
Supervised vs. unsupervised Learning
3.1.1 Introduction to Machine Learning
Lecture 6: Introduction to Machine Learning
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
AI and Machine Learning
Machine learning overview
CS639: Data Management for Data Science
INTRODUCTION TO Machine Learning
Presentation transcript:

CS 445/545 Machine Learning Spring, 2013 See syllabus at Lecture slides will be posted on this website before each class.

Use of laptops, phones, etc. in class: –Please don’t, unless you are using it to take notes or view class slides.

What is machine learning? Textbook definitions of “machine learning”: –Detecting patterns and regularities with a good and generalizable approximation (“model” or “hypothesis”) –Execution of a computer program to optimize the parameters of the model using training data or past experience.

Training Examples: Class 1Training Examples: Class 2 Test example: Class = ?

Training Examples: Class 1Training Examples: Class 2 Test example: Class = ?

Training Examples: Class 1Training Examples: Class 2 Test example: Class = ?

Training Examples: Class 1Training Examples: Class 2 Test example: Class = ?

Training Examples: Class 1Training Examples: Class 2 Test example: Class = ?

Training Examples: Class 1Training Examples: Class 2 Test example: Class = ?

Any observations from these machine learning examples?

Types of machine learning tasks Classification –Output is one of a number of classes (e.g., ‘A’) Regression –Output is a real value (e.g., ‘$35/share”)

Types of Machine Learning Methods Supervised –provide explicit training examples with correct answers e.g. neural networks with back-propagation Unsupervised –no feedback information is provided e.g., unsupervised clustering based on similarity

“Semi-supervised” –some feedback information is provided but it is not detailed e.g., only a fraction of examples are labeled e.g., reinforcement learning: reinforcement single is single-valued assessment of current state

Relation between “artificial intelligence” and “machine learning”?

Key Ingredients for Any Machine Learning Method Features (or “attributes”) Underlying representation for “hypothesis”, “model”, or “target function”: Hypothesis space

Learning method Data: Divide into two or three parts. –Training data Used to train the model –Validation data Used to select model complexity, to determine when to stop training, or to alter training method –Test data Used to evaluate trained model Evaluation method

From: "TopShop" To: Subject: Dear mm get 77% off List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO ; format=flowed Content-Transfer-Encoding: 7bit Wassup mm, how are you?! Hurry up, last day huge discount... Our shop have more than 3085 pisl online. Buy more, pay less! Today TopSellers: ** Proepcia $ ** Levitra $ ** Ciails $ ** Vaigra $ Purchase here

Assumption of all ML methods: Inductive learning hypothesis: Any hypothesis that approximates target concept well over sufficiently large set of training examples will also approximate the concept well over other examples outside of the training set. Difference between “induction” and “deduction”?