CS 445/545 Machine Learning Spring, 2017

Slides:



Advertisements
Similar presentations
Rerun of machine learning Clustering and pattern recognition.
Advertisements

CHAPTER 2: Supervised Learning. Lecture Notes for E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1) 2 Learning a Class from Examples.
CPSC 502, Lecture 15Slide 1 Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 15 Nov, 1, 2011 Slide credit: C. Conati, S.
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.
CII504 Intelligent Engine © 2005 Irfan Subakti Department of Informatics Institute Technology of Sepuluh Nopember Surabaya - Indonesia.
CIS 678 Artificial Intelligence problems deduction, reasoning knowledge representation planning learning natural language processing motion and manipulation.
Learning from Observations Chapter 18 Section 1 – 4.
Machine Learning Bob Durrant School of Computer Science
1 MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING By Kaan Tariman M.S. in Computer Science CSCI 8810 Course Project.
Part I: Classification and Bayesian Learning
Introduction to machine learning
CS Machine Learning. What is Machine Learning? Adapt to / learn from data  To optimize a performance function Can be used to:  Extract knowledge.
CS 478 – Introduction1 Introduction to Machine Learning CS 478 Professor Tony Martinez.
Copyright R. Weber Machine Learning, Data Mining ISYS370 Dr. R. Weber.
Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.
Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.
Some working definitions…. ‘Data Mining’ and ‘Knowledge Discovery in Databases’ (KDD) are used interchangeably Data mining = –the discovery of interesting,
Transfer Learning Task. Problem Identification Dataset : A Year: 2000 Features: 48 Training Model ‘M’ Testing 98.6% Training Model ‘M’ Testing 97% Dataset.
1 CSC 8520 Spring Paula Matuszek Kinds of Machine Learning Machine learning techniques can be grouped into several categories, in several ways: –What.
CS 445/545 Machine Learning Winter, 2012 Course overview: –Instructor Melanie Mitchell –Textbook Machine Learning: An Algorithmic Approach by Stephen Marsland.
CS 445/545 Machine Learning Spring, 2013 See syllabus at
Learning from observations
Kernel adaptive filtering Lecture slides for EEL6502 Spring 2011 Sohan Seth.
Week 1 - An Introduction to Machine Learning & Soft Computing
Concept learning, Regression Adapted from slides from Alpaydin’s book and slides by Professor Doina Precup, Mcgill University.
Welcome to Curriculum Night I am so glad you are here. Feel free to ask questions. Remember our time is short. Welcome to Curriculum Night for Ms. Figurelli’s.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology 1 A self-organizing map for adaptive processing of structured.
CS 445/545 Machine Learning Winter, 2014 See syllabus at
Data Mining and Decision Support
Copyright Paula Matuszek Kinds of Machine Learning.
Machine Learning in CSC 196K
Machine Learning Lecture 1: Intro + Decision Trees Moshe Koppel Slides adapted from Tom Mitchell and from Dan Roth.
General Information Course Id: COSC6342 Machine Learning Time: TU/TH 1-2:30p Instructor: Christoph F. Eick Classroom:AH301
CMPS 142/242 Review Section Fall 2011 Adapted from Lecture Slides.
Introduction to Machine Learning, its potential usage in network area,
Machine Learning Supervised Learning Classification and Regression
Machine Learning with Spark MLlib
Who am I? Work in Probabilistic Machine Learning Like to teach 
CS 445/545 Machine Learning Winter, 2017
Unit 1 Days 1-2: Standard 1 Objective 1
Machine Learning for Computer Security
Welcome to Curriculum Night
Machine Learning overview Chapter 18, 21
Machine Learning overview Chapter 18, 21
Lecture 3: Linear Regression (with One Variable)
Welcome to Curriculum Night
Neural Networks for Machine Learning Lecture 1e Three types of learning Geoffrey Hinton with Nitish Srivastava Kevin Swersky.
Reading: Pedro Domingos: A Few Useful Things to Know about Machine Learning source: /cacm12.pdf reading.
Introductory Seminar on Research: Fall 2017
Classification with Perceptrons Reading:
CH. 1: Introduction 1.1 What is Machine Learning Example:
Dipartimento di Ingegneria «Enzo Ferrari»,
COS 518: Advanced Computer Systems Lecture 12 Mike Freedman
Lecturer: Geoff Hulten TAs: Kousuke Ariga & Angli Liu
Prepared by: Mahmoud Rafeek Al-Farra
INF 5860 Machine learning for image classification
Overview of Machine Learning
Introduction to Data Science Lesson 1
3.1.1 Introduction to Machine Learning
Lecture 6: Introduction to Machine Learning
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
AI and Machine Learning
Presentation and project
Machine learning overview
Junheng, Shengming, Yunsheng 11/09/2018
CS639: Data Management for Data Science
Deep Learning Authors: Yann LeCun, Yoshua Bengio, Geoffrey Hinton
Semi-Supervised Learning
A task of induction to find patterns
Presentation transcript:

CS 445/545 Machine Learning Spring, 2017 See syllabus at http://web.cecs.pdx.edu/~mm/MachineLearningSpring2017/ Lecture slides will be posted on this website before each class.

What is machine learning? Textbook definitions of “machine learning”: Detecting patterns and regularities with a good and generalizable approximation (“model” or “hypothesis”) Execution of a computer program to optimize the parameters of the model using training data or past experience.

Training Examples: Class 1 Test example: Class = ?

Training Examples: Class 1 Test example: Class = ?

Training Examples: Class 1 Test example: Class = ?

Training Examples: Class 1 Test example: Class = ?

Training Examples: Class 1 Test example: Class = ?

Training Examples: Class 1 Test example: Class = ?

Types of machine learning tasks Classification Output is one of a number of classes (e.g., ‘A’) Regression Output is a real value (e.g., ‘$35/share”)

Types of Machine Learning Methods Supervised provide explicit training examples with correct answers e.g. neural networks with back-propagation Unsupervised no feedback information is provided e.g., unsupervised clustering based on similarity “Semi-supervised” some feedback information is provided but it is not detailed e.g., only a fraction of examples are labeled e.g., reinforcement learning: reinforcement single is single-valued assessment of current state

Relation between “artificial intelligence” and “machine learning”?

Key Ingredients for Any Machine Learning Method Features (or “attributes”) Underlying Representation for “hypothesis”, “model”, or “target function” Hypothesis space Learning method Data: Training data Used to train the model Validation (or Development) data Used to select model hyperparameters, to determine when to stop training, or to alter training method Test data Used to evaluate trained model Evaluation method

Constructing Features

From: "TopShop" <mm@pdx.edu> To: <mm@pdx.edu> Subject: Dear mm get 77% off List-Unsubscribe: <mailto:unsubscribe-5E587F53488BBC388181@harkinsroofing.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Wassup mm, how are you?! Hurry up, last day huge discount... Our shop have more than 3085 pisl online. Buy more, pay less! Today TopSellers: ** Proepcia - 0.12$ ** Levitra - 1.64$ ** Ciails - 1.78$ ** Vaigra - 0.79$ Purchase here http://TvBqeUP.ngadoctor.ru/

Notation for Instances and Features Instance: x (boldface  vector) Set of M instances: {x1, x2, ... , xM} Instance as feature vector, with N features: x = (x1, x2, ..., xN) Instance as a point in an N-dimensional space: x x2 x3 x1

Assumption of all ML methods: Inductive learning hypothesis: Any hypothesis that approximates target concept well over sufficiently large set of training examples will also approximate the concept well over other examples outside of the training set. Difference between “induction” and “deduction”?

Goals of this course Broad survey of modern ML methods Learn by hands-on experience Good preparation to go further in the field, with more advanced courses or self-learning

Class Syllabus http://web.cecs.pdx.edu/~mm/MachineLearningSpring2017/

Homework Collaboration Discussion is encouraged Actual code / experiments / writeup must be done entirely by you

Don’t forget to ask questions!

“To do” handout

Pre-Test 10 minutes Doesn’t count for grade Just for me to find out what math I need to review in class And for you to find out what math you need to review outside of class

Email me (mm@pdx.edu) if you are on the waiting list and would still like to join the class.