Lecture 3: Linear Regression (with One Variable)

Slides:



Advertisements
Similar presentations
Composite Functions.
Advertisements

Functions, Domain and Range
CSC 4510 – Machine Learning Dr. Mary-Angela Papalaskari Department of Computing Sciences Villanova University Course website:
Indian Statistical Institute Kolkata
Psychology 202b Advanced Psychological Statistics, II February 10, 2011.
2.1 Relations and Functions. In this chapter, you will learn: What a function is. Review domain and range. Linear equations. Slope. Slope intercept form.
Statistics 350 Lecture 16. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
Statistics 350 Lecture 11. Today Last Day: Start Chapter 3 Today: Section 3.8 Mid-Term Friday…..Sections ; ; (READ)
Section 2.6 Question 1. Section 2.6 Answer 1 Section 2.6 Question 2.
1 Econometrics 1 Lecture 6 Multiple Regression -tests.
Bayes Classifier, Linear Regression 10701/15781 Recitation January 29, 2008 Parts of the slides are from previous years’ recitation and lecture notes,
Statistics 350 Lecture 17. Today Last Day: Introduction to Multiple Linear Regression Model Today: More Chapter 6.
1 1 Slide Simple Linear Regression Chapter 14 BA 303 – Spring 2011.
More Machine Learning Linear Regression Squared Error L1 and L2 Regularization Gradient Descent.
CSC 4510 – Machine Learning Dr. Mary-Angela Papalaskari Department of Computing Sciences Villanova University Course website:
Machine Learning CSE 681 CH2 - Supervised Learning.
CSC 4510 – Machine Learning Dr. Mary-Angela Papalaskari Department of Computing Sciences Villanova University Course website:
Machine Learning Introduction Study on the Coursera All Right Reserved : Andrew Ng Lecturer:Much Database Lab of Xiamen University Aug 12,2014.
Model representation Linear regression with one variable
Andrew Ng Linear regression with one variable Model representation Machine Learning.
Overview of Supervised Learning Overview of Supervised Learning2 Outline Linear Regression and Nearest Neighbors method Statistical Decision.
Logistic Regression Week 3 – Soft Computing By Yosi Kristian.
PS 225 Lecture 20 Linear Regression Equation and Prediction.
Concept learning, Regression Adapted from slides from Alpaydin’s book and slides by Professor Doina Precup, Mcgill University.
Regularization (Additional)
Graphs We often use graphs to show how two variables are related. All these examples come straight from your book.
Activity 1.2. Some definitions… Independent variable is another name for the input variable of a function Independent variable is another name for the.
Section 7.1: Functions and Representations of Functions.
CISC Machine Learning for Solving Systems Problems Microarchitecture Design Space Exploration Lecture 4 John Cavazos Dept of Computer & Information.
MACHINE LEARNING 3. Supervised Learning. Learning a Class from Examples Based on E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1)
WEEK 2 SOFT COMPUTING & MACHINE LEARNING YOSI KRISTIAN Gradient Descent for Linear Regression.
Section Copyright © 2015, 2011, 2008 Pearson Education, Inc. Lecture Slides Essentials of Statistics 5 th Edition and the Triola Statistics Series.
Lecture 11: Simple Linear Regression
Lecture #26 Thursday, November 17, 2016 Textbook: 14.1 and 14.3
Linear Regression (continued)
Neural Networks for Machine Learning Lecture 1e Three types of learning Geoffrey Hinton with Nitish Srivastava Kevin Swersky.
Quantitative Methods Dr. Aravind Banakar –
Quantitative Methods Dr. Aravind Banakar –
Quantitative Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
Quantitative Methods
Overview of Supervised Learning
2.1 – Represent Relations and Functions.
STA 282 – Regression Analysis
Functions And Function Notation.
Function Notation “f of x” Input = x Output = f(x) = y.
Linear Algebra Lecture 3.
1.5 Linear Inequalities.
An algebraic expression that defines a function is a function rule.
Concept of a Function.
2.1 Relations and Functions
Do Now: Make a K-W-L Chart Complete what you KNOW about functions
EQUATION 4.1 Relationship Between One Dependent and One Independent Variable: Simple Regression Analysis.
2.1: Relations and Functions
Warm Up What three terms come next? 1. 9, 12, 15, 18, . . .
Warm Up What three terms come next? 1. 9, 12, 15, 18, . . .
Cases. Simple Regression Linear Multiple Regression.
Dependent Axis Y Answer Output Range f (x) Function Notation
Multiple features Linear Regression with multiple variables
Multiple features Linear Regression with multiple variables
Regression and Correlation of Data
Linear regression with one variable
SYEN 3330 Digital Systems Chapter 2 – Part 1 SYEN 3330 Digital Systems.
Function Notation.
Lesson 3.3 Writing functions.
The Scientific Method.
Presentation transcript:

Lecture 3: Linear Regression (with One Variable)

Supervised Learning: Regression Right answers are given for inputs Regression refers to predicting continuous valued output (e.g. price)

Notations

Learning Process

Hypothesis Representation

Hypothesis Representation

Finding Parameters

Cost Function

Cost Function Intuition

Cost Function Intuition (Cont)

Cost Function Intuition (Cont)

Cost Function Intuition (Cont)

Cost Function Intuition (Cont)

Cost Function Intuition (Cont) cc cc

Cost Function Intuition (Cont) cc cc cc

Cost Function Intuition (Cont) cc cc cc cc cc cc cc

Cost Function Intuition (Cont) cc cc cc cc cc cc cc = 1

Cost Function Intuition 2

Cost Function Intuition 2

Cost Function Intuition 2 (Cont)

Cost Function Intuition 2 (Cont)

Cost Function Intuition 2 (Cont)

Cost Function Intuition 2 (Cont)