Presentation is loading. Please wait.

Presentation is loading. Please wait.

HADOOP David Kauchak CS451 – Fall 2013. Admin Assignment 7.

Published byErick Craig Modified over 9 years ago

Similar presentations

Presentation on theme: "HADOOP David Kauchak CS451 – Fall 2013. Admin Assignment 7."— Presentation transcript:

1 HADOOP David Kauchak CS451 – Fall 2013

2 Admin Assignment 7

3 logistic regression: three views linear classifier conditional model logistic linear model minimizing logistic loss

4 Logistic regression Why is it called logistic regression?

5 A digression: regression vs. classification Raw dataLabel 0 0 1 1 0 extract features f 1, f 2, f 3, …, f n featuresLabel classification: discrete (some finite set of labels) regression: real value

6 linear regression Given some points, find the line that best fits/explains the data Our model is a line, i.e. we’re assuming a linear relationship between the feature and the label value How can we find this line? f1f1 response (y)

7 Linear regression Learn a line h that minimizes some loss/error function: feature (x) response (y) Sum of the individual errors: 0/1 loss!

8 Error minimization How do we find the minimum of an equation? Take the derivative, set to 0 and solve (going to be a min or a max) Any problems here? Ideas?

9 Linear regression feature response squared error is convex!

10 Linear regression Learn a line h that minimizes an error function: in the case of a 2d line: function for a line feature response

11 Linear regression We’d like to minimize the error Find w 1 and w 0 such that the error is minimized We can solve this in closed form

12 Multiple linear regression If we have m features, then we have a line in m dimensions weights

13 Multiple linear regression We can still calculate the squared error like before Still can solve this exactly!

14 Logistic function

15 Logistic regression Find the best fit of the data based on a logistic

16 Big Data What is “big data”? What are some sources of big data? What are the challenges of dealing with big data? What are some of the tools you’ve heard of? For more info: http://www.youtube.com/watch?v=eEpxN0htRKI

17 Hadoop: guest speaker Patricia Florissi CTO of EMC PhD from Columbia University http://www.mobileworldmag.com/emc-leads-it-transformation-at-the-emc-forum/

18 Hadoop http://www.youtube.com/watch?v=XtLXPLb6EXs

Download ppt "HADOOP David Kauchak CS451 – Fall 2013. Admin Assignment 7."

Similar presentations

Linear Regression.

Linear Regression.
Regularization David Kauchak CS 451 – Fall 2013.

Regularization David Kauchak CS 451 – Fall 2013.
Linear Classifiers/SVMs

Linear Classifiers/SVMs
Clustering Beyond K-means

Clustering Beyond K-means
Support Vector Machines Instructor Max Welling ICS273A UCIrvine.

Support Vector Machines Instructor Max Welling ICS273A UCIrvine.
PERCEPTRON LEARNING David Kauchak CS 451 – Fall 2013.

PERCEPTRON LEARNING David Kauchak CS 451 – Fall 2013.
Supervised Learning Recap

Supervised Learning Recap
Unsupervised learning

Unsupervised learning
CMPUT 466/551 Principal Source: CMU

CMPUT 466/551 Principal Source: CMU
Lecture 13 – Perceptrons Machine Learning March 16, 2010.

Lecture 13 – Perceptrons Machine Learning March 16, 2010.
Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,

Cos 429: Face Detection (Part 2) Viola-Jones and AdaBoost Guest Instructor: Andras Ferencz (Your Regular Instructor: Fei-Fei Li) Thanks to Fei-Fei Li,
Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.

Classification and Prediction: Regression Via Gradient Descent Optimization Bamshad Mobasher DePaul University.
Lecture 17: Supervised Learning Recap Machine Learning April 6, 2010.

Lecture 17: Supervised Learning Recap Machine Learning April 6, 2010.
x – independent variable (input)

x – independent variable (input)
Intro to Linear Methods Reading: DH&S, Ch 5.{1-4,8} hip to be hyperplanar...

Intro to Linear Methods Reading: DH&S, Ch 5.{1-4,8} hip to be hyperplanar...
Introduction to Linear and Logistic Regression. Basic Ideas Linear Transformation Finding the Regression Line Minimize sum of the quadratic residuals.

Introduction to Linear and Logistic Regression. Basic Ideas Linear Transformation Finding the Regression Line Minimize sum of the quadratic residuals.
1 Linear Classification Problem Two approaches: -Fisher’s Linear Discriminant Analysis -Logistic regression model.

1 Linear Classification Problem Two approaches: -Fisher’s Linear Discriminant Analysis -Logistic regression model.
Classification and Prediction: Regression Analysis

Classification and Prediction: Regression Analysis
CSCI 347 / CS 4206: Data Mining Module 04: Algorithms Topic 06: Regression.

CSCI 347 / CS 4206: Data Mining Module 04: Algorithms Topic 06: Regression.
Section 8.3 – Systems of Linear Equations - Determinants Using Determinants to Solve Systems of Equations A determinant is a value that is obtained from.

Section 8.3 – Systems of Linear Equations - Determinants Using Determinants to Solve Systems of Equations A determinant is a value that is obtained from.

Similar presentations

Ads by Google