Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Slides:

Advertisements

Similar presentations

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Advertisements

Special Topics in Educational Data Mining HUDK5199 Spring term, 2013 February 18, 2013.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Advanced Methods and Analysis for the Learning and Social Sciences PSY505 Spring term, 2012 March 16, 2012.

MA 102 Statistical Controversies Monday, January 28, 2002 Today: Discussion of Statistical Thought, First Ideas About Data, and Exercises. Introduction.

Unsupervised Learning: Clustering Some material adapted from slides by Andrew Moore, CMU. Visit for

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Data Mining BS/MS Project Clustering for Market Segmentation Presentation by Mike Calder.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

COMP53311 Clustering Prepared by Raymond Wong Some parts of this notes are borrowed from LW Chan ’ s notes Presented by Raymond Wong

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

CPSC 502, Lecture 15Slide 1 Introduction to Artificial Intelligence (AI) Computer Science cpsc502, Lecture 16 Nov, 3, 2011 Slide credit: C. Conati, S.

Credibility: Evaluating what’s been learned This Lecture based on Ch 5 of Witten & Frank Plan for this week 3 classes before Midterm Paper and Survey discussion.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Lecture 6 Spring 2010 Dr. Jianjun Hu CSCE883 Machine Learning.

Advanced Methods and Analysis for the Learning and Social Sciences PSY505 Spring term, 2012 March 16, 2012.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Overview of Emerging IT2 At the request of several students, the context and mathematics of several Big Data algorithms will be examined in detail Dissertation.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Special Topics in Educational Data Mining HUDK5199 Spring, 2013 April 17, 2012.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Apache Mahout Qiaodi Zhuang Xijing Zhang.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

Clustering Hongfei Yan School of EECS, Peking University 7/8/2009 Refer to Aaron Kimball’s slides.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

CS 161 Computer Science I Andrew Scholer

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Data Mining By Farzana Forhad CS 157B. Agenda Decision Tree and ID3 Rough Set Theory Clustering.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

An Energy-Efficient Approach for Real-Time Tracking of Moving Objects in Multi-Level Sensor Networks Vincent S. Tseng, Eric H. C. Lu, & Kawuu W. Lin Institute.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Advanced Artificial Intelligence Lecture 8: Advance machine learning.

Special Topics in Educational Data Mining HUDK5199 Spring, 2013 April 3, 2013.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Core Methods in Educational Data Mining HUDK4050 Fall 2015.

Given a set of data points as input Randomly assign each point to one of the k clusters Repeat until convergence – Calculate model of each of the k clusters.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Core Methods in Educational Data Mining HUDK4050 Fall 2014.

Special Topics in Educational Data Mining HUDK5199 Spring term, 2013 April 15, 2013.

Machine Learning Lecture 4: Unsupervised Learning (clustering) 1.

Unsupervised Learning Part 2. Topics How to determine the K in K-means? Hierarchical clustering Soft clustering with Gaussian mixture models Expectation-Maximization.

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Advanced Methods and Analysis for the Learning and Social Sciences

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

KMeans Clustering on Hadoop Fall 2013 Elke A. Rundensteiner

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Core Methods in Educational Data Mining

Presentation transcript:

Core Methods in Educational Data Mining HUDK4050 Fall 2014

Assignment B7 Let’s go over each answer

Any questions?

Any questions about k-Means?

Let’s play with clustering a bit Apply k-means using the following points and initial centroids I need 5 volunteers!

01 pknow time

01 pknow time

01 pknow time

01 pknow time

01 pknow time

Any comments on exercise?

Why Is distortion/MSD good for choosing between randomized restarts But bad for choosing cluster size?

Why Isn’t cross-validated distortion/MSD good for choosing cluster size? Why doesn’t cross-validation fix the issue?

What Is the solution?

Is there a better way To choose the number of clusters Than just the adjusted fit?

What are the advantages? Of Gaussian Mixture Models

What are the advantages? Of Gaussian Mixture Models Why not use them all the time?

What are the advantages? Of Spectral Clustering

What are the advantages? Of Spectral Clustering Why not use it all the time?

What are the advantages? Of Hierarchical Clustering

What are the advantages? Of Hierarchical Clustering Why not use it all the time?

Clustering: Any Questions?

Factor Analysis.vs. Clustering What’s the difference?

Factor Analysis: Any Questions?

What… Are the general advantages of structure discovery algorithms (clustering, factor analysis) Compared to supervised/prediction modeling methods?

What… Are the general advantages of structure discovery algorithms (clustering, factor analysis) Compared to supervised/prediction modeling methods? What are the disadvantages?

Important point… If you cluster in a well-known domain, you are likely to obtain well-known findings

Because of this… Clustering is relatively popular But somewhat prone to uninteresting papers in education research – Where usually a lot is already known So be thoughtful…

Amershi & Conati (2009) Any questions?

Bowers (2010) Any questions?

Any other questions?

Assignment B8 Sequential Pattern Mining Due Monday

Next Class Wednesday, December 3: Association Rule Mining Readings Baker, R.S. (2014) Big Data and Education. Ch. 5, V3. Merceron, A., Yacef, K. (2008) Interestingness Measures for Association Rules in Educational Data. Proceedings of the 1st International Conference on Educational Data Mining, Bazaldua, D.A.L., Baker, R.S., San Pedro, M.O.Z. (2014) Combining Expert and Metric-Based Assessments of Association Rule Interestingness. Proceedings of the 7th International Conference on Educational Data Mining.

The End