Collaborative Data Analysis and Multi-Agent Systems Robert W. Thomas CSCE APR 2013

Agenda Problem Description Existing Research Overview Limitation of Existing Results Future Research Suggestions 2

Problem Description Information Overload Divide and Conquer; Reconcile Recommender Systems and Social Media – Content Filtering – Collaborative Filtering – Collaborative Data Analysis through Agents 3

Content Filtering Recommendations based on items similar to what has been preferred previously 4

Collaborative Filtering (CF) Recommendations based on what others in a network prefer Different Techniques – Memory-Based – Model-Based – Hybrid 5

Memory-Based CF Similarity Computation Prediction and Recommendation Computation Top-N Recommendations 6

Similarity Computation 7

Prediction and Recommendation Computation 8

Top-N Recommendations Item-Based User-Based 9

Model-Based CF Bayesian Belief Net Clustering Regression-Based Markov Decision Process (MDP) –Based Latent Semantic 10

Bayesian Belief Net 11

Clustering Cluster: collection of similar objects, dissimilar to objects in other clusters – Pearson correlation can be used Three Categories – Partitioning – Density-based – Hierarchal Often an Intermediate Step 12

Regression-Based Use approximation of ratings to make predictions against a regression model Apply to situations where rating vectors have large Euclidean distances but very high Similarity Computation scores 13

MDP-Based Sequential Optimization Problem – S = {states} – A = {actions} – R = {rewards} for r(s,a,s’) – Pr = {transition probabilities} for pr(s,a,s’) Partially Observable MDP (POMDP) 14

Latent Semantic Uses statistical modeling to discover additional communities or profiles 15

Network Trust We’re all mad here; I’m mad; you’re mad. Opinions of different contacts are valued more than others under certain conditions Accounting for this can increase CF accuracy Semantic Knowledge Social Tie-Strength 16

Hybrid CF CF + Content-Based CF + CF CF + CF and/or Content-Based 17

Limitations of Existing Solutions Time / Accuracy Trade Offs Noisy Data Data Sparsity (New User) Scalability Synonymy Gray Sheep Shilling Attacks Privacy 18

Future Research Suggestions Hybrids Semantics Trust Parallel Processing – Multi-Agent Systems 19

BACKUP 20

References Su, Xiaoyuan, and Taghi M. Khoshgoftaar. "A survey of collaborative filtering techniques." Advances in Artificial Intelligence 2009 (2009): 4. Chen, Wei, and Simon Fong. "Social network collaborative filtering framework and online trust factors: a case study on Facebook." Digital Information Management (ICDIM), 2010 Fifth International Conference on. IEEE, O'Donovan, John, and Barry Smyth. "Trust in recommender systems." Proceedings of the 10th international conference on Intelligent user interfaces. ACM,