1. Efficient Retrieval of Recommendations in a Matrix Factorization Framework Noam KoenigsteinParikshit RamYuval Shavitt School of Electrical Engineering Tel Aviv University Computational Science & Engineering Georgia Institute of Technology School of Electrical Engineering Tel Aviv University

2. Motivation In the field of Recommender System, Matrix Factorization (MF) models have shown superior accuracy for recommendation tasks. E.g., The Netflix Prize, KDD-Cup’11, etc. Training is fast. Computing test scores is fast. But… Retrieval of Recommendations (RoR) is s--l--o--w ! This problem is well known in the industry, yet never been approached before in academia!

3. 2 2 4 5 33 2.. 41 2 2 5 I T E M S USERSUSERS Yahoo! Music: 1M Users 625K Items 6 Tera elements ~300 multiplications ~5 days CPU Naïve Multithreading: High latency + wasteful Yahoo! Music: 1M Users 625K Items 6 Tera elements ~300 multiplications ~5 days CPU

4. Reduction to Inner Product...... 1......

6. Best Matches Algorithms Metric Space Cosine Similarity Locality Sensitive Hashing

7. Metric Trees R R

9. Branch-and-bound Algorithm

10. Bounding Inner Product Similarity

12. Approximate Solution Users vectors can be normalized  Users can be clustered based on their spherical angle!

13. Relative Error Bound What is the error when recommendations are retrieved based on an approximate user vector?

14. Adaptive Approximate Solution

15. Experimentations Set-up MovieLensNetflixYahoo! Music Ratings1,000,206100,480,507252,800,275 Users6,040480,1891,000,990 Items3,95217,770624,961 Sparsity95.81%98.82%99.96% Yahoo! Music Recommendations: Modeling Music Ratings with Temporal Dynamics and Item Taxonomy Gideon Dror, Noam Koenigstein, Yehuda Koren (RecSys-11`)

16. Exact Alg. Speedup

17. Approximate Alg. Speedup

18. Speedup vs. Precision

19. Speedup vs. MedianRank

20. Conclusions We introduce a new and relevant research problem An exact solution with limited speedup An approximate solution with a tradeoff between accuracy and speedup Much room for further research…

21. Basic Model

22. Reduction to Inner Product...... 1......