FRM: Modeling Sponsored Search Log with Full Relational Model

Slides:



Advertisements
Similar presentations
Evaluating the Robustness of Learning from Implicit Feedback Filip Radlinski Thorsten Joachims Presentation by Dinesh Bhirud
Advertisements

Temporal Query Log Profiling to Improve Web Search Ranking Alexander Kotov (UIUC) Pranam Kolari, Yi Chang (Yahoo!) Lei Duan (Microsoft)
Suleyman Cetintas 1, Monica Rogati 2, Luo Si 1, Yi Fang 1 Identifying Similar People in Professional Social Networks with Discriminative Probabilistic.
Structural Equation Modeling Using Mplus Chongming Yang Research Support Center FHSS College.
Modelling Relevance and User Behaviour in Sponsored Search using Click-Data Adarsh Prasad, IIT Delhi Advisors: Dinesh Govindaraj SVN Vishwanathan* Group:
Catching the Drift: Learning Broad Matches from Clickthrough Data Sonal Gupta, Mikhail Bilenko, Matthew Richardson University of Texas at Austin, Microsoft.
Binomial Random Variable Approximations, Conditional Probability Density Functions and Stirling’s Formula.
What is Statistical Modeling
Statistic Models for Web/Sponsored Search Click Log Analysis The Chinese University of Hong Kong 1 Some slides are revised from Mr Guo Fan’s tutorial at.
Assuming normally distributed data! Naïve Bayes Classifier.
Context-Aware Query Classification Huanhuan Cao 1, Derek Hao Hu 2, Dou Shen 3, Daxin Jiang 4, Jian-Tao Sun 4, Enhong Chen 1 and Qiang Yang 2 1 University.
Multivariate Data Analysis Chapter 4 – Multiple Regression.
1 LM Approaches to Filtering Richard Schwartz, BBN LM/IR ARDA 2002 September 11-12, 2002 UMASS.
Simple Bayesian Supervised Models Saskia Klein & Steffen Bollmann 1.
Cohort Modeling for Enhanced Personalized Search Jinyun YanWei ChuRyen White Rutgers University Microsoft BingMicrosoft Research.
Example of Simple and Multiple Regression
Query Rewriting Using Monolingual Statistical Machine Translation Stefan Riezler Yi Liu Google 2010 Association for Computational Linguistics.
Improving Web Search Ranking by Incorporating User Behavior Information Eugene Agichtein Eric Brill Susan Dumais Microsoft Research.
Ramakrishnan Srikant Sugato Basu Ni Wang Daryl Pregibon 1.
Fan Guo 1, Chao Liu 2 and Yi-Min Wang 2 1 Carnegie Mellon University 2 Microsoft Research Feb 11, 2009.
Evaluation Methods and Challenges. 2 Deepak Agarwal & Bee-Chung ICML’11 Evaluation Methods Ideal method –Experimental Design: Run side-by-side.
CIKM’09 Date:2010/8/24 Advisor: Dr. Koh, Jia-Ling Speaker: Lin, Yi-Jhen 1.
Implicit User Feedback Hongning Wang Explicit relevance feedback 2 Updated query Feedback Judgments: d 1 + d 2 - d 3 + … d k -... Query User judgment.
Basic Probability Rules Let’s Keep it Simple. A Probability Event An event is one possible outcome or a set of outcomes of a random phenomenon. For example,
Confidence-Aware Graph Regularization with Heterogeneous Pairwise Features Yuan FangUniversity of Illinois at Urbana-Champaign Bo-June (Paul) HsuMicrosoft.
PROBABILITY AND STATISTICS FOR ENGINEERING Hossein Sameti Department of Computer Engineering Sharif University of Technology.
The Triangle of Statistical Inference: Likelihoood Data Scientific Model Probability Model Inference.
Analysis of Topic Dynamics in Web Search Xuehua Shen (University of Illinois) Susan Dumais (Microsoft Research) Eric Horvitz (Microsoft Research) WWW 2005.
Jun Li, Peng Zhang, Yanan Cao, Ping Liu, Li Guo Chinese Academy of Sciences State Grid Energy Institute, China Efficient Behavior Targeting Using SVM Ensemble.
Resolving the Exposure Puzzle: The Many Facets of Exchange Rate Exposure By Sohnke Bartram, Gregory W. Brown, Bernadette A. Minton DISCUSSANT: DoAnne Sanchez,
Context-Aware Query Classification Huanhuan Cao, Derek Hao Hu, Dou Shen, Daxin Jiang, Jian-Tao Sun, Enhong Chen, Qiang Yang Microsoft Research Asia SIGIR.
The Value of Information in Real-Time Display Advertising Björn Hoppe 28. April 2015.
A Framework to Predict the Quality of Answers with Non-Textual Features Jiwoon Jeon, W. Bruce Croft(University of Massachusetts-Amherst) Joon Ho Lee (Soongsil.
1 Learning to Impress in Sponsored Search Xin Supervisors: Prof. King and Prof. Lyu.
1 A latent information function to extend domain attributes to improve the accuracy of small-data-set forecasting Reporter : Zhao-Wei Luo Che-Jung Chang,Der-Chiang.
Recommender Systems 11/04/2017
PV-Trend: A JSL Application for Trending Topics for Pharmacovigilance
Transfer Learning in Astronomy: A New Machine Learning Paradigm
CS 2750: Machine Learning Density Estimation
Google AdWords Integration
Chapter Six Normal Curves and Sampling Probability Distributions
Martin Rajman, Martin Vesely
Chapter 8: Hypothesis Testing and Inferential Statistics
DUI United States Quarterly Update Last Quarter: Q2 2014
Evaluating Classifiers
CIKM Competition 2014 Second Place Solution
Log Linear Modeling of Independence
STAT120C: Final Review.
CIKM Competition 2014 Second Place Solution
Probability & Statistics Probability Theory Mathematical Probability Models Event Relationships Distributions of Random Variables Continuous Random.
Econometric Models The most basic econometric model consists of a relationship between two variables which is disturbed by a random error. We need to use.
Martin Rajman, EPFL Switzerland & Martin Vesely, CERN Switzerland
Machine Learning: Lecture 3
10701 / Machine Learning Today: - Cross validation,
What is Regression Analysis?
Particle Filters for Event Detection
Learning to rank 11/04/2017.
Daniela Stan Raicu School of CTI, DePaul University
Product moment correlation
Date : 2013/1/10 Author : Lanbo Zhang, Yi Zhang, Yunfei Chen
Parametric Methods Berlin Chen, 2005 References:
Chapter 13 Additional Topics in Regression Analysis
Efficient Multiple-Click Models in Web Search
Math 145 June 26, 2007.
Math 145 February 12, 2008.
Mathematical Foundations of BME Reza Shadmehr
Bootstrapping and Bootstrapping Regression Models
Chapter 5: Sampling Distributions
Statistics 101 Chapter 8 Section 8.1 c and d.
Naïve Bayes Classifier
Presentation transcript:

FRM: Modeling Sponsored Search Log with Full Relational Model

Application Scenario

Why to use Click Models Target The simple case CTR statistics of a query-ad pair in different positions The simple case Only one ad in a session (like tossing a coin) Click event follows binomial distribution with a beta prior General case: the above method cannot be utilized directly More ads are shown together in a session Position-bias More factors: influence among ads, users’ intent, etc.

Challenge of Click Models Examination Hypothesis The user must examine an ad before clicking. Problem How to calculate p(E)? How to estimate r?

Competitive Click Models Influence among ads is not considered

The Influence Among the Ads The green arrow: competing influence The red arrow: collaborating influence

Data Support

Limitation of Previous Work TCM model Only modeling two ads Only consider competing influence

Our Contributions Extend TCM from modeling two ads to arbitrary number of ads Identify the collaborating influence and incorporate it into click models Incorporating features to further enhance click models

Extended TCM

Estimation of Parameters Estimation of r Estimation of lambda

Full Relational Model

Incorporating Features Classical regression model Prediction = f (Observation) The model is trained in sessions containing only one ad Incorporate the prediction into priors Beta (alpha, beta)

Experimental Results Evaluation Metrics ROC

The End Thank you very much. xxin@cse.cuhk.edu.hk