The Beta Reputation System

Slides:



Advertisements
Similar presentations
Evaluating the Robustness of Learning from Implicit Feedback Filip Radlinski Thorsten Joachims Presentation by Dinesh Bhirud
Advertisements

Improvements and extras Paul Thomas CSIRO. Overview of the lectures 1.Introduction to information retrieval (IR) 2.Ranked retrieval 3.Probabilistic retrieval.
LEARNING INFLUENCE PROBABILITIES IN SOCIAL NETWORKS Amit Goyal Francesco Bonchi Laks V. S. Lakshmanan University of British Columbia Yahoo! Research University.
1 CS 6910: Advanced Computer and Information Security Lecture on 11/2/06 Trust in P2P Systems Ahmet Burak Can and Bharat Bhargava Center for Education.
Probability Distributions CSLU 2850.Lo1 Spring 2008 Cameron McInally Fordham University May contain work from the Creative Commons.
CHAPTER 21 Inferential Statistical Analysis. Understanding probability The idea of probability is central to inferential statistics. It means the chance.
An Approach to Evaluate Data Trustworthiness Based on Data Provenance Department of Computer Science Purdue University.
An Introduction to Markov Decision Processes Sarah Hickmott
Experimental Uncertainties: A Practical Guide What you should already know well What you need to know, and use, in this lab More details available in handout.
CSCE 715 Ankur Jain 11/16/2010. Introduction Design Goals Framework SDT Protocol Achievements of Goals Overhead of SDT Conclusion.
Dept. of Computer Science & Engineering, CUHK1 Trust- and Clustering-Based Authentication Services in Mobile Ad Hoc Networks Edith Ngai and Michael R.
Introduction to Information Retrieval Introduction to Information Retrieval Hinrich Schütze and Christina Lioma Lecture 11: Probabilistic Information Retrieval.
A Trust Based Assess Control Framework for P2P File-Sharing System Speaker : Jia-Hui Huang Adviser : Kai-Wei Ke Date : 2004 / 3 / 15.
An Authentication Service Against Dishonest Users in Mobile Ad Hoc Networks Edith Ngai, Michael R. Lyu, and Roland T. Chin IEEE Aerospace Conference, Big.
Chapter 6 An Introduction to Portfolio Management.
8-1 Copyright ©2011 Pearson Education, Inc. publishing as Prentice Hall Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft.
Copyright ©2011 Pearson Education 8-1 Chapter 8 Confidence Interval Estimation Statistics for Managers using Microsoft Excel 6 th Global Edition.
WELCOME TO THE WORLD OF FUZZY SYSTEMS. DEFINITION Fuzzy logic is a superset of conventional (Boolean) logic that has been extended to handle the concept.
Monté Carlo Simulation MGS 3100 – Chapter 9. Simulation Defined A computer-based model used to run experiments on a real system.  Typically done on a.
Elec471 Embedded Computer Systems Chapter 4, Probability and Statistics By Prof. Tim Johnson, PE Wentworth Institute of Technology Boston, MA Theory and.
 Catalogue No: BS-338  Credit Hours: 3  Text Book: Advanced Engineering Mathematics by E.Kreyszig  Reference Books  Probability and Statistics by.
INFERENTIAL STATISTICS – Samples are only estimates of the population – Sample statistics will be slightly off from the true values of its population’s.
EE513 Audio Signals and Systems Statistical Pattern Classification Kevin D. Donohue Electrical and Computer Engineering University of Kentucky.
The Beta Reputation System Audun Jøsang and Roslan Ismail [1] Presented by Hamid Al-Hamadi CS 5984, Trust and Security, Spring 2014.
© 2008 McGraw-Hill Higher Education The Statistical Imagination Chapter 9. Hypothesis Testing I: The Six Steps of Statistical Inference.
Investment Analysis and Portfolio management Lecture: 24 Course Code: MBF702.
VTT-STUK assessment method for safety evaluation of safety-critical computer based systems - application in BE-SECBS project.
Estimation of Statistical Parameters
1 Institute of Engineering Mechanics Leopold-Franzens University Innsbruck, Austria, EU H.J. Pradlwarter and G.I. Schuëller Confidence.
Theory of Probability Statistics for Business and Economics.
Boolean Algebra and Computer Logic Mathematical Structures for Computer Science Chapter 7.1 – 7.2 Copyright © 2006 W.H. Freeman & Co.MSCS Slides Boolean.
Uses of Statistics: 1)Descriptive : To describe or summarize a collection of data points The data set in hand = the population of interest 2)Inferential.
The two way frequency table The  2 statistic Techniques for examining dependence amongst two categorical variables.
Two Main Uses of Statistics: 1)Descriptive : To describe or summarize a collection of data points The data set in hand = the population of interest 2)Inferential.
1 2 nd Pre-Lab Quiz 3 rd Pre-Lab Quiz 4 th Pre-Lab Quiz.
Lecture V Probability theory. Lecture questions Classical definition of probability Frequency probability Discrete variable and probability distribution.
Stats 845 Applied Statistics. This Course will cover: 1.Regression –Non Linear Regression –Multiple Regression 2.Analysis of Variance and Experimental.
Probability Theory Modelling random phenomena. Permutations the number of ways that you can order n objects is: n! = n(n-1)(n-2)(n-3)…(3)(2)(1) Definition:
Presentation for CDA6938 Network Security, Spring 2006 Timing Analysis of Keystrokes and Timing Attacks on SSH Authors: Dawn Xiaodong Song, David Wagner,
From the population to the sample The sampling distribution FETP India.
1 Tom Edgar’s Contribution to Model Reduction as an introduction to Global Sensitivity Analysis Procedure Accounting for Effect of Available Experimental.
Statistical NLP: Lecture 4 Mathematical Foundations I: Probability Theory (Ch2)
Chapter 9: Introduction to the t statistic. The t Statistic The t statistic allows researchers to use sample data to test hypotheses about an unknown.
1 Collecting and Interpreting Quantitative Data Deborah K. van Alphen and Robert W. Lingard California State University, Northridge.
Describing a Score’s Position within a Distribution Lesson 5.
Outline Historical note about Bayes’ rule Bayesian updating for probability density functions –Salary offer estimate Coin trials example Reading material:
Artificial Intelligence Logical Agents Chapter 7.
Bayes’ Theorem Suppose we have estimated prior probabilities for events we are concerned with, and then obtain new information. We would like to a sound.
Chapter 3 Data Representation
Chapter 2: The Research Enterprise in Psychology
OPERATING SYSTEMS CS 3502 Fall 2017
Lan Zhou, Vijay Varadharajan, and Michael Hitchens
Probability and the Normal Curve
Trustworthiness Management in the Social Internet of Things
PROVEST: Provenance-based Trust Model for Delay Tolerant Networks
Statistics: The Z score and the normal distribution
A survey of trust and reputation systems for online service provision
Martin Rajman, Martin Vesely
12 Inferential Analysis.
Introduction In probability, events are either dependent or independent. Two events are independent if the occurrence or non-occurrence of one event has.
Propagation Algorithm in Bayesian Networks
Statistical NLP: Lecture 4
iSRD Spam Review Detection with Imbalanced Data Distributions
EE513 Audio Signals and Systems
Statistics II: An Overview of Statistics
Parametric Methods Berlin Chen, 2005 References:
Sampling Distributions
A Trust Evaluation Framework in Distributed Networks: Vulnerability Analysis and Defense Against Attacks IEEE Infocom
Type I and Type II Errors
Collecting and Interpreting Quantitative Data
Presentation transcript:

The Beta Reputation System Jøsang and R. Ismail 15th Bled Electronic Commerce Conference, Bled, Slovenia, June 2002, pp. 1-14

Outline Introduction Building Blocks in the Beta Reputation System Belief Discounting in the Beta Reputation System Performance of the Beta Reputation System Conclusion

Introduction Reputation systems Encouraging good behavior and adherence to contracts Fostering trust amongst strangers in e-commerce transactions Providing incentive for honest behavior and helping people make decisions about who to trust. Without a reputation system taking past experiences into account, strangers might prefer to act deceptively for immediate gain instead of behaving honestly.

Introduction Fundamental aspects Reputation engine Take reputation ratings from various inputs including feedback about other users Use mathematical operations to compute a reputation score Propagation mechanism Two approaches: Centralized (e.g., eBay) Reputation data are stored in a central server Users send a query to the central server for the reputation score Decentralized Everybody keeps and manages reputation of other users Users can ask others for feedbacks

Contribution A reputation engine (called Beta Reputation System) is proposed based on the beta probability density function which can be used to represent probability distributions of binary events (1/0 for success/failure or satisfactory/unsatisfactory) Posteriori probabilities of binary events can be represented as beta distributions A sound basis in the theory of statistics Applicable to both centralized and distributed systems

Building Blocks in the Beta Reputation System The beta-family of probability density functions is a continuous family of functions indexed by the two parameters α and β .

Building Blocks in the Beta Reputation System “When observing binary processes with two possible outcomes , the beta function takes the integer number of past observations of and to estimate the probability of , or in other words, to predict the expected relative frequency with which will happen in the future.”

Building Blocks in the Beta Reputation System Initially α=1 and β=1 yielding the initial reputation score of 0.5, meaning no information

Building Blocks in the Beta Reputation System Example: A process with two possible outcomes Produced outcome 7 times Produced outcome 1 time The Beta function is plotted below:

Building Blocks in the Beta Reputation System Example (cont’): represents the probability of an event The curve represents the probability that the process will produce outcome during future observations represents the probability that the first-order variable has a specific value The probability expectation value -> the most likely value of the relative frequency of outcome is 0.8 8 / (8 + 2)

Building Blocks in the Beta Reputation System In e-commerce, an agent’s perceived satisfaction after a transaction is not binary - not the same as statistical observations of a binary event. Beta reputation system can be extended to non-binary events by representing positive and negative feedbacks as a pair (r, s) of continuous values. Degree of dissatisfaction (a real number) Degree of satisfaction (a real number)

Building Blocks in the Beta Reputation System . Compact notation:

Building Blocks in the Beta Reputation System T’s reputation function by X is subjective (as seen by X) Superscript (X): feedback provider (the trustor) Subscript (T): feedback target (the trustee)

Building Blocks in the Beta Reputation System A reputation rating is how an entity is expected to behave in the future When the reputation rating is within a range [0, 1], from Definition 1: When the reputation rating is within a range [-1, 1],

Building Blocks in the Beta Reputation System One can combine positive and negative feedback from multiple sources, e.g., combine feedback from X and Y about target T Combine positive feedback Combine negative feedback Operation is both commutative and associative

Belief Discounting in Beta Reputation System Belief discounting is done by varying the weight of the feedback based on the agent’s reputation Jøsang’s belief model uses a metric called opinion to describe beliefs about the truth of a proposition interpreted as probability that proposition x is true interpreted as probability that proposition x is false interpreted as uncertainty

Belief Discounting in Beta Reputation System Y: a recommender who provides a feedback to X about T X: a trustor who has its opinion about Y Objective: X wants to form an opinion about T, taking into account its opinion about Y Y’s opinion about T

Belief Discounting in Beta Reputation System The opinion metric can be interpreted equivalently to the Beta function by mapping: Inserting (b,d,u) defined above into the three equations in Definition 4, one can obtain T’s discounted reputation function by X through Y, , as follows: Associative but not commutative

Belief Discounting in Beta Reputation System Q: Prove or show by example on slide #18

Belief Discounting in the Beta Reputation System Q: Prove or show by example (Continuation from slide #19)

Providing and Collecting Feedback Feedback is received and stored by a feedback collection center C Assume that all agents are authenticated and that no agent can change identity Agents provide feedback about transactions C discounts received feedback based on providers reputation and updates the target’s reputation function and rating accordingly C provides updated reputation ratings to requesting entities

Performance: Effect of Discounting Center C receives a sequence of n identical feedback values (r=n, s=0) from X about T Blue line is (r=1000, s=0) meaning no discounting at all, i.e., C takes X’s feedback as is Pink line is (r=0, s=0) under which T’s rating is not influenced by X’s feedback at all. i.e., C ignores X’s feedback Varying X’s reputation function parameters Conclusion: As X’s reputation function gets weaker, T’s rating is less influenced by the feedback From X

Conclusions The Beta reputation system uses beta probability density function to combine feedback and derive reputation ratings, with a strong foundation in the theory of statistics Belief discounting can deal with bad-mouthing or ballot-stuffing attacks when trust is accurate (i.e., when Center C is accurate in assessing a recommender X’s reputation). Discounted feedbacks are combined by Center C to yield the reputation score of a target node. Flexibility and simplicity make it suitable for supporting electronic contracts and for building trust between players in e-commerce applications (centralized or distributed).