Existence of Non-measurable Set

Slides:



Advertisements
Similar presentations
Section 7.5: Equivalence Relations Def: A relation R on a set A is called an equivalence relation if it is reflexive, symmetric, and transitive. Ex: Let.
Advertisements

Great Theoretical Ideas in Computer Science.
Week 21 Basic Set Theory A set is a collection of elements. Use capital letters, A, B, C to denotes sets and small letters a 1, a 2, … to denote the elements.
1.  Detailed Study of groups is a fundamental concept in the study of abstract algebra. To define the notion of groups,we require the concept of binary.
1 Discrete Structures & Algorithms Discrete Probability.
Chris Morgan, MATH G160 January 9, 2012 Lecture 1 Chapter 4.1, 4.2, & 4.3: Set Theory, Introduction to Probability.
Great Theoretical Ideas in Computer Science.
Lecture ,3.3 Sequences & Summations Proof by Induction.
1 Lecture 6 Topics –Proof of the existence of unsolvable problems Problems/languages not in REC Proof Technique –There are more problems/languages than.
Great Theoretical Ideas in Computer Science.
Cardinality of a Set “The number of elements in a set.” Let A be a set. a.If A =  (the empty set), then the cardinality of A is 0. b. If A has exactly.
Cardinality of Sets Section 2.5.
1.2 Sample Space.
Methods of Proof & Proof Strategies
Basic Concepts of Discrete Probability (Theory of Sets: Continuation) 1.
Chapter 11 Probability Sample spaces, events, probabilities, conditional probabilities, independence, Bayes’ formula.
Chapter 3 – Set Theory  .
1 Lecture 3 (part 3) Functions – Cardinality Reading: Epp Chp 7.6.
Section 7.2. Section Summary Assigning Probabilities Probabilities of Complements and Unions of Events Conditional Probability Independence Bernoulli.
Methods of Proof Lecture 3: Sep 9. This Lecture Now we have learnt the basics in logic. We are going to apply the logical rules in proving mathematical.
CSCE 411 Design and Analysis of Algorithms Set 9: Randomized Algorithms Prof. Jennifer Welch Fall 2014 CSCE 411, Fall 2014: Set 9 1.
Chapter 5: Probability Analysis of Randomized Algorithms Size is rarely the only property of input that affects run time Worst-case analysis most common.
Week 11 What is Probability? Quantification of uncertainty. Mathematical model for things that occur randomly. Random – not haphazard, don’t know what.
4.1 Probability Distributions NOTES Coach Bridges.
Lecture V Probability theory. Lecture questions Classical definition of probability Frequency probability Discrete variable and probability distribution.
확률및공학통계 (Probability and Engineering Statistics) 이시웅.
Rules of the game  You will work with your Unit 3 group  We will have 4 rounds of 6 questions each. Most are multiple choice; some are fill in the blank.
Probability (outcome k) = Relative Frequency of k
Discrete Mathematics Set.
Discrete Random Variables. Introduction In previous lectures we established a foundation of the probability theory; we applied the probability theory.
TELECOMMUNICATIONS Dr. Hugh Blanton ENTC 4307/ENTC 5307.
Random Variables and Stochastic Processes – Dr. Ghazi Al Sukkar Office Hours: will be.
Basic probability Sep. 16, Introduction Our formal study of probability will base on Set theory Axiomatic approach (base for all our further studies.
CS 285- Discrete Mathematics
Chapter 1 Random events and the probability §1. Random event.
Section 2.5. Cardinality Definition: A set that is either finite or has the same cardinality as the set of positive integers (Z + ) is called countable.
Basic Probability. Introduction Our formal study of probability will base on Set theory Axiomatic approach (base for all our further studies of probability)
CS 173, Lecture B August 27, 2015 Tandy Warnow. Proofs You want to prove that some statement A is true. You can try to prove it directly, or you can prove.
Sample Space and Events Section 2.1 An experiment: is any action, process or phenomenon whose outcome is subject to uncertainty. An outcome: is a result.
PROBABILITY AND COMPUTING RANDOMIZED ALGORITHMS AND PROBABILISTIC ANALYSIS CHAPTER 1 IWAMA and ITO Lab. M1 Sakaidani Hikaru 1.
1 COMP2121 Discrete Mathematics Principle of Inclusion and Exclusion Probability Hubert Chan (Chapters 7.4, 7.5, 6) [O1 Abstract Concepts] [O3 Basic Analysis.
1-1 Copyright © 2013, 2005, 2001 Pearson Education, Inc. Section 2.4, Slide 1 Chapter 2 Sets and Functions.
Relations Chapter 9 Copyright © McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent of McGraw-Hill.
The Relation Induced by a Partition
Function Hubert Chan (Chapter 2.1, 2.2) [O1 Abstract Concepts]
Chapter 2 Sets and Functions.
The Language of Sets If S is a set, then
Theme 7. Use of probability in psychological research
Probability – part 1 Prof. Carla Gomes Rosen 1 1.
Probability.
Introduction to Discrete Mathematics
What is Probability? Quantification of uncertainty.
Function Hubert Chan (Chapter 2.1, 2.2) [O1 Abstract Concepts]
2.4 Sequences and Summations
Existence of Non-measurable Set
Some Review Problems for Math 141 Final
Cardinality of Sets Section 2.5.
Countable or Uncountable…That is the question!
Lecture 7 Functions.
The Foundations: Logic and Proofs
CS200: Algorithm Analysis
Functions Rosen 2.3, 2.5 f( ) = A B Lecture 5: Oct 1, 2.
Sets A set is simply any collection of objects
Sets and Probabilistic Models
Independence and Counting
Experiments, Outcomes, Events and Random Variables: A Revisit
Independence and Counting
Independence and Counting
CHAPTER 1 Regular Languages
Lecture 2 Basic Concepts on Probability (Section 0.2)
Presentation transcript:

Existence of Non-measurable Set Hubert Chan [O1 Abstract Concepts] [O2 Proof Techniques]

Review Infinite Sample Space Does there exist a uniform distribution on ? No. Suppose on the contrary, for all . Since is countable, we can apply the sum rule. If , then . If , then . Both cases contradict .

Review: Axiom of Choice Given a collection of non-empty subsets, there exists a representative function that elects a representative element from each subset.

Probability as a Measure Pick a point uniformly at random from the interval [0,1]. What is the probability that you picked a point from interval [a,b]? b – a Pick a point uniformly at random from the unit square area. What is the probability that you picked a point from a part of area s? s a b 1 s 1 1

Main Result: Non-Measurable Sets Is there a subset in the interval [0,1], such that the “length” of the subset cannot be defined? “Cannot be defined”: the length can not be any number c, for 0 ≤ c ≤ 1. Is there a shape inside the square, such that the area of the shape cannot be defined? ? 1 ? 1 1

Warm-Up Can we sample a positive integer uniformly at random? Can we pick a rational number from [0,1] u.a.r.?

Formal Definition [O1] Sample space : possible outcomes. Flipping a coin:  = { H, T } Collection F of events. An event is a subset of . (i) ; 2 F (ii) if A 2 F, then ( \ A) 2 F (iii) (countable union) if Ai 2 F for each positive integer i, then [i Ai 2 F F = {;, {H}, {T}, {H,T} }. ; is an impossible event, e.g., getting a “6” Probability function Pr : F ! [0,1] (i) Pr() = 1 (ii) For countable number of pairwise disjoint events Ai, Pr([i Ai) = i Pr(Ai).

Why can’t we pick a rational from [0,1] u.a.r.? Probability function Pr : F ! [0,1] (i) Pr() = 1 (ii) For countable number of pairwise disjoint events Ai, Pr([i Ai) = i Pr(Ai). Define Aq := {q} for each rational q in [0,1] How many rationals in [0,1]? Infinite. Countable? Can both (i) and (ii) hold if all Aq’s have the same probability?

How do we pick real from [0,1] u.a.r.? Note that Ω = [0,1) is uncountable. How do we pick numbers from Ω uniformly at random? What does it mean by “uniformly at random”? Intuition: For two subsets A and B, if we can get B (or A) by shifting A (or B), then it should hold that Pr[A] = Pr[B].

Cyclic Shifting Take Ω = [0,1). We “identify” 1 with 0. Cyclic shifting: a bijective function fs: Ω → Ω, such that 0 ≤ s < 1 and fs fs Examples: f0.2( [0.5,0.6] ) = [0.7,0.8]. f0.5( [0.7,0.8) ) = [0.2,0.3).

Uniformly at Random [O1] A selection from Ω is uniformly at random if it satisfies the following condition: For two subsets A, B, if there exists a cyclic shifting function from A to B (and vice versa), then Pr[A] = Pr[B].

Problem Sample space: Ω = [0,1). (We omit 1 for convenience.) Event: subset of numbers in Ω, e.g. interval [a,b]. Question: If we pick a real number from Ω uniformly at random, is it true that for any subset S⊆Ω, Pr[S] is well defined? Example: If S is an interval [a,b], then Pr[S] = b-a.

Recall The Problem [O2] Is it magic? Question: If we pick a real number from Ω uniformly at random, is it true that for any subset S ⊆ Ω, Pr[S] is well defined? In the remaining part, we will construct a subset M of Ω, for which Pr[M] is undefined, i.e., for any number p ∊ [0,1], we have Pr[M] ≠p. If we try to assign a value to Pr[M], we will violate properties of probability. Is it magic?

Equivalence Classes Definition of relation “〜”: x〜y  y-x ∊ Q Two numbers are related if their difference is rational. Note that “〜” is an equivalence relation. Let C be the collection of all equivalence classes of “〜”. Hence, C gives a partition of Ω.

Equivalence Classes: Cx Define Q = Q ⋂ Ω. Then Q contains all rational numbers in [0,1). Let equivalence class Cx be all the numbers y in Ω, such that x〜y. Then Cx = {x⊕q : q ∊ Q }, where Pr[Cx] = 0 ⋃A∊C A = ⋃x∊Ω Cx

Recall Axiom of Choice Suppose we have a collection C of non-empty sets in Ω S1, S2, S3, … Each set can be finite set or infinite set The number of sets can be finite or infinite (even uncountable) Then, we can pick a representative from each set: x1, x2, x3, … Each xi is an element of Si Formally, there exists f: C → Ω, such that for each A ∊ C, f(A) ∊ A

Candidate for Non-measurable set M = { f(A): A ∊ C } the set of representatives of equivalence classes Since there are “many” equivalence classes, we need Axiom of Choice to choose representatives. M is uncountable We want to show that it is impossible to define a probability for M.

Strategy We want to construct a countable collection of pairwise disjoint subsets M0, M1, M2, … such that ⋃i Mi= Ω and if Pr[M] exists, then for all i, Pr[Mi] = Pr[M]. Why would this cause contradiction?

Construction of Mq’s Given M, for each q in Q (q is a rational number in Ω), define Mq = {x ⊕ q: x ∊ M}. By uniformity, we have Pr[M] = Pr[Mq] for any q in Q. {Mq}q∊Q is countable.

Construction of Mq’s Mq’s are pairwise disjoint. Proof. Assume Mq ⋂ Mp≠ ∅. Then, there exists a number x ∊ M and y ∊ M such that x ⊕ q = y ⊕ p, which implies x〜y. Since x, y are both in M, then we know x = y, and consequently q = p, which indicate Mq = Mp.

Construction of Mq’s ⋃q Mq= Ω. Proof. For any x ∊ Ω, it’s in an equivalence class with representative u, such that x〜u. Hence there exists q ∊ Q, such that x = u ⊕ q, and x ∊ Mq.

Contradiction Recall that for pairwise disjoint sets Mi’s, if the collection of all Mi’s is countable, then Pr[{Mi}] = i Pr[Mi]. If Pr[M] = 0, then Pr[⋃i Mi] = 0, which contradicts to Pr[⋃i Mi] = Pr[Ω] = 1. If Pr[M] > 0, then Pr[⋃i Mi] = ∞, which contradicts to Pr[⋃i Mi] = Pr[Ω] = 1.

Conclusion It is impossible to divide up a sample space into countably infinite number of equally probably events. Assuming Axiom of Choice, there exists a non-measurable set. Do you know how to show there is a subset S in a 1 x 1 square such that the area of S is undefined?