1 Engineering Computation Part 5. 2 Some Concepts Previous to Probability RANDOM EXPERIMENT A random experiment or trial can be thought of as any activity.

Slides:



Advertisements
Similar presentations
Discrete Random Variables and Probability Distributions
Advertisements

MOMENT GENERATING FUNCTION AND STATISTICAL DISTRIBUTIONS
Chapter 2 Multivariate Distributions Math 6203 Fall 2009 Instructor: Ayona Chatterjee.
Chapter 2 Concepts of Prob. Theory
Random Variables ECE460 Spring, 2012.
DISCRETE RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS
Week 21 Basic Set Theory A set is a collection of elements. Use capital letters, A, B, C to denotes sets and small letters a 1, a 2, … to denote the elements.
The Bernoulli distribution Discrete distributions.
Chapter 2 Discrete Random Variables
Discrete Probability Distributions
DEPARTMENT OF HEALTH SCIENCE AND TECHNOLOGY STOCHASTIC SIGNALS AND PROCESSES Lecture 1 WELCOME.
Review of Basic Probability and Statistics
Chapter 4 Discrete Random Variables and Probability Distributions
Introduction to stochastic process
Discrete Random Variables and Probability Distributions
Probability Distributions Finite Random Variables.
Assignment 2 Chapter 2: Problems  Due: March 1, 2004 Exam 1 April 1, 2004 – 6:30-8:30 PM Exam 2 May 13, 2004 – 6:30-8:30 PM Makeup.
Probability Distributions
1 Review of Probability Theory [Source: Stanford University]
Data Basics. Data Matrix Many datasets can be represented as a data matrix. Rows corresponding to entities Columns represents attributes. N: size of the.
Visual Recognition Tutorial1 Random variables, distributions, and probability density functions Discrete Random Variables Continuous Random Variables.
A random variable that has the following pmf is said to be a binomial random variable with parameters n, p The Binomial random variable.
2. Random variables  Introduction  Distribution of a random variable  Distribution function properties  Discrete random variables  Point mass  Discrete.
Continuous Random Variables and Probability Distributions
Copyright © 2014 by McGraw-Hill Higher Education. All rights reserved.
Review of Probability and Random Processes
Discrete Random Variables and Probability Distributions
Chapter 21 Random Variables Discrete: Bernoulli, Binomial, Geometric, Poisson Continuous: Uniform, Exponential, Gamma, Normal Expectation & Variance, Joint.
Probability Distributions: Finite Random Variables.
Lecture 28 Dr. MUMTAZ AHMED MTH 161: Introduction To Statistics.
Prof. SankarReview of Random Process1 Probability Sample Space (S) –Collection of all possible outcomes of a random experiment Sample Point –Each outcome.
Chapter 5 Discrete Random Variables and Probability Distributions ©
Winter 2006EE384x1 Review of Probability Theory Review Session 1 EE384X.
Copyright © 2010, 2007, 2004 Pearson Education, Inc. Review and Preview This chapter combines the methods of descriptive statistics presented in.
The Negative Binomial Distribution An experiment is called a negative binomial experiment if it satisfies the following conditions: 1.The experiment of.
Basic Concepts of Discrete Probability (Theory of Sets: Continuation) 1.
CPSC 531: Probability Review1 CPSC 531:Probability & Statistics: Review II Instructor: Anirban Mahanti Office: ICT 745
Random Variables. A random variable X is a real valued function defined on the sample space, X : S  R. The set { s  S : X ( s )  [ a, b ] is an event}.
Week 21 Conditional Probability Idea – have performed a chance experiment but don’t know the outcome (ω), but have some partial information (event A) about.
Expectation for multivariate distributions. Definition Let X 1, X 2, …, X n denote n jointly distributed random variable with joint density function f(x.
Math b (Discrete) Random Variables, Binomial Distribution.
STA347 - week 31 Random Variables Example: We roll a fair die 6 times. Suppose we are interested in the number of 5’s in the 6 rolls. Let X = number of.
Stats Probability Theory Summary. The sample Space, S The sample space, S, for a random phenomena is the set of all possible outcomes.
Exam 2: Rules Section 2.1 Bring a cheat sheet. One page 2 sides. Bring a calculator. Bring your book to use the tables in the back.
Topic 3 - Discrete distributions Basics of discrete distributions - pages Mean and variance of a discrete distribution - pages ,
Probability (outcome k) = Relative Frequency of k
Basics on Probability Jingrui He 09/11/2007. Coin Flips  You flip a coin Head with probability 0.5  You flip 100 coins How many heads would you expect.
Random Variables Example:
Discrete Random Variables. Introduction In previous lectures we established a foundation of the probability theory; we applied the probability theory.
Random Variables. Numerical Outcomes Consider associating a numerical value with each sample point in a sample space. (1,1) (1,2) (1,3) (1,4) (1,5) (1,6)
Continuous Random Variables and Probability Distributions
1 Review of Probability and Random Processes. 2 Importance of Random Processes Random variables and processes talk about quantities and signals which.
Statistical NLP: Lecture 4 Mathematical Foundations I: Probability Theory (Ch2)
Random Variables 2.1 Discrete Random Variables 2.2 The Expectation of a Random Variable 2.3 The Variance of a Random Variable 2.4 Jointly Distributed Random.
Engineering Probability and Statistics - SE-205 -Chap 3 By S. O. Duffuaa.
Random Variables If  is an outcome space with a probability measure and X is a real-valued function defined over the elements of , then X is a random.
The UNIVERSITY of NORTH CAROLINA at CHAPEL HILL Review of Final Part I Sections Jiaping Wang Department of Mathematics 02/29/2013, Monday.
MAT 446 Supplementary Note for Ch 3
Engineering Probability and Statistics - SE-205 -Chap 3
Chapter 2 Discrete Random Variables
Appendix A: Probability Theory
Some Discrete Probability Distributions
Statistical NLP: Lecture 4
Discrete Random Variables: Basics
Discrete Random Variables: Basics
Experiments, Outcomes, Events and Random Variables: A Revisit
Discrete Random Variables and Probability Distributions
Random Variables Binomial and Hypergeometric Probabilities
Discrete Random Variables: Basics
Presentation transcript:

1 Engineering Computation Part 5

2 Some Concepts Previous to Probability RANDOM EXPERIMENT A random experiment or trial can be thought of as any activity that will result in one and only one of several well-defined outcomes, but one does not know in advance which one will occur. SAMPLE SPACE The set of all possible outcomes of a random experiment E, denoted by S(E), is called the sample space of the random experiment E. EXAMPLE Suppose that the structural condition of a concrete structure (e.g., a bridge) can be classified into one of three categories: poor, fair, or good. An engineer examines one such structure to assess its condition. This is a random experiment. Its sample space, S(E) = {poor, fair, good}, has three elements. If instead one measures the concrete quality in the range [0,10], this is the sample space.

3 Example of a random experiment RANDOM EXPERIMENT Rolling two dices SAMPLE SPACE The set {1,2,3,4,5,6} x {1,2,3,4,5,6}

4 Random Variable RANDOM VARIABLE A random variable can be defined as a real-valued function defined over a sample space of a random experiment. That is, the function assigns a real value to every element in the sample space of a random experiment. The set of all possible values of a random variable X, denoted by S(X), is called the support or range of the random variable X. EXAMPLE In the previous concrete example, let X be −1, 0, or 1, depending on whether the structure is poor, fair, or good, respectively. Then X is a random variable with support S(X) = {−1, 0, 1}. The condition of the structure can also be assessed using a continuous scale, say, from 0 to 10, to measure the concrete quality, with 0 indicating the worst possible condition and 10 indicating the best. Let Y be the assessed condition of the structure. Then Y is a random variable with support S(Y ) = {y : 0 ≤ y ≤ 10}

5 Random Variable

6 NOTATION We consistently use the customary notation of denoting random variables by uppercase letters such as X, Y, and Z or X 1,X 2,...,X n, where n is the number of random variables under consideration. Realizations of random variables (that is, the actual values they may take) are denoted by the corresponding lowercase letters such as x, y, and z or x 1, x 2,..., x n. DISCRETE AND CONTINUOUS RANDOM VARIABLES A random variable is said to be discrete if it can assume only a finite or countably infinite number of distinct values. Otherwise, it is said to be continuous. Thus, a continuous random variable can take an uncountable set of real values. The random variable X in the concrete example with possible values -1. 0, 1 is discrete whereas the random variable Y, with values in [0,10], is continuous. UNIVARIATE AND MULTIVARIATE RANDOM VARIABLES When we deal with a single random quantity, we have a univariate random variable. When we deal with two or more random quantities simultaneously, we have a multivariate random variable.

7 Probability axioms

8 Probability properties

9 Induced probability of a random variable

10 Induced probability of a random variable

11 Induced probability of a random variable

12 Conditional probability

13 Independence of events

14 Total probability and Bayes theorems

15 Probability of a random variable To specify a random variable we need to know: 1.its range or support, S(X), which is the set of all possible values of the random variable, and 2.a tool by which we can obtain the probability associated with every subset in its support, S(X). These tools are some functions such as the probability mass function (pmf), the cumulative distribution function (cdf)

16 Probability mass function of a discrete random variable

17 Cumulative distribution function of a discrete random variable Properties Concrete example

18 Moments of a discrete random variable

19 Moments of a discrete random variable

20 Bernoulli Random Variable

21 Binomial random variable The binomial random variable arises when one repeats n identical and independent Bernoulli experiments and observes the number of successes. EXAMPLES The number os cars taking left at one intersection of a series of 100 cars The number of broken specimens in a test of a series of 100 specimens The number of exceedances of a given flow level in a series of 365 days. The number of waves higher than 10 m in a series of 1000 waves.

22 Binomial random variable

23 Binomial random variable

24 Binomial random variable

25 Binomial random variable

26 Geometric or Pascal random variable

27 Geometric or Pascal random variable

28 Return period Thus, the return period is 1/p for exceedances For large values it becomes 1/(1-p)

29 Negative binomial random variable

30 Negative binomial random variable

31 Negative binomial random variable

32 Hypergeometric random variable

33 Hypergeometric random variable

34 Poisson random variable Assumptions

35 Poisson random variable

36 Poisson random variable

37 Poisson random variable

38 Multivariate random variable Joint probability mass function Example

39 Marginal probability mass function

40 Conditional probability mass function

41 Variance and covariances

42 Means, variances and covariances

43 Covariance and correlation

44 Covariance and correlation

45 Multinomial distribution

46 Multinomial distribution