Markov Chains Extra problems

Slides:

Advertisements

Similar presentations

Markov Chain Nur Aini Masruroh.

Advertisements

Markov Processes Aim Higher. What Are They Used For? Markov Processes are used to make predictions and decisions where results are partly random but may.

This is the online version of the game of craps. It is a type of simulation game. It’s as though you’re playing on the real table. Craps is played in most.

. Markov Chains. 2 Dependencies along the genome In previous classes we assumed every letter in a sequence is sampled randomly from some distribution.

EGR 141 Computer Problem Solving in Engineering and Computer Science

A measurement of fairness game 1: A box contains 1red marble and 3 black marbles. Blindfolded, you select one marble. If you select the red marble, you.

Take out a coin! You win 4 dollars for heads, and lose 2 dollars for tails.

DGame Task Task 1Task 2Task 3Task 4 Task 5Task 6Task 7Task 8 Task 9Task 10Task 11 NC Level 3 to 8.

Games of probability What are my chances?. Roll a single die (6 faces). –What is the probability of each number showing on top? Activity 1: Simple probability:

Monopoly Game Example Mutually Exclusive.

. Markov Chains as a Learning Tool. 2 Weather: raining today40% rain tomorrow 60% no rain tomorrow not raining today20% rain tomorrow 80% no rain tomorrow.

. Computational Genomics Lecture 7c Hidden Markov Models (HMMs) © Ydo Wexler & Dan Geiger (Technion) and by Nir Friedman (HU) Modified by Benny Chor (TAU)

Hidden Markov Models Tunghai University Fall 2005.

. Hidden Markov Models - HMM Tutorial #5 © Ydo Wexler & Dan Geiger.

Lecture 12 – Discrete-Time Markov Chains

An Introduction to Markov Chains. Homer and Marge repeatedly play a gambling game. Each time they play, the probability that Homer wins is 0.4, and the.

Markov Chain Part 2 多媒體系統研究群指導老師：林朝興博士學生：鄭義繼. Outline Review Classification of States of a Markov Chain First passage times Absorbing States.

Tutorial 8 Markov Chains. 2  Consider a sequence of random variables X 0, X 1, …, and the set of possible values of these random variables is {0, 1,

What is the probability that the great-grandchild of middle class parents will be middle class? Markov chains can be used to answer these types of problems.

INDR 343 Problem Session

INFM 718A / LBSC 705 Information For Decision Making Lecture 9.

Markov Chains Chapter 16.

INDR 343 Problem Session

. Markov Chains Tutorial #5 © Ilan Gronau. Based on original slides of Ydo Wexler & Dan Geiger.

1 Introduction to Stochastic Models GSLM Outline  discrete-time Markov chain  motivation  example  transient behavior.

My game… You pay £1 to play I roll a dice If it lands on 1 or 2 you win £1.50 If it lands on 3, 4, 5, 6 you lose Will this game make me a profit if 10.

Lucky Candies Probability Game By: Laura Santa Maria Isabella Moreno.

CDA6530: Performance Models of Computers and Networks Examples of Stochastic Process, Markov Chain, M/M/* Queue TexPoint fonts used in EMF. Read the TexPoint.

The game of Craps Rules of play: 1. Played with two dice (six faces to a die – numbers 1-6 per face) 2. Sequence of betting rounds (or just rounds) 3.

S TOCHASTIC M ODELS L ECTURE 1 M ARKOV C HAINS Nan Chen MSc Program in Financial Engineering The Chinese University of Hong Kong (ShenZhen) Sept. 9, 2015.

Probability True or False? Answers.

Dice Games for Math. Multiplication War Skill: Multiplication facts to 36 Players: 2 to 4 players Supplies: 2 dice and counters (such as M&Ms, Cheerios,

Unit 6 Games. The Difference Game Materials –4 decks of cards number –40 pennies One player shuffles the number cards and places them with the numbers.

1 M14 Expected Value, Discrete  Department of ISM, University of Alabama, ’95,2002 Lesson Objectives  Understand the meaning of “expected value.” (Know.

Dependent and Independent Events. Events are said to be independent if the occurrence of one event has no effect on the occurrence of another. For example,

Rolling Two Number Cubes Good practice for addition of numbers in primary. Play some games – See who is the first one to fill all the boxes 2-12 on their.

Math Meeting Write today’s date __________________________ How many weeks and extra days are there until May 1 st ?_______________ Time: _______________________.

2 Digit Divisors. 3,521 ÷ 26 = = 26 x = 26 x 3 Click the squirrel for a video on repeated multiplication.

Expected Value.

 { X n : n =0, 1, 2,...} is a discrete time stochastic process Markov Chains.

Chapter 3 : Problems 7, 11, 14 Chapter 4 : Problems 5, 6, 14 Due date : Monday, March 15, 2004 Assignment 3.

Probability Evaluation 11/12 th Grade Statistics Fair Games Random Number Generator Probable Outcomes Resources Why Fair Games? Probable Outcome Examples.

1 Parrondo's Paradox. 2 Two losing games can be combined to make a winning game. Game A: repeatedly flip a biased coin (coin a) that comes up head with.

Not So Great Expectations! Which game do you think has the highest return per dollar?

Decimal Roll Game Today’s Learning Goals  We will continue to practice comparing and adding/subtracting decimal numbers by playing a game.

Lesson 10.5 AIM: The Game of Pig. DO NOW What is a strategy? Give an example from your daily life of how you use strategies.

8/14/04J. Bard and J. W. Barnes Operations Research Models and Methods Copyright All rights reserved Lecture 12 – Discrete-Time Markov Chains Topics.

Craps Probability Solution Or: More than you ever wanted to know about conditional probability!

Fair and Unfair Games Laura Smiley. What makes a game… FairUnfair.

WOULD YOU PLAY THIS GAME? Roll a dice, and win $1000 dollars if you roll a 6.

Warm-Up Pick a partner. Get one worksheet per pair, and one die per pair. They are located on the table near the door. DO NOT START ON WORKSHEET Also.

PIG GAME. MATERIALS  Dices  Scoring pad or sheets Player 1Player 2 Roll

Jane wins $21 if a die roll shows a six, and she loses $2 otherwise

A nontransitive talk James Grime. Hi Jim, I was wondering if you can design a set of five nontransitive dice.

In the last section, you figured out how to determine what values of x make one expression greater than another. In this lesson you will study what can.

Thinking Mathematically Expected Value. Expected value is a mathematical way to use probabilities to determine what to expect in various situations over.

Pronunciation Pronunciation Board game 1.Roll the dice and advance according to the number that shows on the dice. 2. When a player lands on a space s/he.

Let E denote some event. Define a random variable X by Computing probabilities by conditioning.

Discrete-time markov chain (continuation)

Markov Chains Tutorial #5

Probability of casino games

IENG 362 Markov Chains.

Expected Value.

Probability True or False? Answers.

1st/2nd Grade Math Games Family Math Night.

GAMBLER’S RUIN in a FAIR GAME

Expected Value.

Fun… Tree Diagrams… Probability.

Presentation transcript:

Markov Chains Extra problems

Markov Chain Example -- Weather raining today 40% rain tomorrow 60% no rain tomorrow not raining today 20% rain tomorrow 80% no rain tomorrow Construct a transition graph and a transition matrix.

Markov Chain Example – Stock Price At the end of a given day, the price of a stock is recorded. If the stock has gone up, the probability that it will go up tomorrow is 0.7. If the stock has gone down, the probability that it will go up tomorrow is only 0.5. Construct a transition graph and a transition matrix.

Markov Chain Example -- Gambler’s Ruin At time zero I have X0 = $2, and each day I make a $1 bet. I win with probability p and lose with probability 1– p. I’ll quit if I ever obtain $4 or if I lose all my money. Xt = amount of money I have after the bet on day t. 3 with probability p 1 with probability 1 – p So, X1 = { if Xt = 4 then Xt+1 = Xt+2 = • • • = 4 if Xt = 0 then Xt+1 = Xt+2 = • • • = 0. The possible values of Xt is S = { 0, 1, 2, 3, 4 } Construct a transition graph and a transition matrix.

Markov Chain Example -- Game of Craps The Game of Craps in Las Vegas plays as follows The player rolls a pair of dice and sums the numbers showing. A total of 7 or 11 on the first rolls wins for the player Where a total of 2, 3, 12 loses Any other number is called the point. The player rolls the dice again. If he/she rolls the point number, she wins If he/she rolls number 7, she loses Any other number requires another roll The game continues until he/she wins or loses. Construct a transition graph and a transition matrix.