1. Tracking using the Kalman Filter

2. Point Tracking Estimate the location of a given point along a sequence of images. (x 0,y 0 ) (x n,y n )

3. Object Tracking – Generate some conclusions about the motion of the scene, objects, or the camera, given a sequence of images. – Knowing this motion, predict where things are going to project in the next image, so that we don’t have so much work looking for them. – For example- unstable camera + Walking man: a. Stabilize the camera using the dominant motion ( find motion parameters ! ) b. Assume that the man translates horizontally.

9. Modeling “noise” or “uncertainty” rotation

11. The General Model Dynamics Process noise ~N(0,Q) Projection Measurement noise ~N(0,R)

12. Prediction Estimated state Estimated uncertainty / noise

13. Update Updated state Updated uncertainty / noise The weighting factor

14. Prediction Update Summery

15. Gaussian: “Normal” distribution 1D Gaussian: General Gaussian:

16. Adding two information sources We are given to information sources: Z 1 and Z 2 Both are normally distributed (v 1 > v 2 ) We would like to believe more to Z 2, but still use the information from Z 1 ! Mathematically:

17. The solution

18. The solution (cont’)

19. The merging of two Gaussians A “noisy” measure, be don’t believe it very much A more reliable measure

20. The merging of two Gaussians (cont’) The result is a new Gaussian with a smaller variance than the original ones !

21. Why to use the normal distribution? Simple to manipulate Minimize the squared error. The “big numbers” low. The distribution of many “natural” things.

22. What happens when we have a “wrong” estimation of the measurements variance ? The correct variance (The same variance that was used to simulate the points) The variance is too small: The estimation doesn’t converge The variance is too large: The convergence is very slow

23. Tracking using the Kalman Filter Two more examples.

24. The General Model Dynamics Process noise Projection Measurement noise

25. Example 1: Estimating a constant Measurement noise

26. Prediction: Update

27. We can combine the prediction and update

28. Claim1: Claim2: Conclusion: The Kalman filter gives a weighted mean !

29. Example 2 : Shihab4 In X: constant velocity In Y: constant acceleration

30. Example2 -dynamics

31. Example2 -measurements For each possible location, give a score Normalize the sum of the scores to 1. The result is a matrix of “probabilities” for each location. Fit a 2D Gaussian to this matrix, whose center is given by: Given an image of the missile (or other source of information):