1. 1 Digital Image Stabilization 教師 : 楊士萱 老師 學生 : 鄭馥銘

2. 2 Outline Introduction of DIS DIS work flow chart Current work Experiment result Future work

3. 3 Introduction of DIS Video footage from hand-held DV is typically jerky due to small, unwanted DV movement

4. 4 Introduction of DIS

5. 5 A DIS system aims to produce a compensated video sequence so that the image motion due to the camera ’ s undesirable shake or jiggles can be removed

6. 6 DIS work flow chart Block-Blased Motion Estimation Do DIS? MV Validation MVs LMVs

7. 7 DIS flow chart FMV Generation Hand – shake Estimation Motion correction LMVs FMVs SMV, HMV, AMV

8. 8 Current work - ME Block-Blased Motion Estimation Do DIS? MV Validation MVs

9. 9 Current work - ME Block-based motion estimation – Using Y in YCBCr,MAD as the distortion measure – MB size = 16 * 16 – Pixel depth = 8 – Resolution = ½ – Search range = 32 or 64 – Full search

10. 10 Current work – do DIS? Block-Blased Motion Estimation Do DIS? MV Validation MVs Not yet

11. 11 Current work – MV Validation Block-Blased Motion Estimation Do DIS? MV Validation LMVs MVs

12. 12 Current work – MV Validation Eliminate the Motion Vectors that effect to obtain frame Motion Vector(FMV). – Repeated pattern – Moving object

13. 13 Current work – FMV Generation FMV Generation Hand – Shake Estimation Motion Correction LMVs FMV

14. 14 Current work – FMV Generation Compute the FMV form LMVs – Median of LMVs – Mean of LMVs – Majority of LMVs that had counted amount of direction

15. 15 Current work – Hand Shake Est FMV Generation Hand – Shake Estimation Motion Correction LMVs FMV SMV, HMV, AMV

16. 16 Current work – Hand Shake Est FMV = SMV(steady motion vector) + HMV(Hand Shake) SMV – Mean of post FMVs in buffer – Motion Vector Integration ( SMV(n) = αSMV(n-1) + βFMV(n) ) HMV(n) = FMV(n) – SMV(n) AMV(n) = AMV(n-1) + HMV(n)

17. 17 Current work – Motion Correction FMV Generation Hand – Shake Estimation Motion Correction LMVs FMV SMV, HMV, AMV AMV

18. 18 Experiment result1 – sport video SMV = Mean of post FMVs in buffer

19. 19 Experiment result1 – sport video HMV(n) = FMV(n) – SMV(n)

20. 20 Experiment result1 – sport video Frequency response of FMV & SMV

21. 21 Experiment result2 – sport video SMV(n) = α SMV(n-1) + βFMV(n)

22. 22 Experiment result2 – sport video HMV(n) = FMV(n) – SMV(n)

23. 23 Experiment result2 – sport video Frequency response of FMV & SMV

24. 24 Future work Block-Blased Motion Estimation Do DIS? MV Validation

25. 25 Future work FMV Generation verify mean & median & majority result MV Validation – MVI method SMV(n) = αSMV(n-1) + βFMV(n) How to choose α and β. ? Spare MBs for foreground and background ?

26. 26 Future work Finding or making video suit with DIS testing Implement DIS system in DM270