1 Digital Image Stabilization 教師 : 楊士萱 老師 學生 : 鄭馥銘

2 Outline Introduction of DIS DIS work flow chart Current work Experiment result Future work

3 Introduction of DIS Video footage from hand-held DV is typically jerky due to small, unwanted DV movement

4 Introduction of DIS

5 A DIS system aims to produce a compensated video sequence so that the image motion due to the camera ’ s undesirable shake or jiggles can be removed

6 DIS work flow chart Block-Blased Motion Estimation Do DIS? MV Validation MVs LMVs

7 DIS flow chart FMV Generation Hand – shake Estimation Motion correction LMVs FMVs SMV, HMV, AMV

8 Current work - ME Block-Blased Motion Estimation Do DIS? MV Validation MVs

9 Current work - ME Block-based motion estimation – Using Y in YCBCr,MAD as the distortion measure – MB size = 16 * 16 – Pixel depth = 8 – Resolution = ½ – Search range = 32 or 64 – Full search

10 Current work – do DIS? Block-Blased Motion Estimation Do DIS? MV Validation MVs Not yet

11 Current work – MV Validation Block-Blased Motion Estimation Do DIS? MV Validation LMVs MVs

12 Current work – MV Validation Eliminate the Motion Vectors that effect to obtain frame Motion Vector(FMV). – Repeated pattern – Moving object

13 Current work – FMV Generation FMV Generation Hand – Shake Estimation Motion Correction LMVs FMV

14 Current work – FMV Generation Compute the FMV form LMVs – Median of LMVs – Mean of LMVs – Majority of LMVs that had counted amount of direction

15 Current work – Hand Shake Est FMV Generation Hand – Shake Estimation Motion Correction LMVs FMV SMV, HMV, AMV

16 Current work – Hand Shake Est FMV = SMV(steady motion vector) + HMV(Hand Shake) SMV – Mean of post FMVs in buffer – Motion Vector Integration ( SMV(n) = αSMV(n-1) + βFMV(n) ) HMV(n) = FMV(n) – SMV(n) AMV(n) = AMV(n-1) + HMV(n)

17 Current work – Motion Correction FMV Generation Hand – Shake Estimation Motion Correction LMVs FMV SMV, HMV, AMV AMV

18 Experiment result1 – sport video SMV = Mean of post FMVs in buffer

19 Experiment result1 – sport video HMV(n) = FMV(n) – SMV(n)

20 Experiment result1 – sport video Frequency response of FMV & SMV

21 Experiment result2 – sport video SMV(n) = α SMV(n-1) + βFMV(n)

22 Experiment result2 – sport video HMV(n) = FMV(n) – SMV(n)

23 Experiment result2 – sport video Frequency response of FMV & SMV

24 Future work Block-Blased Motion Estimation Do DIS? MV Validation

25 Future work FMV Generation verify mean & median & majority result MV Validation – MVI method SMV(n) = αSMV(n-1) + βFMV(n) How to choose α and β. ? Spare MBs for foreground and background ?

26 Future work Finding or making video suit with DIS testing Implement DIS system in DM270