1. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr A study on resolution-improved volumetric computational reconstruction using stereo matching in 3D integral imaging Graduate school of Design & IT Dongseo Univ Hwang Yong-Hyeon http://kowon.dongseo.ac.kr/~d0066042

2. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Contents 1.Introduction 2.Conventional method 3.Proposed method 4.Experiment Results 5.Future work

3. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Introduction

4. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr 3D Display  Human Visual System Stereo Disparity

5. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr 3D Display 1.Stereoscopic display 2.Multi-view display 3.Integral imaging display 4.Holographic display Left camera Right camera

6. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr 3D Display 1.Stereoscopic display 2.Multi-view display 3.Integral imaging display 4.Holographic display

7. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr 3D Display 1.Stereoscopic display 2.Multi-view display 3.Integral imaging display 4.Holographic display

8. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr 3D Display 1.Stereoscopic display 2.Multi-view display 3.Integral imaging display 4.Holographic display

9. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Integral imaging PickupDisplay 3D Elemental images Lenslet array 3D object3D image Elemental images Lenslet array

10. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Optical vs Computational Optical pickup Optical Reconstruction Computational Reconstruction Real 3D display (NHK,SNU, Connecticut Univ. etc) Pattern recognition (Connecticut Univ., KWU etc) VCR

11. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr CII system Pickup process (optical) Volumetric computational reconstruction (VCR) (computer) plane by plane VCR

12. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr VCR of 3D objects Elemental image Reconstruction Object Pinhole array Elemental image

13. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Conventional method

14. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Conventional method B. Javidi et al, R. Ponce-Diaz, and S.-H. Hong, Opt. Lett. 31, 1106-1108 (2006) Reference plane image z=z r z=0 Cross- correlation z=z r z=0 Target plane image

15. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Proposed method

16. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Novel Proposed method Sub-Image transformation Segmentation using stereo matching VCR zrzr Inverse Sub-Image transformation

17. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Elemental image

18. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Novel Proposed System Sub-Image transformatio n Segmentation using stereo matching VCR zrzr Inverse Sub-Image transformation Elemental image

19. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Sub-image transformation Elemental image Sub-image

20. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Sub-image transformation

21. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Sub-image transformation 1 pixel sub-image transformation Elemental images

22. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Sub-image transformation 900 x 900 1 pixel sub-image transformation

23. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Novel Proposed System Segmentation using stereo matching VCR zrzr Inverse Sub-Image transformation Elemental image Sub-Image transformatio n

24. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Stereo matching P L = (X,Y,Z) OLOL x y z (u L,v L ) OROR x y z (u R,v R ) baseline B

25. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr feature-based method Original image Feature image

26. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Matching window area-based method Left imageRight image

27. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Stereo matching SSD (Sum of square distance) SAD (Sum of absolute distance) NCC (Normalized correlation coefficient)

28. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Disparity map Right ImageLeft ImageDisparity

29. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Sub-image transformation 900 x900 5 pixel sub-image transformation

30. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Stereo matching 5 X 5 sub-image

31. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Stereo matching Left image Right image

32. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Disparity map

33. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Segmentation result 5 x 5 Sub-image Segmentation result

34. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Novel Proposed System Segmentation using stereo matching VCR zrzr Inverse Sub-Image transformation Elemental image Sub-Image transformatio n

35. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Inverse sub-image 5 x 5 Sub-image Elemental image

36. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Novel Proposed System Segmentation using stereo matching VCR zrzr Inverse Sub-Image transformation Elemental image Sub-Image transformatio n

37. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr VCR

38. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Experiment Results

39. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr VCR of conventional method Elemental imageVCR image

40. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr VCR of proposed method Segmentation elemental imageVCR image

41. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr PSNR of conventional method PSNR : 20.94db Reference imageReconstruction image

42. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr PSNR of proposed method PSNR : 29.61db Reference imageReconstruction image

43. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Test image CowToyCarHorse CowToyCarHorse

44. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr PSNR Conventional methodProposed methodImproved PSNR Cow20.9429.618.67db Toy22.3129.817.5db Car18.0324.015.98db Horse13.7823.199.41db

45. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Experiment environment

46. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Real image Elemental image Sub-imagea dieToy Segmentation result

47. Hwang Yong-Hyeon Dongseo Univ. E-mail:pial051@dit.dongseo.ac.kr Future work Real image test Segmentation using difference stereo matching Real image calibration