Design of Augmented Object Compositing System based on Diminished Reality Donghyun Kim 1, Kwang Hyun Jang 2, Seoksoo Kim * 1,* Dept of Multimeida Engineering,

Slides:



Advertisements
Similar presentations
Advanced Image Processing Student Seminar: Lipreading Method using color extraction method and eigenspace technique ( Yasuyuki Nakata and Moritoshi Ando.
Advertisements

Automatic Color Gamut Calibration Cristobal Alvarez-Russell Michael Novitzky Phillip Marks.
QR Code Recognition Based On Image Processing
David Wild Supervisor: James Connan Rhodes University Computer Science Department Gaze Tracking Using A Webcamera.
LING 111 Teaching Demo By Tenghui Zhu Introduction to Edge Detection Image Segmentation.
ART: Augmented Reality Table for Interactive Trading Card Game Albert H.T. Lam, Kevin C. H. Chow, Edward H. H. Yau and Michael R. Lyu Department of Computer.
Comparison and Combination of Ear and Face Images in Appearance-Based Biometrics IEEE Trans on PAMI, VOL. 25, NO.9, 2003 Kyong Chang, Kevin W. Bowyer,
Smart Traveller with Visual Translator. What is Smart Traveller? Mobile Device which is convenience for a traveller to carry Mobile Device which is convenience.
California Car License Plate Recognition System ZhengHui Hu Advisor: Dr. Kang.
Preprocessing Images for Facial Recognition Adam Schreiner ECE533.
Jason Li Jeremy Fowers Ground Target Following for Unmanned Aerial Vehicles.
OOSE 01/17 Institute of Computer Science and Information Engineering, National Cheng Kung University Member:Q 薛弘志 P 蔡文豪 F 周詩御.
Presented by: Kamakhaya Argulewar Guided by: Prof. Shweta V. Jain
Shape Recognition and Pose Estimation for Mobile Augmented Reality Author : N. Hagbi, J. El-Sana, O. Bergig, and M. Billinghurst Date : Speaker.
New Segmentation Methods Advisor : 丁建均 Jian-Jiun Ding Presenter : 蔡佳豪 Chia-Hao Tsai Date: Digital Image and Signal Processing Lab Graduate Institute.
KinectFusion : Real-Time Dense Surface Mapping and Tracking IEEE International Symposium on Mixed and Augmented Reality 2011 Science and Technology Proceedings.
Presented by Tienwei Tsai July, 2005
Course Syllabus 1.Color 2.Camera models, camera calibration 3.Advanced image pre-processing Line detection Corner detection Maximally stable extremal regions.
Face Recognition System By Arthur. Introduction  A facial recognition system is a computer application for automatically identifying or verifying a person.
COMPARISON OF IMAGE ANALYSIS FOR THAI HANDWRITTEN CHARACTER RECOGNITION Olarik Surinta, chatklaw Jareanpon Department of Management Information System.
The Implementation of Markerless Image-based 3D Features Tracking System Lu Zhang Feb. 15, 2005.
Synthesizing Natural Textures Michael Ashikhmin University of Utah.
Development of a Software Renderer for utilizing 3D Contents on a 2D-based Mobile System Sungkwan Kang 1, Joonseub Cha 2, Jimin Lee 1 and Jongan Park 1,
Longitudinal Motion Characteristics between a Non- Matched Piezoelectric Sensor and Actuator Pair Young-Sup Lee Department of Embedded Systems Engineering,
Surround-Adaptive Local Contrast Enhancement for Preserved Detail Perception in HDR Images Geun-Young Lee 1, Sung-Hak Lee 1, Hyuk-Ju Kwon 1, Tae-Wuk Bae.
Design of Context-Aware based Information Prevention Sungmo Jung 1, Younsam Chae 2, Jonghun Shin 2, Uyeol Baek 2, Seoksoo Kim ∗ 1, * Department of Multimedia,
A Study of Secure Communications in WiFi Networks Bumjo Park 1 and Namgi Kim 11 1 Dept. Of Computer Science, Kyonggi Univ. San 94-1, Iui, Yeongtong, Suwon,
Advanced Science and Technology Letters Vol.106 (Information Technology and Computer Science 2015), pp.17-21
Effect Analysis of Electric Vehicle Charging to Smart Grid with Anti-Islanding Method Bum-Sik Shin, Kyung-Jung Lee, Sunny Ro, Young-Hun Ki and Hyun-Sik.
Interactive Mirror System based on Personal Purchase Information Donghyun Kim 1, Younsam Chae 2, Jonghun Shin 2, Uyeol Baek 2, Seoksoo Kim * 1,* Dept of.
Advanced Science and Technology Letters Vol.28 (EEC 2013), pp Histogram Equalization- Based Color Image.
Applicability Analysis of Software Testing for Actual Operating Railway Software Jong-Gyu Hwang 1, Hyun-Jeong Jo 1, Baek-Hyun Kim 1, Jong-Hyun Baek 1 1.
The Study on the Car Mechanics e-Training AR(Augmented Reality) System for Real-time Augmented Contents Ji-Yean Yoon,1, Dong-Jin Kim 1, Yu-Doo Kim 1 and.
Border Code: an Efficient Code System for Augmented Reality Seong-hun Park and Young-guk Ha' Konkuk University, Department of Computer Science and Engineering,
Robot Velocity Based Path Planning Along Bezier Curve Path Gil Jin Yang, Byoung Wook Choi * Dept. of Electrical and Information Engineering Seoul National.
Augmented Reality and 3D modelling Done by Stafford Joemat Supervised by Mr James Connan.
A Recognition Method of Restricted Hand Shapes in Still Image and Moving Image Hand Shapes in Still Image and Moving Image as a Man-Machine Interface Speaker.
BLFS: Supporting Fast Editing/Writing for Large- Sized Multimedia Files Seung Wan Jung 1, Seok Young Ko 2, Young Jin Nam 3, Dae-Wha Seo 1, 1 Kyungpook.
Advanced Science and Technology Letters Vol.28 (EEC 2013), pp Fuzzy Technique for Color Quality Transformation.
Protocol Extraction for Blackbox-based Online Game Testing Yeonjun Choi 1,2, Seongil Jin 2, ' ETRI, 2 Chungnam National University Daej eon, Korea
Color Image Segmentation Mentor : Dr. Rajeev Srivastava Students: Achit Kumar Ojha Aseem Kumar Akshay Tyagi.
A NEW ALGORITHM FOR THE VISUAL TRACKING OF SURGICAL INSTRUMENT IN ROBOT-ASSISTED LAPAROSCOPIC SURGERY 1 Interdisciplinary Program for Bioengineering, Graduate.
Improved Lane Detection for Unmanned Ground Vehicle Navigation Seok Beom Kim, Joo Hyun Kim, Bumkyoo Choi, and Jungchul Lee Department of Mechanical Engineering,
Advanced Science and Technology Letters Vol.46 (Games and Graphics 2014), pp On Study of the Volumetric.
The Design of Smart RFID Tag System for Food Poisoning Index Monitoring Chang Won Lee 1.1, Nghia Truong Van 1, Kyung Kwon Jung 2, Joo Woong Kim 1, Woo.
Augmented Reality Services based on Embedded Metadata Byoung-Dai Lee Department of Computer Science, Kyonggi University, Suwon, Korea Abstract.
Student Gesture Recognition System in Classroom 2.0 Chiung-Yao Fang, Min-Han Kuo, Greg-C Lee, and Sei-Wang Chen Department of Computer Science and Information.
Visual Information Processing. Human Perception V.S. Machine Perception  Human perception: pictorial information improvement for human interpretation.
Cancer Metastases Classification in Histological Whole Slide Images
Video object segmentation and its salient motion detection using adaptive background generation Kim, T.K.; Im, J.H.; Paik, J.K.;  Electronics Letters 
Author : Sang Hwa Lee, Junyeong Choi, and Jong-Il Park
Automatic Video Shot Detection from MPEG Bit Stream
IMAGE SEGMENTATION USING THRESHOLDING
Ji-Yean Yoon,1, Dong-Jin Kim1, Yu-Doo Kim1 and Il-Young Moon1,
Grid with Anti-Islanding Method
Dongwook Lee1,Jinsul Kim2, Minsoo Hahn1
Seunghui Cha1, Wookhyun Kim1
Fast Preprocessing for Robust Face Sketch Synthesis
YangSun Lee*, YunSik Son**
Aziz Nasridinov and Young-Ho Park*
Il-Kyoung Kwon1, Sang-Yong Lee2
Kil-Hun Lee1,*, Moon-Seok Jun1, Hyeon-Hong Kim2,
Estimation of 3D Bounding Box for Image Object
Efficient Image Classification on Vertically Decomposed Data
Dingding Liu* Yingen Xiong† Linda Shapiro* Kari Pulli†
Higher School of Economics , Moscow, 2016
Presented by :- Vishal Vijayshankar Mishra
Image processing and computer vision
Speaker: YI-JIA HUANG Date: 2011/12/08 Authors: C. N
Higher School of Economics , Moscow, 2016
Presentation transcript:

Design of Augmented Object Compositing System based on Diminished Reality Donghyun Kim 1, Kwang Hyun Jang 2, Seoksoo Kim * 1,* Dept of Multimeida Engineering, Hannam University, Daejeon, South Korea 2 E-gonggam Co., Ltd, Convergence Technology Production Center 602/3, ETRI, 218, Kajun- gro, Youseong-go, Daejeon, Korea Abstract. Recently broadcasting service providers are supplying the various broadcasting environments through virtual studio that uses small-scaled blue screen. However now that such services decreases the immersion of the users and cannot present the reality of broadcasting service. Therefore, in this paper, the improved augmented object synthesis system structure that uses the object removal technique that maximizes the reality was designed and suggested so that reduction of reality and immersion due to restriction of space and absence of contents. Keywords: Augmented Reality, Image Compositing, Diminished Reality 1 Introduction If watches the existing real-time internet broadcasting services, they have the problem that the immersion of service users decreases because the broadcasting is produced in the narrow space. Thus, broadcasting service providers are supplying the various broadcasting environments through virtual studio that uses small-scaled blue screen[1]. However, now that such services provide various broadcasting environments only through background image and cannot provide the suitable contents for the broadcast- ing, it decreases the immersion of the users and cannot present the reality of broad- casting service. Therefore, in this paper, the improved augmented object synthesis system structure that uses the object removal technique that maximizes the reality was designed and suggested so that reduction of reality and immersion due to restriction of space and absence of contents can be solved regarding operation of private internet broadcasting by providing various broadcasting environments through chroma-key and synthesizing various contents to the images through marker-based augmented reality technique and removing marker provided to synthesis of image from the image. * Corresponding author SoftTech 2013, ASTL Vol. 19, pp , © SERSC 2013

Proceedings, The 2nd International Conference on Software Technology 2 Design of Augmented Object Compositing System based on Diminished Reality Fig 1 shows a diagram of design of augmented object compositing system based on diminished reality Fig. 1. Diagram of design of augmented object compositing system based on diminished reality 2.1 Maker Detection Module Image Preprocessing. In order to detect the marker in the input screen, the im-age should be binarization. So, in this paper, the image is binarization using threshold selection method of Otsu[2] that binarization the image by performing bimodal distri- bution on frequency histogram Marker Recognition. 1 st marker candidate region is set by performing labeling work in the binarization image. After that, 2 nd marker candidate region is set by turning over the set the image of candidate region and re-implementing labeling work Marker Detection. After selecting one point among the detected facial shape information by detecting outline information using edge tracing algorithm[3] in mark-er candidate region, the corner point located at furthest distance from the point is extracted according to Pythagorean theorem. After that, the furthest corner point located from the extracted two corner points is extracted. After extracting three corner points, the remaining one point is extracted through Rect area expression. In order to match the marker in the set marker candidate region, the marker is detected by applying template matching[4] techniqueMaker Area Remove Module Image Completion. The region of the detected marker is removed by applying image completion technology that operates in the order like following figure to the input image. Marker region detected in the image that marker is detected is designated as the image completion region and the image is classified into the outline of image completion region and sample region for completing image. After that, the patch that has the highest priority is detected by considering reliability of patch center point and 28

Design of Augmented Object Compositing System based on Diminished Reality the structure inside of patch among the patches take the dot on outline as the center. If finds the patch whose priority is highest, the patch that is most similar to the se-lected patch from sample image is detect. Image completion region is filled by copying the similar patch. The image is completed by repeating a serious of process as above Color Calibration. If projects the image that applies image completion technol- ogy, the problem that all colors of object removal region of input image and object removal region point of result image are arranged happens. Therefore, the image that calibrates the color is produced by using radiometric compensation[5] method that is one of color calibration technologies. 2.2 Object Composition Module Color Channel Conversion. RGB color has the problem that it is weak for light-ing when synthesizing the image. So, in this paper, image in RGB color space that performs image completion work is converted to the image in HSV color space using the following expression. The range of ultramarine blue color is set in H channel that expresses the color that separates background area in ultramarine blue from the image of converted HSV channel Image Composition. The simplest way of separating background area from fore- ground area is to define the color of actionless background in single color in color space and designate the values included in the range as background area and the area other than the designated range as the foreground area[7]. The range of ultramarine blue color is defined as the threshold for binarization in order to separate foreground area from background area and the foreground area is separated from background area by binarization the image by threshold selection method of Otsu[4] and turning over the binarization image. The information of HSV channel space for background area of the dualized image is converted into the information of RGBA color space and alpha channel information of the converted RGBA color space is analyzed. After completing alpha channel anal-ysis of background area, alpha channel information of RGBA color of background image to be converted space is analyzed and synthesized with the image Augmented Objects. The distance between the marker in the image and camera and change of pose is estimated by using calibration technique that initializes the size of article that exists at specific distance from camera and the coordinates of 4 corner point of the detected marker is regularized into the coordinates system in virtual space. The article on the screen in virtual space is created and provided by implement-ing projection transform on the regularized coordinates system into screen coordinates systems of screen. Proceedings, The 2nd International2390 Conference on Software Technology

3 Conclusion In this paper, the problem of low reality and immersion of the users who use the im-ages produced through private broadcasting station-based virtual studio that uses the existing chroma-key was solved. It gave the users the immersion by applying aug-mented reality that utilizes that and chroma-key technique and augmenting 3D object in virtual space and the improved object synthesis system structure that applies dimin-ished reality that the users can feel reality more by removing the marker in the image output through image completion technique. It is judged that the speed of detecting the marker can be improved through the re-search that improves the processing speed of marker and it is expected that the im-proved system can be established by connecting it with augmented reality system accordingly. Acknowledgment This research was supported by the MKE(The Ministry of Knowledge Economy), Korea, under IT/SW Creative research program supervised by the NIPA(National IT Industry Promotion Agency). (NIPA-2012-ITAH ) References 1.Thomas, G.: Mixed reality techniques for TV and their application for on-set and pre- visualization in film production. International Workshop on Mixed Reality Technology for Filmmaking, pp (2006) 2.Hima Bindu, Ch., Satya Prasad, K.: An Efficient Medical Image Segmentation Using Con- ventional OTSU Method, International Journal of Advanced Science and Technology, Vol. 38, pp (2012) 3.Kim, D., So, Y., Kim, S.: Study of Marker Array List Method for Augmented Reality Ser-vice Based Smart Home, International Journal of Smart Home, Vol. 5, No. 4, pp (2011) 4.Sharanabasappa, R., Sanjaypande, M.B.: A Unique Document Security Technique using Face Biometric Template, International Journal of Advanced Science and Technology, Vol. 50, pp (2013) 5.Sun, J., Yuan, L., Jia, J., Shum, H.Y.: Image Completion with Structure Propagation. ACM Transactions on Graphics, Vol. 24. No. 3, pp (2005). 6.Smith, A.R., Blinn, J.F.: Blue Screen Matting. In SIGGRAPH '96:Proceeding of the 23rd annual conference on Computer graphics, pp (1996) 7.Agata, H., Yamashita, A., Kaneko, T.: Chroma Key using a Checker Pattern Background. IEICE TRANSACTIONS on Information and Systems, Vol. 90, No. 1, pp (2007)