Generation of Virtual Image from Multiple View Point Image Database Haruki Kawanaka, Nobuaki Sado and Yuji Iwahori Nagoya Institute of Technology, Japan.

Slides:



Advertisements
Similar presentations
Development of a system to reproduce the drainage from Tsujun Bridge for environment education Hikari Takehara Kumamoto National College of Technology.
Advertisements

More on single-view geometry
Advanced Image Processing Student Seminar: Lipreading Method using color extraction method and eigenspace technique ( Yasuyuki Nakata and Moritoshi Ando.
EigenFaces and EigenPatches Useful model of variation in a region –Region must be fixed shape (eg rectangle) Developed for face recognition Generalised.
Motion Capture The process of recording movement and translating that movement onto a digital model Games Fast Animation Movies Bio Medical Analysis VR.
Virtual Me. Motion Capture (mocap) Motion capture is the process of simulating actual movement in a computer generated environment The capture subject.
Introduction Games have always been a fundamental part of human life. Space storm “ عاصفة الفضاء” is a 3D SCI-FI game that consists of two stages presented.
QR Code Recognition Based On Image Processing
Principal Component Analysis Based on L1-Norm Maximization Nojun Kwak IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008.
3D Graphics Rendering and Terrain Modeling
Person Re-Identification Application for Android
Computer vision: models, learning and inference
Mapping: Scaling Rotation Translation Warp
Virtual Dart: An Augmented Reality Game on Mobile Device Supervisor: Professor Michael R. Lyu Prepared by: Lai Chung Sum Siu Ho Tung.
Principal Component Analysis CMPUT 466/551 Nilanjan Ray.
ICIP 2000, Vancouver, Canada IVML, ECE, NTUA Face Detection: Is it only for Face Recognition?  A few years earlier  Face Detection Face Recognition 
Recognition of Traffic Lights in Live Video Streams on Mobile Devices
Exchanging Faces in Images SIGGRAPH ’04 Blanz V., Scherbaum K., Vetter T., Seidel HP. Speaker: Alvin Date: 21 July 2004.
Detecting Image Region Duplication Using SIFT Features March 16, ICASSP 2010 Dallas, TX Xunyu Pan and Siwei Lyu Computer Science Department University.
Computing motion between images
3D Hand Pose Estimation by Finding Appearance-Based Matches in a Large Database of Training Views
Distinctive Image Feature from Scale-Invariant KeyPoints
Texture Synthesis on Surfaces Paper by Greg Turk Presentation by Jon Super.
Cindy Song Sharena Paripatyadar. Use vision for HCI Determine steps necessary to incorporate vision in HCI applications Examine concerns & implications.
FACE RECOGNITION, EXPERIMENTS WITH RANDOM PROJECTION
MULTIPLE MOVING OBJECTS TRACKING FOR VIDEO SURVEILLANCE SYSTEMS.
Automatic Camera Calibration for Image Sequences of a Football Match Flávio Szenberg (PUC-Rio) Paulo Cezar P. Carvalho (IMPA) Marcelo Gattass (PUC-Rio)
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
1 Probabilistic Formulation for Skin Detection Sanun Srisuk Seminar I.
Video Trails: Representing and Visualizing Structure in Video Sequences Vikrant Kobla David Doermann Christos Faloutsos.
I mage and M edia U nderstanding L aboratory for Performance Evaluation of Vision-based Real-time Motion Capture Naoto Date, Hiromasa Yoshimoto, Daisaku.
University of Texas at Austin CS 378 – Game Technology Don Fussell CS 378: Computer Game Technology Beyond Meshes Spring 2012.
Group-1 Group members- Sadbodh sharma-y07uc101 Kapil Phatnani-y08uc065.
Face Recognition Using Neural Networks Presented By: Hadis Mohseni Leila Taghavi Atefeh Mirsafian.
EE392J Final Project, March 20, Multiple Camera Object Tracking Helmy Eltoukhy and Khaled Salama.
1 Activity and Motion Detection in Videos Longin Jan Latecki and Roland Miezianko, Temple University Dragoljub Pokrajac, Delaware State University Dover,
SVD(Singular Value Decomposition) and Its Applications
Introduction --Classification Shape ContourRegion Structural Syntactic Graph Tree Model-driven Data-driven Perimeter Compactness Eccentricity.
AdvisorStudent Dr. Jia Li Shaojun Liu Dept. of Computer Science and Engineering, Oakland University 3D Shape Classification Using Conformal Mapping In.
Flow Based Action Recognition Papers to discuss: The Representation and Recognition of Action Using Temporal Templates (Bobbick & Davis 2001) Recognizing.
Shape Recognition and Pose Estimation for Mobile Augmented Reality Author : N. Hagbi, J. El-Sana, O. Bergig, and M. Billinghurst Date : Speaker.
Prepared By: Menna Hamza Mohamed Mohamed Hesham Fadl Mona Abdel Mageed El-Koussy Yasmine Shaker Abdel Hameed Supervised By: Dr. Magda Fayek.
Multimodal Interaction Dr. Mike Spann
1/20 Obtaining Shape from Scanning Electron Microscope Using Hopfield Neural Network Yuji Iwahori 1, Haruki Kawanaka 1, Shinji Fukui 2 and Kenji Funahashi.
Hand Gesture Recognition System for HCI and Sign Language Interfaces Cem Keskin Ayşe Naz Erkan Furkan Kıraç Özge Güler Lale Akarun.
BACKGROUND LEARNING AND LETTER DETECTION USING TEXTURE WITH PRINCIPAL COMPONENT ANALYSIS (PCA) CIS 601 PROJECT SUMIT BASU FALL 2004.
MESA LAB Multi-view image stitching Guimei Zhang MESA LAB MESA (Mechatronics, Embedded Systems and Automation) LAB School of Engineering, University of.
Does the Quality of the Computer Graphics Matter When Judging Distances in Visually Immersive Environments? Authors: Thompson, Creem-Regehr, et al. Presenter:
1 Recognition by Appearance Appearance-based recognition is a competing paradigm to features and alignment. No features are extracted! Images are represented.
A 3D Model Alignment and Retrieval System Ding-Yun Chen and Ming Ouhyoung.
Data Extraction using Image Similarity CIS 601 Image Processing Ajay Kumar Yadav.
Multimedia System and Networking UTD Slide- 1 University of Texas at Dallas B. Prabhakaran Rigging.
1 Perception and VR MONT 104S, Fall 2008 Lecture 21 More Graphics for VR.
Realtime NPR Toon and Pencil Shading Joel Jorgensen May 4, 2010.
CVPR2013 Poster Detecting and Naming Actors in Movies using Generative Appearance Models.
112/5/ :54 Graphics II Image Based Rendering Session 11.
Review on Graphics Basics. Outline Polygon rendering pipeline Affine transformations Projective transformations Lighting and shading From vertices to.
Interactive Mirror System based on Personal Purchase Information Donghyun Kim 1, Younsam Chae 2, Jonghun Shin 2, Uyeol Baek 2, Seoksoo Kim * 1,* Dept of.
Image-Based Rendering Geometry and light interaction may be difficult and expensive to model –Think of how hard radiosity is –Imagine the complexity of.
Image features and properties. Image content representation The simplest representation of an image pattern is to list image pixels, one after the other.
ENTERFACE 08 Project 9 “ Tracking-dependent and interactive video projection ” Mid-term presentation August 19th, 2008.
11/25/03 3D Model Acquisition by Tracking 2D Wireframes Presenter: Jing Han Shiau M. Brown, T. Drummond and R. Cipolla Department of Engineering University.
A Plane-Based Approach to Mondrian Stereo Matching
3D Puppetry: A Kinect-based Interface for 3D Animation
Recognition: Face Recognition
Machine Vision Acquisition of image data, followed by the processing and interpretation of these data by computer for some useful application like inspection,
Presented by :- Vishal Vijayshankar Mishra
Brief Review of Recognition + Context
Principal Component Analysis
SIFT.
Presentation transcript:

Generation of Virtual Image from Multiple View Point Image Database Haruki Kawanaka, Nobuaki Sado and Yuji Iwahori Nagoya Institute of Technology, Japan ・

Background The soccer playing game has become popular in Japan since the World Cup Soccer of Japan and South Korea cosponsorship was held in It is desired to see the game from various view points. –setting cameras at the reverse side of the goal –at the ceiling to view down. –many cameras are set at various locations –a camera has the function of pan−tilt−zoom But, these are not free viewpoints. ・ ・

Previous method to generate a virtual image large scale environment with many camera settings and installations –It takes much cost. –the application is restricted at only that stadium. using a few cameras and a motion capture –at only the indoor space –the special wear and several markers It is difficult to use in actual games. ・・ ・ ・ ・ ・・ ・

Present approach The labels of the back number are generated as the virtual image. The pose of each player is not considered. ・・

Study Purpose generate a virtual image at another view point –from a real image –without the special environment ・・

Proposed Method The appropriate pose image of each player is determined from using multiple viewpoint image database of a player’s CG model. Each pose image is synthesized at the position to the virtual scene. The position of each player is assumed to be provided by the trajectory system.

Trajectory Recording System We have developed Trajectory Recording System. Trajectory of two players ・・・・・

Flow of Proposed Method 1.Creation of database by CG model 2.Generation of virtual image for each player from image database I.Recognize the pose of a player II.Generate the corresponding virtual image from another view point 3.Synthesis of another view point image ・

Creation of database by CG model ~ Images for Database ~ Image Database (Human model) is created by CG. –Various motions ( run, walk, shot, pass, heading, trap etc ) 280 poses –From 8 view direction (rotation with every 45°) –total 2240 images ・ ・・

Creation of database by CG model ~ Processing of Each Image ~ CG Image of human model Silhouette To eliminate of many factors such as the condition of light source, skin color, hair and uniform… –It is necessary to save the data size and the search time of the image database. Image database is created using the silhouette. –This depends on the difference of pose but does not depend on such factor of each player. ・ ・

Creation of database by CG model ~ Processing of Each Image ~ N N Normalize the image size [ ・・・ ] N×N 1-dimensional data The image size for each pose is normalize. –The rectangle region which surrounds the silhouette of each pose, is extracted. –The extracted region just touches to the square with keeping its aspect ratio. By the raster scan, one dimensional expansion of the normalized image is made. ・

Creation of database by CG model ~ Principal Component Analysis ~ Set of image data (all poses & all view) eigen values, eigen vectors Covariance matrix Compress & Projection onto eigen space If the sum of eigen values becomes over 90% effective Image data [ ・・・ ] [ ・・・ ] [ ・・・ ] ・ ・ ・ ・ ・ ・

Generation of virtual image for each player ~ Recognize the pose of a player(1) ~ Detection of player N N [ ・・・ ] by eigen vector Normarize Projection onto eigen space 1-D Each silhouette is normalized, changed to one dimensional vector and projected to a point in the eigen space. ・ ・・

Generation of virtual image for each player ~ Recognize the pose of a player(2) ~ Eigen Space Result of search minimum distance e1e1 e3e3 e2e2 CG image Real image A B When A is given, B is selected as the most similar sample. The pose of image A is recognized as B. given image ・・ ・

Generation of virtual image ~ Generate the corresponding virtual image from another view point ~ Coordinates are acquired from trajectory recording system Virtual stadium created using the OpenGL + Another view image is made from result of search according to view point & view direction of virtual image. + Generated virtual scene (x, y) ・ ・ ・ ・

OriginalSilhouetteSearchedSimilarity : s 90.0% 87.1% 94.0% Experiments Actual original image Virtual image from the same view direction as original The experiment of pose recognition ・ ・・・ ・・

Experiments Original image Virtual image from different view point Player’s position is fixed. Viewpoint is moved. Texture is used as soccer field. It is also possible to generate an animation of movie by connecting each frame image sequentially. ・ ・

Conclusion A new approach to generate a virtual image from another view point is proposed. –Multi-image database to apply the eigen space method for the pose recognition. –This approach is simple but generates the reasonable virtual scene. ・ ・ ・

Future Works It is difficult to discriminate the absolute pose of each player. It is also difficult t o treat the overlapped case in which two or more players cross. Investigation of more effective matching approach is required to reduce the cost of time and memory. ・