Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng.

Slides:



Advertisements
Similar presentations
Distinctive Image Features from Scale-Invariant Keypoints
Advertisements

Distinctive Image Features from Scale-Invariant Keypoints David Lowe.
A Natural Interactive Game By Zak Wilson. Background This project was my second year group project at University and I have chosen it to present as it.
Content-Based Image Retrieval
Large-Scale Image Retrieval From Your Sketches Daniel Brooks 1,Loren Lin 2,Yijuan Lu 1 1 Department of Computer Science, Texas State University, TX, USA.
Low Complexity Keypoint Recognition and Pose Estimation Vincent Lepetit.
Mapping: Scaling Rotation Translation Warp
Large-Scale, Real-World Face Recognition in Movie Trailers Week 2-3 Alan Wright (Facial Recog. pictures taken from Enrique Gortez)
Watching Unlabeled Video Helps Learn New Human Actions from Very Few Labeled Snapshots Chao-Yeh Chen and Kristen Grauman University of Texas at Austin.
Virtual Dart: An Augmented Reality Game on Mobile Device Supervisor: Professor Michael R. Lyu Prepared by: Lai Chung Sum Siu Ho Tung.
LYU0603 A Generic Real-Time Facial Expression Modelling System Supervisor: Prof. Michael R. Lyu Group Member: Cheung Ka Shun ( ) Wong Chi Kin ( )
OpenCV Stacy O’Malley CS-590 Summer, What is OpenCV? Open source library of functions relating to computer vision. Cross-platform (Linux, OS X,
Real-time Combined 2D+3D Active Appearance Models Jing Xiao, Simon Baker,Iain Matthew, and Takeo Kanade CVPR 2004 Presented by Pat Chan 23/11/2004.
Background S.A.U.V.I.M. Semi - Autonomous Underwater Vehicle for
USER VERIFICATION SYSTEM. Scope Web Interface RGB separation Pervasive.
Target Online Software J. Leaver 01/12/ /06/2015Imperial College 2 Target Controller Software Software for Stage 1 upgrade nearing completion –Hardware.
Lecture 6 Sept 15, 09 Goals: two-dimensional arrays matrix operations circuit analysis using Matlab image processing – simple examples.
Eye Tracking Project Project Supervisor: Ido Cohen By: Gilad Ambar
Smart Traveller with Visual Translator for OCR and Face Recognition LYU0203 FYP.
Web-based Control Interface For a model train control system By: Kevin Sendra.
Real-Time Face Detection and Tracking Using Multiple Cameras RIT Computer Engineering Senior Design Project John RuppertJustin HnatowJared Holsopple This.
MACHINE VISION GROUP Head-tracking virtual 3-D display for mobile devices Miguel Bordallo López*, Jari Hannuksela*, Olli Silvén* and Lixin Fan**, * University.
Vision-Based Biometric Authentication System by Padraic o hIarnain Final Year Project Presentation.
Augmented Reality and 3D modelling Done by Stafford Joemat Supervised by Mr James Connan and Mr Mehrdad Ghaziasgar.
Knowledge Systems Lab JN 8/24/2015 A Method for Temporal Hand Gesture Recognition Joshua R. New Knowledge Systems Laboratory Jacksonville State University.
Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015.
Computer vision.
Internet-scale Imagery for Graphics and Vision James Hays cs195g Computational Photography Brown University, Spring 2010.
Knowledge Systems Lab JN 9/10/2002 Computer Vision: Gesture Recognition from Images Joshua R. New Knowledge Systems Laboratory Jacksonville State University.
Multimedia Specification Design and Production 2013 / Semester 2 / week 8 Lecturer: Dr. Nikos Gazepidis
Image Collection Backend for Cameraphones. Introduction Project Goals Design an integrated system to upload image from a mobile phone to a remote server.
Intruder Alert System By: Jordan Tymburski Rachita Bhatia.
WEBCAS (WEBCAM BASED CLASSROOM ATTENDANCE SYSTEM)
Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng Shantanu Ghosh,
Students: Anurag Anjaria, Charles Hansen, Jin Bai, Mai Kanchanabal Professors: Dr. Edward J. Delp, Dr. Yung-Hsiang Lu CAM 2 Continuous Analysis of Many.
Live Demo Augmented reality – lets see some pictures flying…Augmented reality – lets see some pictures flying… Facebook -Facebook -
Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng.
IBM QBIC: Query by Image and Video Content Jianping Fan Department of Computer Science University of North Carolina at Charlotte Charlotte, NC 28223
REAL TIME FACE DETECTION
Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng.
Yingcai Xiao Chapter 10 Image Processing. Outline Motivation DWA: a real world example Algorithms Code examples.
Theia Technical Design Presentation 3. Theia Overview Theia’s purpose is to create three dimensional, virtual representations of a room. To allow the.
Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng Shantanu Ghosh,
Kylie Gorman WEEK 1-2 REVIEW. CONVERTING AN IMAGE FROM RGB TO HSV AND DISPLAY CHANNELS.
Delivering Business Value through IT Face feature detection using Java and OpenCV 1.
Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng.
Knowledge Systems Lab JN 1/15/2016 Facilitating User Interaction with Complex Systems via Hand Gesture Recognition MCIS Department Knowledge Systems Laboratory.
Markerless Augmented Reality Platform Design and Verification of Tracking Technologies Author:J.M. Zhong Date: Speaker:Sian-Lin Hong.
Scale Invariant Feature Transform (SIFT)
Final Year Project. Project Title Kalman Tracking For Image Processing Applications.
MACHINE VISION GROUP MOBILE FEATURE-CLOUD PANORAMA CONSTRUCTION FOR IMAGE RECOGNITION APPLICATIONS Miguel Bordallo, Jari Hannuksela, Olli silvén Machine.
Augmented Reality and 3D modelling Done by Stafford Joemat Supervised by Mr James Connan.
Quiz Week 8 Topical. Topical Quiz (Section 2) What is the difference between Computer Vision and Computer Graphics What is the difference between Computer.
Stereoscopic Imaging for Slow-Moving Autonomous Vehicle By: Alex Norton Advisor: Dr. Huggins February 28, 2012 Senior Project Progress Report Bradley University.
IBM - CVUT Student Research Projects IBM Presence detection Milan Stezka
Frank Bergschneider February 21, 2014 Presented to National Instruments.
VR software and platform Dr. Nan WANG Dr. Ronan BOULIC EPFL Immersive Interaction Group.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching.
Computer Photography -Scene Fixed 陳立奇.
CSCI 631 – Foundations of Computer Vision March 15, 2016 Ashwini Imran Image Stitching Link: singhashwini.mesinghashwini.me.
Identify internal hardware devices (e. g
Copyright ©2008, Thomson Engineering, a division of Thomson Learning Ltd.
Rotoscoping Senior Capstone Project | Ted Trisco
Recognition of biological cells – development
Scale Invariant Feature Transform (SIFT)
Cheng-Ming Huang, Wen-Hung Liao Department of Computer Science
Mixed Reality Server under Robot Operating System
Research Institute for Future Media Computing
S Carbini, O. Bernier, J.E. Viallet,
February 16th, 2004 Class Meeting 5
Presentation transcript:

Real-Time Cyber Physical Systems Application on MobilityFirst Winlab Summer Internship 2015 Karthikeyan Ganesan, Wuyang Zhang, Zihong Zheng

PRELIMINARY GOAL OF OUR PROJECT WINLAB SUMMER2015 MobilityFirst Virtual Network Client side: Run an instance of camera system; Transmits video in standard format; Simple graphical interface to display results Server side: Implement server application for object recognition; Return the result CPS Application based on MF

OUTLINE OF THE PROGRESS WINLAB SUMMER2015 SERVER CLIENT Database Image Process COORD Network COORD Network Camera Display General One

How Object Detection Algorithms Work WINLAB SUMMER2015 Feature Detection  Identifying Points of Interests within Image(Edges,Corners,Blobs,etc.)  Like a Partial differential of Image gradient  SURF uses a modification of the “Determinant of Hessian” method Feature Extraction  Translate the pixel information to a reduced representation  Extract a Descriptor or 'Features Vector' containing relevant information to perform required tasks  Multiple diverse schemes available. Most prominent are SURF, ORB, FREAK.

Image Match Find Descriptors Match Descriptors FOR THE BEST PPT GET MORE WINLAB SUMMER2015

Image Match Descriptor:64 Demensions Vector Image: n×64 vectors Matrix [d00 d01 d02…………d63 d64 d10 d11 d12…………d163 d164. dn0 dn1 dn2……….dn63 dn64] Image WINLAB SUMMER2015

Image Match Find Descriptors Surf Pixel -> Hessian Matrix -> Determinant ->feature value Build Scale Space -> Compare feature val -> locate descriptor Scale: proportional ratio of a linear dimension of the model to the same feature of the original. Calculate Sum of Harr Wavelet -> Direction of descriptor WINLAB SUMMER2015

Image Match Match Descriptors Source ImageDatabase Image Descriptor Index Mapped Image Index n WINLAB SUMMER2015

Image Match Achievement Match Image from Database of 100 images Within 2159ms WINLAB SUMMER2015

NEW WEBCAM ARRIVED! WINLAB SUMMER2015 Transmit format: mjpeg FPS: 10/seconds Resolution: >=640*480 Up to 1080p(1920*1080) Protocol: TCP Camera Model: Logitech HD C920

CAMERA PART WINLAB SUMMER2015 Two Plans: 1.Continue using MJPG-streamer + QT or GTK 2.Switch to use OpenCV library directly to construct a basic version application MJPG-streamer: a command line application that copied JPG-frame from a single input plugin to multiple output plugin OpenCV(Open Source Computer Vision): a library of programming functions mainly aimed at real-time computer vision QT: framework mainly for developing application software with graphical user interfaces GTK: a cross-platform widget toolkit for creating graphical user interfaces

DEMO WINLAB SUMMER2015 It is just a local version. The whole application is still developing, especially the Displaying and the Application Protocol part.

Next Week Plan WINLAB SUMMER2015 Finish the basic version client side application base on OpenCV Migrate the Image processing program to Linux platform, also try to add more features to it Do the essential combination between client and server side

Question WINLAB SUMMER2015