CDVS on mobile GPUs MPEG 112 Warsaw, July 2015

2 Our Challenge CDVS on mobile GPUs  Compute CDVS descriptor from a stream video continuously  Make pairwise matching between an entire database and the frame just acquired Is it possible with an embedded system?

3 CDVS on mobile GPUs Feature Extraction in real time  CDVS Extraction from an image takes about two seconds on embedded systems such as smartphones or tablets  If we want to acquire information from a video stream this timing is inadequate  We need to use specific hardware Solution: GPU

4 CDVS on mobile GPUs CPU vs GPU GPUs have thousands of cores to process parallel workloads efficiently

5 CDVS on mobile GPUs GPU Programming Languages  Open Computing Language  It contains the API to operate with the GPU  Very similar to CUDA language

6 MPEG CDVS Extraction pipeline CDVS on mobile GPUs Keypoint detection Image Feature selection Local descriptor compression Coordinate coding Local descriptors Global descriptor aggregation Global descriptor Local descriptor computation These three steps are implemented on GPU

7 CDVS on mobile GPUs TIM EYER  CDVS extraction using GPU hardware  Small database inside the smartphone  Pairwise matching operation between frame video and image stored into database

Thank You