ScanShot : Detecting Document Capture Moments and Correcting Device Orientation Jeungmin Oh, Woohyeok Choi, Joohyun Kim, Uichin Lee (Dept. of Knowledge.

Slides:



Advertisements
Similar presentations
- Rohit Vobbilisetty. What is the Camera API Capture Photos Capture Videos Camera API - Android2.
Advertisements

Mobile phone based real time solution to track completed / in progress work The programme officer initiates the work by capturing the site image, GPS.
TouchDevelop Create apps ON your phone! Peli de Halleux (Senior Software Developer) Microsoft Research.
Windows XP / Microsoft Word Computer Applications.
Slide Ruler. ? X 5" On today’s menu...  What happened with Gravity  Noise  The tool today  Fundamental Limitations  Magical Christmas Land  (Where.
Tablet Computers Georgia 4- H Cotton Boll and Consumer Judging 2013.
Software to Manage EEP Vegetation Plot Data A design proposal Michael Lee January 31, 2011.
The Process of Multiplatform Development: An Example Robyn Taylor University of Alberta.
Click & Fix 10/20/10 James Cui Janam Jhaveri Paul Mongold.
Masters ProjectFall 2010Joe B. Taylor Pedestrian Navigation Using Mobile Devices Georeferencing Photographs of Publicly Posted Maps.
Tracking Gökhan Tekkaya Gürkan Vural Can Eroğul. Outline Tracking –Overview –Head Tracking –Eye Tracking –Finger/Hand Tracking Demos.
Tablet Computers Georgia 4- H Cotton Boll and Consumer Judging 2013.
Session 1.1. Windows Phone Topics Session 1.1 Windows Phone The Windows Phone Device.
Phone guide. Sensor Thermometer thermometer for measuring ambient temperature. However, there's a thermometer in pretty much any smartphone, and some.
Phone guide for people over 65. Not Smart Phones.
Building Sensor-based Apps Windows Phone Windows Store Windows Desktop
Wudi Zhou Dummy Arm Team 4. Project Overview An remote controlled robot arm with 6 degree of freedom. It is controlled by a control sleeve. Control sleeve.
TouchDevelop Create apps for all your devices
Click icon to add picture SmartSpaghetti: Accurate and Robust Tracking of Human's Location Mostafa Uddin, Ajay Gupta, Kurt Maly, and Tamer Nadeem.
Measuring Digital System Latency from Sensing to Actuation at Continuous 1 ms Resolution Weixin Wu, Yujie Dong, Adam Hoover Dept. Electrical and Computer.
TouchLogger: Inferring Keystrokes on Touch Screen from Smartphone Motion Liang Cai and Hao Chen UC Davis.
Muscle Volume Analysis 3D reconstruction allows for accurate volume calculation Provides methods for monitoring disease progression Measure muscle atrophy.
Protecting Mobile Users From Visual Privacy Attacks Mahmud Al-Noor Tareq Department of Computer Science and Engineering.
Robot sensors MVRT 2010 – 2011 season. Analog versus Digital Analog Goes from 0 to 254 Numerous values Similar to making waves because there are not sudden.
Towards real-time camera based logos detection Mathieu Delalandre Laboratory of Computer Science, RFAI group, Tours city, France Osaka Prefecture Partnership.
Troubleshooting Foundations of Technology Troubleshooting © 2013 International Technology and Engineering Educators Association, STEM  Center for Teaching.
Juan David Rios – Graduate Student ECE IMDL FALL 2012 Dr. A. Antonio Arroyo - Eric M. Schwartz November 29/2012.
WPH310. Free Phone! Windows Phone 7 as a Game Platform Free Tools to Build Great Games The Game Loop Input on Windows Phone 7 Building a Game with Your.
TE PICT. Programmer Gamer THE PROBLEM Today's Mobiles, More than mere a communication media.
App Inventor You are going to use App Inventor to make an application for your phone Smart Phone ‘s can hold many entertaining apps due to the amount of.
DIGITAL IMAGE PORTFOLIO DOUG TYSON 26 JUNE DIGITAL ARTWORK.
Hands-Free Camera Controller Jeffrey Gould. Overview Introduction –Background –Design Criteria Components Sensor Mapping Problems Demonstration Future.
Sensors in android. App being more applicable Keeping track of your heart beat while jogging. Pointing the phone camera towards the night sky to know.
CRS Helpdesk Software Presented By The Systems House Inc.
Virtual Image Peephole By Kyle Patience Supervisor: Reg Dodds Co Supervisor: Mehrdad Ghaziasgar.
Current Works Corrected unit conversions in code Found an error in calculating offset (to zero sensors) – Fixed error, but still not accurately integrating.
Error-Detecting and Error-Correcting Codes
Moto-Sheets. com Sports Timing Software and Jury Management Events Scoring / Event Management.
Evolution of Input. The Evolution of Typical Inputs Biased towards input devices used in gaming. There are too many input devices to include, such as.
1.Accelerometer:Accelerometer in an iPhone. Definition: An accelerometer is a sensor which measures the tilting motion and orientation of a mobile phone.
Sensors For Mobile Phones  Ambient Light Sensor  Proximity Sensor  GPS Receiver Sensor  Gyroscope Sensor  Barometer Sensor  Accelerometer Sensor.
Sensor Fusion Donald Heer 11/10/10. The Questions Can two things happen at the ‘same’ time? Can the same thing be observed ‘identically’ by two different.
Contents: 1. Introduction 2. Gyroscope specifications 3. Drift rate compensation 4. Orientation error correction 5. Results 6. Gyroscope and odometers.
App Inventor You are going to use App Inventor to make an application for your phone Smart Phone ‘s can hold many entertaining apps due to the amount of.
Basic iPod Operation. Welcome to iPod Touch Instead of a resistive touch screen that requires a stylus, the iPod touch has a capacitive touch screen*.
MOBILE SENSORS BY OLIVIA TUFFS-MOULDS. ACCELEROMETER An accelerometer is a device, hidden in the motherboard of a smartphone, is a sensor which detects.
Build Cycle 5.  Themes  US Presidents  Custom Images  Number of Moves Made  Posting to Facebook.
This sensors the brightness of your screen. It adjusts the display screens brightness automatically. When its dark it takes the brightness down and when.
Audio & Vibration MOBILE IS EVERYWHERE Problems: External stimuli & noise Seeing & hearing challenges Accessibility Solutions: Audio & Vibrations.
What Do Sensors Do in a Smartphone? For Seniors Zarrin Begum.
Make an information leaflet about what the sensors do in a Smart Phone for people over 65 years of age. You can use PowerPoint, Word or Publisher.
Understanding Mobile Devices, Interactions, and Tools Lesson 1.
Gestures and Device Motion. Introduction Everyone has their own way of picking up and putting down their device Holding and using the device can determine.
Chapter 4 Exposure F-stop, Shutter Speed and Other Things.
CHAPTER 8 Sensors and Camera. Chapter objectives: Understand Motion Sensors, Environmental Sensors and Positional Sensors Learn how to acquire measurement.
To add a new title to the current slide, select “Click to add title” and type. Once completed, save the presentation.
Chapter 8 Sensors and Camera. Figure 08.01: The Accelerometer can gauge the orientation of a stationary device.
Multiplication Timed Tests.
Smartphone sensors Gyroscope: The gyroscope is a sensor that can provide orientation information with great precision. Magnetometer: It is able to detect.
Robotic Calibration of Multi-Sensor Capture System
CS4101 Introduction to Embedded Systems Lab 11: Sensors
Responsive Framework.
Photos operating the Pocket Sensor
Android Topics Sensors Accelerometer and the Coordinate System
Android Sensor Programming
This presentation document has been prepared by Vault Intelligence Limited (“Vault") and is intended for off line demonstration, presentation and educational.
Dor Granat, Ran yeheskel ADvisor: matan sela
What can you tell me about this type of camera?
Warmup Chapter P Review
This presentation document has been prepared by Vault Intelligence Limited (“Vault") and is intended for off line demonstration, presentation and educational.
Presentation transcript:

ScanShot : Detecting Document Capture Moments and Correcting Device Orientation Jeungmin Oh, Woohyeok Choi, Joohyun Kim, Uichin Lee (Dept. of Knowledge Service Engineering, KAIST) 1

2 Document capturing using a smartphone camera becomes very common

Many apps support document capturing, however…

4 If we take a photo of document… Capturing a document

5 Occasionally, captured photos had with erroneous orientation Viewing a captured document

6 Portrait Upside Down Landscape RightLandscape Left Why do such orientation errors happen?

7

8 We ran photo taking experiment…

9 The error rate for landscape task exceeds 80%

10 Solution 1. Detect a document capture moment 2. Fix an orientation error by tracking rotation 3. Display an overlay indicator for manual correction

Acc-Z G 1. Detecting document capture moments 2. Fixing an orientation error by tracking rotation Accelerometer is used for detecting document capturing behavior 3. Displaying an overlay indicator for manual correction

Gyro-Z Gyroscope is used for tracking rotation to fix an orientation error 1. Detecting document capture moments 2. Fixing an orientation error by tracking rotation 3. Displaying an overlay indicator for manual correction

ScanShot successfully reduced erroneous orientations in the landscape document capturing task Detecting document capture moments 2. Fixing an orientation error by tracking rotation 3. Displaying an overlay indicator for manual correction

(a) overlay with incorrect orientation (b) overlay with correct orientation ScanShot displays overlay screen if needed 1. Detecting document capture moments 2. Fixing an orientation error by tracking rotation 3. Displaying an overlay indicator for manual correction

Q&A 15

Sensor data 16 Portrait, no rotation Landscape, rotation Portrait, no rotation Landscape, rotation AccelerometerGyroscope

CV-based approach 17

Grips for document capturing task External H/W 18

Variation of overlays 19 (a) overlay with correct orientation (b) overlay with incorrect orientation

Acc-Z Gyro-Z G