Smartphone Touchless Screen ELG 5121 / CSI 7163A Multimedia Communications Smartphone Touchless Screen Prepared by: Abdelmounaim Dahbi

Outline Introduction Objective Background Orientation Based Touchless Screen Magnetic Field Based Touchless Screen Challenges Conclusion Future Research

Introduction Smartphone vs Average Cell phone Calling vs Email, Internet, Digital Camera, Navigation Possibilities Smartphones Have a Mobile Operating System, Full Qwerty Keyboard (Hardware or Software), Synchronize with email server, view and sometimes edit documents.. Windows Mobile, iPhone OS, Google’s Android, Symbian OS, RIM’s BlackBerry, Palm’s WebOS, Linux IBM designed the first smartphone in 1992 (Simon) Motorola demonstrated the first cell phone, 19 years before the first smartphone, in 1973.

Smartphone Market Penetration Introduction Smartphone Market Penetration

Objective

Background 800% 50% Worldwide Smartphone Sales to End Users by Operating System in 1Q10 (Thousands of Units), according to Gartner

Background 2010 Q3: 43.6% Android Platform.. Share of 2010 Q2 smartphone sales to end users by operating system, according to Gartner

Background Android Mobile operating system developed by Android Inc; Based upon a modified version of the Linux kernel; A corresponding open-source project led by Google; Android has been available under a free software / open source license since 21 October 2008; Google published the entire source code under an Apache License (vendors can add proprietary extensions without submitting those back to the open source community ). No industry player can control or restrict innovations

Orientation Based Touchless Screen Idea

Orientation Based Touchless Screen Approach Android Orientation System: - Origin in bottom left - z = Azimuth, rotation around the Z axis (0<=azimuth<360) - x = Pitch, rotation around X axis (-180<=pitch<=180) y = Roll, rotation around Y axis (-90<=roll<=90) All angles are in degrees.

Orientation Based Touchless Screen

Magnetic Field Based Touchless Screen Idea Earth Magnetic Field

Magnetic Field Based Touchless Screen Idea

Magnetic Field Based Touchless Screen Idea

Magnetic Field Based Touchless Screen Idea

Magnetic Field Based Touchless Screen Idea

Magnetic Field Based Touchless Screen Approach Android Magnetic Field System: - Origin in bottom left All values are in micro-Tesla (uT) and measure the ambient magnetic field in the X, Y and Z axis

Challenges The magnetic field might affect the compass hardware The magnetic field might have an effect on the storage memory of the smartphone The app works better when the magnetic field is clearer (long enough magnet) Paradoxes: magnet vs smartphone…

Conclusion Two Android apps have been developed to implement the two proposed touchless screen ideas Orientation based Touchless Screen Magnetic Field based Touchless Screen The two apps have been loaded into a real smartphone (HTC Legend) and work fine. The effect of gravity and the effect of wind…

Future Work Scrolling of the object (Window, List, Grid…) which has the focus; Find a way to make the app work with a very small magnet... Other Alternatives of touchless Screen (Bluetooth: More accurate than the magnet, Voice Recognition, Gesture Recognition)

Thank you!