Presentation is loading. Please wait.

Presentation is loading. Please wait.

> Replacing the computer mouse September 15 th, Boston Accessibility Conference (http://a11y-bos.org/); Microsoft NERD Center.http://a11y-bos.org/

Published byCharlene Cunningham Modified over 9 years ago

Similar presentations

Presentation on theme: "> Replacing the computer mouse September 15 th, Boston Accessibility Conference (http://a11y-bos.org/); Microsoft NERD Center.http://a11y-bos.org/"— Presentation transcript:

1 > Replacing the computer mouse September 15 th, 2012 @2012 Boston Accessibility Conference (http://a11y-bos.org/); Microsoft NERD Center.http://a11y-bos.org/ Franck.Dernoncourt@gmail.com http://francky.me

2 2012-09-15Franck Dernoncourt - http://francky.me2Franck Dernoncourt2 0) Foreword

3 2012-09-15Franck Dernoncourt - http://francky.me3Franck Dernoncourt3 0) Foreword Hands-free paintings!

4 2012-09-15Franck Dernoncourt - http://francky.me4Franck Dernoncourt4 0) Foreword Video http://youtu.be/fIcGJCUAMJg http://youtu.be/fIcGJCUAMJg

5 2012-09-15Franck Dernoncourt - http://francky.me5Franck Dernoncourt5 0) Foreword

6 2012-09-15Franck Dernoncourt - http://francky.me6Franck Dernoncourt6 0) Foreword The first mouse prototype was created in 1963 by Douglas Engelbart at the Stanford Research Institute… almost 50-year-old!

7 2012-09-15Franck Dernoncourt - http://francky.me7 Table of Contents 1.Introduction 2.Moving the mouse cursor 3.Emulating the mouse click 4.Getting rid of the keyboard as well 5.Conclusion & perspectives

8 2012-09-15Franck Dernoncourt - http://francky.me8Franck Dernoncourt8 1) Introduction Important drawbacks Loss of productivity: constantly switching between the mouse and the keyboard. Health issues: RSI (repetitive stress injuries).

9 2012-09-15Franck Dernoncourt - http://francky.me9Franck Dernoncourt9 1) Introduction Adhesive Capsulitis (Frozen Shoulder), Bursitis, Carpal Tunnel Syndrome, Cramp of the Hand (Writers’ Cramp), Cubital Tunnel Syndrome, De Quervain’s Syndrome, Dupuytren’s Contracture, Epicondylitis (tennis / golfer’s elbow), Ganglion Cyst, Peritendinitis, Rotator Cuff Syndrome, Tendinitis, Tenosynovitis, Trigger Finger / Thumb, Vibration-induced White Finger…

10 2012-09-15Franck Dernoncourt - http://francky.me10Franck Dernoncourt10 1) Introduction Adhesive Capsulitis (Frozen Shoulder), Bursitis, Carpal Tunnel Syndrome, Cramp of the Hand (Writers’ Cramp), Cubital Tunnel Syndrome, De Quervain’s Syndrome, Dupuytren’s Contracture, Epicondylitis (tennis / golfer’s elbow), Ganglion Cyst, Peritendinitis, Rotator Cuff Syndrome, Tendinitis, Tenosynovitis, Trigger Finger / Thumb, Vibration-induced White Finger… RSI! 15-25% of all computer users worldwide are estimated to have RSI. A survey of 500 software professionals at Hyderabad in 2000 revealed that over 50% had symptoms of established RSI. Billions of dollars are spent worldwide annually as a consequence of RSI

11 2012-09-15Franck Dernoncourt - http://francky.me11Franck Dernoncourt11 1) Introduction Chronic pain may cost U.S... $635 billion a year !! Source: http://medicalxpress.com/news/2012-09-chronic-pain-billion-year.html

12 2012-09-15Franck Dernoncourt - http://francky.me12Franck Dernoncourt12 1) Introduction Important drawbacks Loss of productivity: constantly switching between the mouse and the keyboard. Health issues: RSI (repetitive stress injuries).

13 2012-09-15Franck Dernoncourt - http://francky.me13Franck Dernoncourt13 1) Introduction Important drawbacks Loss of productivity: constantly switching between the mouse and the keyboard. Health issues: RSI (repetitive stress injuries). Unnatural user interface.

14 2012-09-15Franck Dernoncourt - http://francky.me14Franck Dernoncourt14 1) Introduction We do not aim at replacing the mouse as a pointing device but simply the mouse as a piece of hardware. We therefore stay in the mouse paradigm and focus on the hardware interface. The computer mouse allows two kinds of action: moving the mouse cursor, sending mouse clicks.

15 2012-09-15Franck Dernoncourt - http://francky.me15Franck Dernoncourt15 1) AI > definitions Hands-free mice are numerous: Camera based head tracking systems: SmartNav, Tracker Pro, FreeTrack, HeadMouse Extreme and HeadMaster, Mouth-operated joystick types: the TetraMouse, the QuadJoy, the Jouse2, the IntegraMouse, Footmice: BiLiPro, Flip Flop Mouse, Footime Foot ControlledMouse, Brain-computer interaction: the Emotiv EPOC neuroheadset, the NeuroSky MindSet/MindWave, Eye tracking.

16 2012-09-15Franck Dernoncourt - http://francky.me16 Table of Contents 1.Introduction 2.Moving the mouse cursor 3.Emulating the mouse click 4.Getting rid of the keyboard as well 5.Conclusion & perspectives

17 2012-09-15Franck Dernoncourt - http://francky.me17Franck Dernoncourt17 2) Moving the mouse cursor Footmice might cause stress on the feet or the legs and takes a while to get precise with them. Still worth the try as it is inexpensive and one can get impressively accurate with one’s feet. Footime® Foot Mouse (150 USD)

18 2012-09-15Franck Dernoncourt - http://francky.me18Franck Dernoncourt18 2) Moving the mouse cursor Eye tracking: either pretty bad or expensive (5,000 USD), and don’t support multiscreen configuration. EyeTech (> 4,500 USD) BUT this is might be the future: basic webcam + open source software (e.g. ITU GazeGroup).

19 2012-09-15Franck Dernoncourt - http://francky.me19Franck Dernoncourt19 2) Moving the mouse cursor

20 2012-09-15Franck Dernoncourt - http://francky.me20Franck Dernoncourt20 2) Moving the mouse cursor

21 2012-09-15Franck Dernoncourt - http://francky.me21Franck Dernoncourt21 2) Moving the mouse cursor Among the camera based head tracking systems, SmartNav is the cheapest (300-400 USD). As its precision is as good as the one of a computer mouse, there is no need to invest into the Tracker Pro, FreeTrack, HeadMouse Extreme or HeadMaster (over 1,000 USD).

22 2012-09-15Franck Dernoncourt - http://francky.me22Franck Dernoncourt22 2) Moving the mouse cursor The mouse-operated joysticks are pretty intrusive since one has to put them in the mouth, but this solution is interesting for people who can't move their head or have severe pain in the neck. The TetraMouse is the cheapest by far.

23 2012-09-15Franck Dernoncourt - http://francky.me23Franck Dernoncourt23 2) Moving the mouse cursor Brain computer interaction are so far mostly useless to move the mouse cursor. Note that the Emotiv EPOC neuroheadset contains a gyroscope (=device for measuring or maintaining orientation), thanks to which the user can move the mouse cursor as precisely as a computer mouse. Emotiv EPOC neuroheadset (300 USD)

24 2012-09-15Franck Dernoncourt - http://francky.me24 Table of Contents 1.Introduction 2.Moving the mouse cursor 3.Emulating the mouse click 4.Getting rid of the keyboard as well 5.Conclusion & perspectives

25 2012-09-15Franck Dernoncourt - http://francky.me25Franck Dernoncourt25 3) Emulating the mouse click Hotkeys: re-map keys from the keyboard and assign them to emulate the left, right and middle mouse buttons.

26 2012-09-15Franck Dernoncourt - http://francky.me26Franck Dernoncourt26 3) Emulating the mouse click Dwell clicking software: when the cursor stops moving for a pre-determined amount of time (usually around 1 second), the dwell clicking software will initiate a mouse click. The user can have the software send left clicks, right clicks or double clicks. SmartNav's dwell clicking software (free)

27 2012-09-15Franck Dernoncourt - http://francky.me27Franck Dernoncourt27 3) Emulating the mouse click Footswitches: allow the user to send mouse clicks by pushing a pedal. !! Beware of repetitive strain injuries at the ankles.

28 2012-09-15Franck Dernoncourt - http://francky.me28Franck Dernoncourt28 3) Emulating the mouse click Sip-and-puff: send signals to a device using air pressure by "sipping" (inhaling) or "puffing" (exhaling) on a straw, tube or "wand."

29 2012-09-15Franck Dernoncourt - http://francky.me29Franck Dernoncourt29 3) Emulating the mouse click Speech recognition: set a few voice commands that the user can say to emulate mouse clicks.

30 2012-09-15Franck Dernoncourt - http://francky.me30Franck Dernoncourt30 3) Emulating the mouse click Facial expression recognition: maps facial expressions such as eye blink, wink or smile to mouse clicks. EyeTech (> 4,500 USD)

31 2012-09-15Franck Dernoncourt - http://francky.me31Franck Dernoncourt31 3) Emulating the mouse click Facial expression recognition: maps facial expressions such as eye blink, wink or smile to mouse clicks. NeuroSky MindWave (100 USD) Emotiv EPOC neuroheadset (300 USD)

32 2012-09-15Franck Dernoncourt - http://francky.me32Franck Dernoncourt32 3) Emulating the mouse click Brain-computer interaction: maps concepts to mouse clicks. When the user thinks of one concept, a mouse click is sent. NeuroSky MindWave (100 USD) Emotiv EPOC neuroheadset (300 USD)

33 2012-09-15Franck Dernoncourt - http://francky.me33Franck Dernoncourt33 3) Emulating the mouse click Headset comfortability

34 2012-09-15Franck Dernoncourt - http://francky.me34 3) Emulating the mouse click SolutionProsCons HotkeysFree, easy to use, no latency Requires to use the keyboard, not so good for RSI (much better than mouse clicks though) Dwell clicking Free, easy to use, no latency, hands-free Requires to wait ~1s before click is sent, takes some time (~1s) to switch between mouse click type Speech recognition Easy to use, already integrated within Dragon NaturallySpeaking High latency, put some strain on the voice, noisy Facial expression Hands-free Quite expensive (100-300USD), detection is not 100% accurate, headsets are not comfortable Brain-computer interaction Hands-free Latency, quite expensive (100-300USD), not accurate enough to emulate mouse clicks, headsets are not comfortable Synopsis

35 2012-09-15Franck Dernoncourt - http://francky.me35Franck Dernoncourt35 3) Emulating the mouse click My current configuration: Dwell clicking + hotkeys + speech recognition

36 2012-09-15Franck Dernoncourt - http://francky.me36Franck Dernoncourt36 3) Emulating the mouse click Next test (hopefully in a few days): MaKey MaKey!

37 2012-09-15Franck Dernoncourt - http://francky.me37 Table of Contents 1.Introduction 2.Moving the mouse cursor 3.Emulating the mouse click 4.Getting rid of the keyboard as well 5.Conclusion & perspectives

38 2012-09-15Franck Dernoncourt - http://francky.me38 4) Getting rid of the keyboard as well

39 2012-09-15Franck Dernoncourt - http://francky.me39 4) Getting rid of the keyboard as well

40 2012-09-15Franck Dernoncourt - http://francky.me40 4) Getting rid of the keyboard as well The average rate for transcription is 33 words per minute, and 19 words per minute for composition. An average professional typist types usually in speeds of 50 to 80 words per minute. More statistics on http://en.wikipedia.org/wiki/Words_per_minutehttp://en.wikipedia.org/wiki/Words_per_minute

41 2012-09-15Franck Dernoncourt - http://francky.me41 4) Getting rid of the keyboard as well The average rate for transcription is 33 words per minute, and 19 words per minute for composition. An average professional typist types usually in speeds of 50 to 80 words per minute. More statistics on http://en.wikipedia.org/wiki/Words_per_minutehttp://en.wikipedia.org/wiki/Words_per_minute Using speech recognition, one can easily achieve over 100 words per minute with more than 95% accuracy.

42 2012-09-15Franck Dernoncourt - http://francky.me42 4) Getting rid of the keyboard as well Many voice commands are available, such as any shortcut (e.g. copy paste), typing a predefined text, switching windows, browsing the web, sending e-mail and launching programs. Custom commands can also be easily defined:

43 2012-09-15Franck Dernoncourt - http://francky.me43Franck Dernoncourt43 4) Getting rid of the keyboard as well

44 2012-09-15Franck Dernoncourt - http://francky.me44Franck Dernoncourt44 4) Getting rid of the keyboard as well Work in progress!

45 2012-09-15Franck Dernoncourt - http://francky.me45Franck Dernoncourt45 4) Getting rid of the keyboard as well Subvocal recognition

46 2012-09-15Franck Dernoncourt - http://francky.me46Franck Dernoncourt46 4) Getting rid of the keyboard as well Throat microphones

47 2012-09-15Franck Dernoncourt - http://francky.me47 Table of Contents 1.Introduction 2.Moving the mouse cursor 3.Emulating the mouse click 4.Getting rid of the keyboard as well 5.Conclusion & perspectives

48 2012-09-15Franck Dernoncourt - http://francky.me48Franck Dernoncourt48 5) Conclusion & perspectives Conclusion: SmartNAV + Dwell clicking + hotkeys + speech recognition Speech recognition  Replace 95% of the use of the mouse and the keyboard.  More efficient, more comfortable.

49 2012-09-15Franck Dernoncourt - http://francky.me49Franck Dernoncourt49 5) Conclusion & perspectives

50 2012-09-15Franck Dernoncourt - http://francky.me50Franck Dernoncourt50 5) Conclusion & perspectives Conclusion: Natural user interfaces

51 2012-09-15Franck Dernoncourt - http://francky.me51Franck Dernoncourt51 5) Conclusion & perspectives Conclusion: Natural user interfaces Eye tracking Brain computer interfaces

52 2012-09-15Franck Dernoncourt - http://francky.me5220/05/2015Motion-induced blindness52 Questions ? franck.dernoncourt@gmail.com

Download ppt "> Replacing the computer mouse September 15 th, Boston Accessibility Conference (http://a11y-bos.org/); Microsoft NERD Center.http://a11y-bos.org/"

Similar presentations

PC HABITS AND YOUR HEALTH My Life Monday. While computers make our jobs easier, using them can take its toll on our bodies. More enjoyable computer usage.

PC HABITS AND YOUR HEALTH My Life Monday. While computers make our jobs easier, using them can take its toll on our bodies. More enjoyable computer usage.
A.Mani Kumari 07A21F0007.  Introduction  Definition  Working  Applications  Drawbacks  Conclusion.

A.Mani Kumari 07A21F0007.  Introduction  Definition  Working  Applications  Drawbacks  Conclusion.
Www.tekistore.com Ozupad Nov. 20091. A single device that with many features: Air-space mouse Optical mouse Air-space Joystick JOG Scrolling Pointing.

Ozupad Nov A single device that with many features: Air-space mouse Optical mouse Air-space Joystick JOG Scrolling Pointing.
DEVELOPING ICT SKILLS PART -TWO

DEVELOPING ICT SKILLS PART -TWO
Surjit Kaur Sandhu.  Ergonomics is the science of making things comfy by fitting the job to the worker, rather than expecting workers to accommodate.

Surjit Kaur Sandhu.  Ergonomics is the science of making things comfy by fitting the job to the worker, rather than expecting workers to accommodate.
Proper Keyboarding Techniques (Ergonomics)

Proper Keyboarding Techniques (Ergonomics)
Avoiding Repetitive-Stress Injuries: A Writer's Guide Author: Geoff Hart Presenter: Damon Hauser.

Avoiding Repetitive-Stress Injuries: A Writer's Guide Author: Geoff Hart Presenter: Damon Hauser.
OSU Environmental Health and Safety Office Ergonomics Adjusting Your Workstation to Fit Your Body.

OSU Environmental Health and Safety Office Ergonomics Adjusting Your Workstation to Fit Your Body.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
Ergonomics is the discipline that fits the workplace(like chair, table) and product(like computer, cell phone) to you Ergonomics relates to you in life.

Ergonomics is the discipline that fits the workplace(like chair, table) and product(like computer, cell phone) to you Ergonomics relates to you in life.
User Interface Development Human Interface Devices User Technology User Groups Accessibility.

User Interface Development Human Interface Devices User Technology User Groups Accessibility.
Avoiding Repetitive- Stress Injuries: A Guide for the Technical Communicator Article Written by Geoffrey J.S. Hart Presented By Alan Smith.

Avoiding Repetitive- Stress Injuries: A Guide for the Technical Communicator Article Written by Geoffrey J.S. Hart Presented By Alan Smith.
KEYBOARDS, MICE, AND OTHER INPUT DEVICES PRINCIPALS OF INFORMATION TECHNOLOGY.

KEYBOARDS, MICE, AND OTHER INPUT DEVICES PRINCIPALS OF INFORMATION TECHNOLOGY.
Lesson Objectives To understand that users with disabilities require different input and output devices To be able to identify these devices and explain.

Lesson Objectives To understand that users with disabilities require different input and output devices To be able to identify these devices and explain.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2005 by The McGraw-Hill Companies,

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2005 by The McGraw-Hill Companies,
 At the end of this class, students are able to  Describe definition of input devices clearly  List out the examples of input devices  Describe.

 At the end of this class, students are able to  Describe definition of input devices clearly  List out the examples of input devices  Describe.
Office Ergonomics Ergonomic Guidelines for Computer Users Frank Gonzales, CEES, CEAS.

Office Ergonomics Ergonomic Guidelines for Computer Users Frank Gonzales, CEES, CEAS.
Closing conference of SYSIASS – June 17 th 2014 Multimodal Bio-signal based Control of Intelligent Wheelchair Professor Huosheng Hu Leader of Activity.

Closing conference of SYSIASS – June 17 th 2014 Multimodal Bio-signal based Control of Intelligent Wheelchair Professor Huosheng Hu Leader of Activity.
Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,

Copyright © 2006 by The McGraw-Hill Companies, Inc. All rights reserved. McGraw-Hill Technology Education Copyright © 2006 by The McGraw-Hill Companies,
1 “ Speech ” EMPOWERED COMPUTING Greenfield Business Centre, 20 th September, 2006.

1 “ Speech ” EMPOWERED COMPUTING Greenfield Business Centre, 20 th September, 2006.

Similar presentations

Ads by Google