1. An automated input peripheral multiplexor for computing systems Jon Bright Dan Quintas Matt Spencer Steven Shropshire ECE 4007 Section L03 Project Advisor - David Anderson April 27, 2010

2.  What – Automatically switches keyboard, mouse between computers  Why – Eliminates redundancy; alleviates clutter; improves ergonomics/productivity

3.  How – Processes digital video stream to determine user’s orientation  Who – Consumers with multiple computers; industries with complex workspaces  Cost – Smart Switch prototype: $81,885

4. Proposed GoalActual Outcome Switch two computersMet Platform independentMet Demonstrate on two peopleMet Operable for range of lighting conditionsMet Allows head movementMet Real time; Maximum delay of 600msNot Met

7. Swann Infra-Red Camera TMS320DM6437 Video Processing Board Belkin KVM Switch Input: keyboard, mouse Output: computers Instruction signal Video Feed

8. Video In Optional Video Out Power K/M Out K/M In DSP Board KVM Switch

9. Front : PS/2 Keyboard and Mouse In Back : PS/2 Keyboard and Mouse Out to PCs

10.  Digital image processing algorithm  Video processing board  Processes video in real time  Determine computer head faces  Output active computer

11. Camera generates video feed KVM Switch routes keyboard, mouse Algorithm determines active computer User faces the monitor Active computer Input from keyboard and mouse Inactive computer

12. Needs 1. Detect face 2. Determine direction 3. Work in real time

13.  Proposed by Paul Viola and Michael Jones  Compare adjacent rectangles to learn patterns  FFD uses a graphical representation

17. Wait for Frame Get Frame, Run FFD Algorithm Do nothing Right/Left Count++ Switch Yes Do Nothing Center Count > N? Error

18.  N based on duration of algorithm ◦ 70ms a frame  Probability of error ◦ 1 st error 1/10 ◦ 2 nd error 1/15  For N = 5, probability of incorrect switch insignificant.

19.  1. Detect face? YES!  2. Determine direction? YES!  3.Works in real time? YES! ◦ 70ms per frame ◦ 8.5 frames in 600ms ◦ N = 5

20.  Actual algorithm -13ms out of 70ms  Room for ◦ Robustness ◦ Up/down ◦ 3 screen positions  Double the size -> 83ms, 7 frames in 600ms

21.  Switch two computers – KVM Switch  Platform Independent – No Software Installation  Demonstrate on two people – Steven and Dan  Range of lighting conditions – Van Leer classrooms  Head Movement – Algorithm  Real Time – Not met due to KVM Latency

22.  Underestimated KVM latency  Roughly 1-second delay  USB vs. PS/2 interface  Build KM Switch  All other components real time

23.  High – Low Instruction Signal  Output Options ◦ Serial Port ◦ JTAG ◦ Audio Out ◦ Expansion Connector  Selected Expansion Connector Option

24.  Left computer unresponsive to mouse  Possible loose wire connections  KVM failure

26. HOURS / EngineerCOST EQUIPMENT DSP Board $495 KVM Switch $100 Camera $250 Power Supply $20 Cabling $20 LABOR Algorithm Design 250$30,000 Algorithm Implementation 150$18,000 KVM Firmware Design 200$24,000 Package Assembly 75$9,000 TOTAL EQUIPMENT $885 TOTAL LABOR (x 4 Engineers) 675$81,000 ADVERTISING AND MARKETING $30,000 SMART SWITCH TOTAL $111,885

27.  Faster KVM/KM Switch  Improve algorithm  System configurability  Smaller form factor  Upgrade to USB interfaces