Mousing Around… Michael Feldman, MD, PhD

Goal Is there a better UI than mouse for WSI ?

Microscope Retain ergonomics of microscope –Small motions that move mountains of data Other hand is useful… –Focusing –Changing magnification Fast –400 slides per day in 10 hr day Eyes on diagnosis field

Challenge WSI systems today ≠ microscope Limitations to full clinical use WSI –Total system throughput too slow –One component is UI –Validation image quality –Workflow challenges –IT integration –Storage –Streaming pixels

Multitouch screen… DLP display Interface - Frustrated Total Internal Reflection (FTIR) Software –Aperio image library –Interface code (C++) –Tracking code (C++)

Multi-touch Technology Users can directly interact with objects through touch and simple gestures. Gestures can be used to pan and scale an image. This creates a highly intuitive and interactive image environment.

Image Libraries Multi-touch Application Framework Tracking ComponentApplication Component (x1,y1) (x2,y2) (x3,y3) (X,Y) (L,W) (Zoom) Interface Component

Testing Create basic platform Test (not rigorous) –Image quality –UI How does it feel Ergonomics Simple Gestures: Pan, zoom, tap box, locate small, load work Show movies

Results Image quality – biggest limitation DLP –At inches, DLP is too low resolution UI – a lot to like –Using both your hands feels “correct” –Gestures easy to get used to –Sensitivity not there yet in our models –No haptic feedback –No variable ratio viewing yet

Next Steps Other touch interfaces –One or two touch pads (conductive technology) –Gaming haptics Display –Look into HD DLP but likely still not adequte –One or two large LCD’s Software –More gestures will be needed –Variable ratio movement –More fluid touch sensitivity

Team Drexel –Dr. Youngmoo E. Kim –Matthew Prockup Aperio –Ole Eichorn Pathologists –Mike Feldman – Penn –Alex Judkins – CHOP