1. Mixing the Real and the Virtual in a Hospital through Telepresence Kevin Smith kevin.smith@sindex.ca

2. Mixing the Real and the Virtual! Can we mix virtual people with real people? Can we mix real people with virtual people?

3. It has already been done!

4. Simulation & Training using Telepresence Benefits: –Clinicians and other professionals with heavy demands on their time can participate in a simulation from anywhere in the hospital (or outside it) –Training can take place anywhere eg a simulation can be run in a patient’s room immediately after a real patient is discharged from that room

5. Is it possible? Light Field capture and display –Perceptually the same as an optical wavefront –Based on Integral Photography invented by Lippmann in 1908! Acoustic Wave Field capture and generation

6. What’s a Lightfield?

7. Stanford Multi-Camera Array

8. Data Rate 128 cameras each operating at 30 fps 640 x 480 8 bit pixels Total data rate of over 9 Gbps http://graphics.stanford.edu/papers/CameraArray/

9. Holografika’s HoloVizio

10. QinetiQ’s Autostereo 3D Display Wall

11. Everyone can see the same point

12. Autostereoscopic Displays Available Today QinetiQ http://www.qinetiq.com/home/technologies/technologies/optronics/pad/hpv/3d.html Holografika http://www.holografika.com/markets/ts640rc.shtml Deep Light http://www.deeplight.com/products_displays_designer.html

13. MIT LOUD

14. Data Rate 1020 microphones each sampling at 16 KHz 24 bits per sample Total data rate of 393 Mbps http://cag.csail.mit.edu/mic-array/

15. IOSONO: Wavefield Generation Wave Field Generation –Large array of speakers – uses Huygens’ Principle http://www.idmt.fraunhofer.de/eng/research_topics/wave_field_synthesis.htm

18. MERL: 3D TV Lightfield capture and display 16 cameras at 30 fps 1300 x 1030 pixels, 24 bits Total data rate is over 14 Gbps http://www.merl.com/projects/3dtv/

19. Technology Requirements At least Tbps data connections as standard! At least 100 fold increase in embedded computing power

23. Telepresence in a Hospital Already being used eg CSIRO’s ViCCU –http://www.ict.csiro.au/page.php?did=16http://www.ict.csiro.au/page.php?did=16 InTouch’s RP-7 System –http://www.intouch-health.com/products-RP7.html#virtualhttp://www.intouch-health.com/products-RP7.html#virtual

24. Telepresence in a Hospital In the future, hospitals can be built where all walls are two way lightfields so that a person or an object can be projected in “full” 3D into any room of a hospital and, conversely, any patient can be imaged and viewed in “full” 3D –http://www.camfpd.com/future.htmhttp://www.camfpd.com/future.htm

25. Examples of the Operational Use of Telepresence in a Hospital Specialists can attend a “code blue” as well as the crash team Nursing staff can respond through telepresence to a patient’s “call button” and assess whether have to go physically A patient can be triaged in an ambulance by a trauma specialist