Mixing the Real and the Virtual in a Hospital through Telepresence Kevin Smith

Mixing the Real and the Virtual! Can we mix virtual people with real people? Can we mix real people with virtual people?

It has already been done!

Simulation & Training using Telepresence Benefits: –Clinicians and other professionals with heavy demands on their time can participate in a simulation from anywhere in the hospital (or outside it) –Training can take place anywhere eg a simulation can be run in a patient’s room immediately after a real patient is discharged from that room

Is it possible? Light Field capture and display –Perceptually the same as an optical wavefront –Based on Integral Photography invented by Lippmann in 1908! Acoustic Wave Field capture and generation

What’s a Lightfield?

Stanford Multi-Camera Array

Data Rate 128 cameras each operating at 30 fps 640 x bit pixels Total data rate of over 9 Gbps

Holografika’s HoloVizio

QinetiQ’s Autostereo 3D Display Wall

Everyone can see the same point

Autostereoscopic Displays Available Today QinetiQ Holografika Deep Light

MIT LOUD

Data Rate 1020 microphones each sampling at 16 KHz 24 bits per sample Total data rate of 393 Mbps

IOSONO: Wavefield Generation Wave Field Generation –Large array of speakers – uses Huygens’ Principle

MERL: 3D TV Lightfield capture and display 16 cameras at 30 fps 1300 x 1030 pixels, 24 bits Total data rate is over 14 Gbps

Technology Requirements At least Tbps data connections as standard! At least 100 fold increase in embedded computing power

Telepresence in a Hospital Already being used eg CSIRO’s ViCCU – InTouch’s RP-7 System –

Telepresence in a Hospital In the future, hospitals can be built where all walls are two way lightfields so that a person or an object can be projected in “full” 3D into any room of a hospital and, conversely, any patient can be imaged and viewed in “full” 3D –

Examples of the Operational Use of Telepresence in a Hospital Specialists can attend a “code blue” as well as the crash team Nursing staff can respond through telepresence to a patient’s “call button” and assess whether have to go physically A patient can be triaged in an ambulance by a trauma specialist