Brian Moynihan MBA | MSIS | MA XR + Healthcare Brian Moynihan MBA | MSIS | MA Head, Health Technology & Informatics Lynn Eades MLS Health Technology Librarian University Libraries - Health Sciences Library University of North Carolina at Chapel Hill

Applicable Technologies Virtual Reality – Primarily Virtual Experience Room-scale VR: HTC Vive, Oculus Rift, Playstation VR Standalone headsets: Oculus Go, Mirage Solo, (Vive Focus) Phone-based VR – Google Cardboard, Gear VR Augmented Reality – Virtual objects on top of real world Vuzix Smartglasses, Epson Moverio – heads-up display Software for existing devices: ARKit, ARCore, Snapchat, Sumerian (Example: Pokemon Go) Mixed Reality – Mixing virtual component with real objects and people Microsoft Hololens/Meta/Magic Leap – Virtual objects in 3D space Complementary Technologies 3D printing/Making – moving from bits to atoms and back 360-degree video cameras; Motion Capture Markers on paper, T-shirt, Merge Cube, Trackers Biometrics –heart rate, HRV, EEG, respiration, EDA, gaze, steps, etc.

XR Spectrum - variations Virtual reality – high end/medium/low end Augmented reality – marker-based, stickers, detecting planes/faces, phone or heads-up displays Mixed reality – VR + video pass-through, full mapping of physical space Tethered to external computer, headset + device, headset alone Inside out tracking vs. outside in Tracking head rotation only (3DoF) vs. tracking position in space (6DoF) No controller, 3DOF controller, 6DOF controller

A Range of Applications From phone to dome smartphone, headset, room, dome From high end to low end From creation to consumption From bits to atoms (and back again) making real objects virtual and virtual objects real, by linking to Maker initiatives Ties to every discipline at UNC Fine Arts & Humanities – Music, Dramatic Art, Classics, Religious Studies, Foreign Languages, Philosophy Social Sciences – Anthropology, Area Studies, Archeology, City & Regional Planning, Geography, History, Economics, Political Science, Sociology Natural Sciences – Chemistry, Physics, Math, Biology, Geology Health Sciences – Medicine, Nursing, Pharmacy, Dentistry, Public Health, Exercise Science, Social Work, Health Informatics, Biomedical Engineering Technology – Computer Science, Information Science Beyond: Education, Media & Journalism, Business, Government, Social work, Libraries, Morehead Planetarium Applications in Education / Research / Entrepreneurship / Training / Clinical Care

XR at UNC Interest Group for everyone: http://arvr.web.unc.edu/ Click button on site to join group Listserv, events CARVR student group Developing real-world projects XR Faculty Learning Community Monthly meetings focused on XR in the classroom and faculty research VR at UNC Libraries HTC Vive, workshops https://library.unc.edu/vr/ HSL: consultations, presentations, demos, eye tracking projects moynihan@med.unc.edu Wonda VR – Do-It-Yourself approach. Contact arvr@unc.edu to access campus license.

Varied uses of XR in Healthcare Psychology – relaxation (meditation), facing trauma (PTSD, fear of heights, flying, snakes, etc.), anxiety (public speaking, revealing HIV status), smoking cessation, eating disorders, autism (social cognition) Inpatient use - pain management, overcoming loneliness and depression, motivating movement, patient education Education – going impossible places (blood stream, molecular bonding, anatomy, etc.), empathy, telestration Physical training – athletics, fitness, physical rehabilitation, mental preparation Professional training – surgical planning and practice, practicing CPR and Heimlich maneuver, radiology, teaching soft skills, how to use devices, inventory mangement Rehabilitation - stroke, vision disorders, attention, balance, memory

Example: Surgical Uses of Augmented Reality Surgical preparation Telepresence – conferring with surgeons around the world during surgery. 3D models of distant specialists, heads-up displays Telestration – remote guidance by specialist for distant provider including inexpensive addition of gesture, pointing, drawing for remote Display of scans (CT, PET, MRI, FRMI, DTI) on live patient Used in collarbone surgery to see rotation, spinal surgery, plastic surgery

Examples of ARVR Healthcare Projects at UNC Augmented reality scavenger hunt – UNC Children’s Hospital VR for pain management – UNC Burn Center Immersive tour of Pediatric surgery for kids - Pediatric Anesthesiology VR study on stress for mothers facing addiction - Psychiatry An immersive oral history of death and dying – Health & Humanities Augmented reality surgery application – Pediatric Surgery + CS Studies on gait, balance, and falls – Biomedical Engineering Mapping the mouse’s brain in VR – Neuroscience Virtual patient – Pharmacy Simulation Lab

Contact moynihan@med.unc.edu | beades@med.unc.edu arvr@unc.edu http://arvr.web.unc.edu/ digitalhealth@unc.edu https://hsl.lib.unc.edu/digital-health