Project # 8 - Internet of Hospital Things (IoHT): Communicating to Facilitate Healing REU student: Stefanie Mutter Graduate mentors: Myungho Lee, Kangsoo Kim Faculty mentor(s): Dr. Gerd Bruder, Dr. Greg Welch Week 4 (June 4 – June 9, 2018) Accomplishments: Got NID so was able to create iRIS account and modify existing IRB Formatted lab by moving furniture, etc for performing the experiment (diagram on slide 2) Created 3 characters using Adobe Fuse & Mixamo (Female1, GN1, Male1 on slide 3) Refined protocol for experiment Problem & Solutions: Need to acquire hospital bed to put in experiment environment Not sure how to use LipSyncPro to animate characters’ faces (talking, expressions, etc) Gender neutral character looks kind of young Had to work off-campus for most of week Plans for next week: Learn how to animate/rig characters’ faces Code the characters’ animations in Unity so they can complete tasks w/ the click of a button Hopefully get in contact w/ UCF College of Nursing to borrow hospital bed Hi everyone, it’s Stef, I look a little different today…… just kidding. So, I’m currently having wisdom teeth surgery but the grind never stops so here’s my presentation for this week. We finally got our NID’s, so I was able to create an iRIS account in order to modify our project’s IRB proposal. While my mentors were away this week, I formatted the HuSIS (the lab in which the experiment is going to be performed) by moving furniture and bringing in “props” so the environment can resemble that of a hospital room. ***go to second slide*** I also created 3 different characters ***go to next slide***, a Female, a Male, and a Gender Neutral, to use in the experiment. I did this by using the beta version of Adobe Fuse and Mixamo, which is an online rigging and animation software that works with Fuse. Additionally, I refined the protocol for the experiment, which includes dialogue with the participants as well as dictating what commands the participants are going to give the virtual agents. Some problems I encountered this week: I need to somehow get a hospital bed to put in the HuSIS for the participants to sit in. They’re too expensive to buy, so next week we’re going to try to get authorization to borrow one from the UCF college of Nursing. I’m running into issues animating the characters’ faces in Unity using LipSync Lite, so I’m going to try to acquire LipSyncPro, which has built in phoneme capabilities for animation. Additionally, as you saw in the pictures, the Gender neutral character looks kind of young – like the Male/Female’s teenage son instead of a gender neutral character. So, next week, I’m going to try to fix that. And obviously, I had to work off-campus for most of the week so that created some challenges. Next week, I’m going to learn how to animate the characters’ faces with LipSyncPro and Unity, so that they can speak naturally. Additionally, I’m going to code the characters’ animations, such as walking, in Unity so they can complete the tasks that participants ask them to complete with just a mere push of a button. Thanks! NSF REU Research Experience on Internet of Things 2018

Lab setup for experiment Project # 8 - Internet of Hospital Things (IoHT): Communicating to Facilitate Healing REU student: Stefanie Mutter Graduate mentors: Myungho Lee, Kangsoo Kim Faculty mentor(s): Dr. Gerd Bruder, Dr. Greg Welch Lab setup for experiment NSF REU Research Experience on Internet of Things 2018

Project # 8 - Internet of Hospital Things (IoHT): Communicating to Facilitate Healing REU student: Stefanie Mutter Graduate mentors: Myungho Lee, Kangsoo Kim Faculty mentor(s): Dr. Gerd Bruder, Dr. Greg Welch Female1 GN1 Male1 NSF REU Research Experience on Internet of Things 2018