ChatArt Windows Phone App Windows 7 | Presenter Mode Friday, June 08, 2018 ChatArt Windows Phone App Tara Balakrishnan Microsoft Research Connections High School Intern Microsoft Confidential

About Me This summer I developed an app for WP7 that leverages the Project Hawaii Services Rising Senior at Redmond High School High School Intern at MSR Connections

Windows® 7 | Presenter Mode Friday, June 08, 2018 Goal: ChatArt: Users can interact through a pictographic messaging system. Capabilities: Manage groups Send pictures and text messages to a single friend or groups of friends RELAY SERVICE Connect users over the cloud WP7 WP7 Microsoft Confidential

Project Hawaii background information PURPOSE: Client+Cloud = MORE POWER Utilize the cloud’s computing power for the client device SERVICES: SPEECH TO TEXT OCR RELAY RENDEZVOUS RELAY: Send messages across the cloud RENDEZVOUS: Associate a device with a friendly name

Hawaii Relay & Rendezvous Services Each endpoint receives a unique identifier, which can be used to transmit and receive messages Provides a FIFO storage queue for each ID so that messages can be saved and retrieved at a later point in time. Allows a user to associate and look up a “friendly name” to the IDs used by the Relay service Register a friendly name, de- register, associate ID with a friendly name, disassociate, look up ID associated with a friendly name

ChatArt Features Communicate across multiple devices Send/Receive pictures and text messages Touch-based drawing capability Design an interactive user-interface Employ native storage for chat history

Communication

Drawing Interface

Application Architecture

Client-specific Architecture

User Interface Design Studies COMMENTS GUI is extremely intuitive Palette is effectively structured Application Bar allows appropriate user-control SUGGESTIONS Include detailed instructions for joining and creating new user groups: Improve the group page UI

Demo ChatArt: Windows Phone Application pictographic messaging system

Challenges WRITEABLEBITMAP Creating one from a UI Element THREADING Produce a smooth drawing experience TOMBSTONING Still needs to be implemented Convert the canvas into an Image Save the image as a WriteableBitmap Serialize the bitmap into a byte array Send across the Relay Service Create an image from the byte array Read a smooth motion from touch inputs Limit the number of asynchronous calls to prevent lagging Data is stored across several instances of the application Relay service queue isn’t cleared once the image is read

Future Investment Increase Usability Improve UI Enhance the ‘Join Group’ page Improve the user-experience Fully Employ the Hawaii Rendezvous Service Better group management Add a ‘Help Guide’ for new users Group Control Windows Phone Microsoft confidential.

Potential Applications Communication in Emerging Markets Help people, who are unable to read and write, communicate Memorable Communication HAVE FUN!! Sending and Creating pictures, and playing fun games Teaching Tool Communicate despite language barriers Learn the basics of an unfamiliar language

Questions? Thank You!