1. 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Unity Windows Holographic Tuning and Intro to Mixed Reality
5/5/2018 1:12 AM
B8069
Unity Windows Holographic Tuning and Intro to Mixed Reality
Mark Schoennagel
Sr. Evangelist, Unity Technologies
@Unity3dMarkS
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. Who has used one of these?
5/5/2018 1:12 AM
Who has used one of these?
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. How about one of these? 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. Who here has used Unity? 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. 5/5/2018 1:12 AM
Let’s take a look!
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Special thanks to Zero Mass Energy “Center of Gravity”
5/5/2018 1:12 AM
Special thanks to Zero Mass Energy “Center of Gravity”
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8. Full Support for Windows Mixed Reality!
5/5/2018 1:12 AM
Full Support for Windows Mixed Reality!
Announced at Unity Vision Summit
In-Editor support for all Windows 10 AR and MR devices
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. Windows Phone Windows Desktop 5/5/2018 1:12 AM Windows Store
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

10. 91% of all HoloLens titles made with Unity
5/5/2018 1:12 AM
91% of all HoloLens titles made with Unity
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11. Solving Hard Problems! 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

12. What does Unity provide to Microsoft MR
5/5/2018 1:12 AM
What does Unity provide to Microsoft MR
APIs to control all aspects of AR/MR development
High and low level components
Complete end-to-end build platform
Final output to UWP, Universal Windows Platform
Direct connect to Visual Studio, Community Edition 2017.now included in all Unity versions
The “camera” in Unity is literally your head!
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

13. What APIs are available for AR/MR
5/5/2018 1:12 AM
What APIs are available for AR/MR
Gaze
Gesture
Voice
Spatial Mapping
Spatial Sound
Map Persistence
World Coordinates
Web Camera Support
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14. Gaze Input void Update() { RaycastHit hitInfo; if (Physics.Raycast(
5/5/2018 1:12 AM
Gaze Input
void Update() {
RaycastHit hitInfo;
if (Physics.Raycast(
Camera.main.transform.position,
Camera.main.transform.forward,
out hitInfo,
20.0f,
Physics.DefaultRaycastLayers))
// If the Raycast has succeeded and hit a hologram
// hitInfo's point represents the position being gazed at
// hitInfo's collider GameObject represents the hologram being gazed at }
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. Gesture Input void Start () {
5/5/2018 1:12 AM
Gesture Input
void Start () {
//Just need to create it once, so we use the Start
recognizer = new GestureRecognizer();
//Specify the gestures we want to capture
recognizer.SetRecognizableGestures(GestureSettings.Tap);
//Start capturing gestures and subscribe to the event
recognizer.TappedEvent += TapEventHandler;
recognizer.StartCapturingGestures(); }
private void TapEventHandler(TappedEventArgs obj)
//Switch the animation state
GetComponent<Animator>().SetTrigger("Walk");
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16. Voice Input void Start() { keywords.Add(“Run", () => {
5/5/2018 1:12 AM
Voice Input
void Start() {
keywords.Add(“Run", () => {
GetComponent<Animator>().SetTrigger("Stop");
});
keywordRecognizer = new KeywordRecognizer(keywords.Keys.ToArray());
// Register a callback for the KeywordRecognizer and start recognizing!
keywordRecognizer.OnPhraseRecognized += KeywordRecognizer_OnPhraseRecognized;
keywordRecognizer.Start(); }
private void KeywordRecognizer_OnPhraseRecognized(PhraseRecognizedEventArgs args)
System.Action keywordAction;
if (keywords.TryGetValue(args.text, out keywordAction))
keywordAction.Invoke(); }
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

17. 5/5/2018 1:12 AM
Spatial Sound
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18. Spatial Mapping Real-time mapping of environment
5/5/2018 1:12 AM
Spatial Mapping
Real-time mapping of environment
Full support for physics interactions
Continuously enhancing the space
Fine tune LOD, Visualize or Occlude
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. The new hardware, Welcome to Mixed Reality
5/5/2018 1:12 AM
The new hardware, Welcome to Mixed Reality
Easy Setup, no extra software to install
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. 5/5/2018 1:12 AM
System Requirements
Low system requirements, integrated graphics will work.
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. Quick tour of the hardware
5/5/2018 1:12 AM
Quick tour of the hardware
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. Quick tour of the hardware
5/5/2018 1:12 AM
Quick tour of the hardware
Inside-out tracking sensor array
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

23. Guardian system Inside-out makes this much easier. MR.
5/5/2018 1:12 AM
Guardian system
Inside-out makes this much easier. MR.
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

24. Back to the demo! “ADAM” 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

25. More nerdy stuff… Use Single Pass Instancing in Build Settings
5/5/2018 1:12 AM
More nerdy stuff…
Use Single Pass Instancing in Build Settings
~35% CPU performance increase
User setting for Unity pauses during loss of tracking, Helps reduce nausea
Target D3D in Build Settings
Gamma color space only!
Lots of other custom build settings
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

26. Enable Developer Mode Required for remoting 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

27. Controllers Plumbing for controller input similar to Rift / Vive
5/5/2018 1:12 AM
Controllers
Plumbing for controller input similar to Rift / Vive
New, common controller toolkit coming
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

28. Active Latent Frame Setting
API only, predicts where the head is going
Introduces 1 frame of latency
Trade off additional latency for improved more stable performance
Easier to achieve 60 FPS
For AR the difference is not very perceivable so a practical option 
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

29. Focus Point API Changes focus point to reduce jitter.
5/5/2018 1:12 AM
Focus Point API
Changes focus point to reduce jitter.
API is used to set the plane where re-projection is best. 
Objects far in either direction will have greater jitter. 
App developers can override default 2 Meter plane to work best with their app.
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

30. Now back to Unity! 360 Enhanced Video
5/5/2018 1:12 AM
Now back to Unity! 360 Enhanced Video
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

31. 5/5/2018 1:12 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.