1. 11/28/2018 5:35 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

2. Application Compatibility in the real world
11/28/2018 5:35 AM
THR2086
Application Compatibility in the real world
Simon May, CEO, Apptimized Inc.
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

3. Who are we and why am I here?
Application packaging specialists
Founded 2003 in Potsdam, Germany as Revacom GMBH
Customers include PwC, AXA, Commerzbank, Burberry
Developed industry’s first (and only) cloud based packaging and testing solution
Pilot launched in partnership with Microsoft early September 2018
Leverage cloud-based testing solution to assess enterprise LOB applications against Windows desktop Insider Builds
Apptimized Maintain and Maintain Plus
Ongoing automated testing of enterprise line of business, customized, in-house (legacy) apps against desktop Insider builds
Give early warning to the customer of application compatibility issues
Give Windows team advanced insight into enterprise application compatibility issues
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

4. 11/28/2018 5:35 AM
Objective Originally…to generate empirical data to size the barrier represented by application compatibility currently preventing enterprise Windows 10 and Windows-as-a-Service adoption
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

5. 11/28/2018 5:35 AM
Objective Became…to understand the challenges in standing up a repeatable, scalable, and cost-effective line of business application testing capability
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

6. Barriers to enterprise Windows 10 adoption
11/28/2018 5:35 AM
Barriers to enterprise Windows 10 adoption
Source: Dimensional Research :Windows 10: The State of the Union – A Survey of Desktop Stakeholders in IT
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

7. Why is this important? Leverage new features
11/28/2018 5:35 AM
Why is this important? Leverage new features
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

8. Why is this important? Increased complexity
11/28/2018 5:35 AM
Why is this important? Increased complexity
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9. Apptimized Maintain: How does it work?
11/28/2018 5:35 AM
Apptimized Maintain: How does it work?
Identify in-scope applications (or add new applications)
Upload media
‘Record’ install and user-cases against current production build using Apptimized Echo
As Insider Builds are released, customized build images are created
Installs and user cases ‘replayed’
Issues identified and remediated
Windows Dev team notified
Enterprise can commence rollout immediately
Leverage the benefits of the Update as early as possible having identified and remediated any application issues
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

10. Apptimized Maintain: How does it work?
11/28/2018 5:35 AM
Apptimized Maintain: How does it work?
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

11. 11/28/2018 5:35 AM
Application Compatibility in the real world Testing applications successfully deployed to one Windows Update against a later Windows Update
212 Win 7 packages tested
- Win Build 10586
- Insider Build 17127
- Insider Build 17713
Real world packages created to customer standards using Microsoft best practices
Tested using Apptimized Echo
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

12. Summary test results – total tests
11/28/2018 5:35 AM
Summary test results – total tests
636 tests
22% pass rate
140 passes
496 fails
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

13. Summary test results – Win 10 (customized) v Win 7
11/28/2018 5:35 AM
Summary test results – Win 10 (customized) v Win 7
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

14. Way too many failures… Why?
11/28/2018 5:35 AM
Way too many failures… Why?
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

15. Reasons for app test failure – consolidated
11/28/2018 5:35 AM
Reasons for app test failure – consolidated
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

16. Conclusion One size testing won’t work
11/28/2018 5:35 AM
Conclusion One size testing won’t work
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

17. Vanilla Windows 10 vs Customized Windows 10
11/28/2018 5:35 AM
Vanilla Windows 10 vs Customized Windows 10
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

18. Vanilla Windows 10 vs Customized Windows 10 – why?
11/28/2018 5:35 AM
Vanilla Windows 10 vs Customized Windows 10 – why?
Policies - eg security, that prevent applications from interacting with the OS and other apps
Hardcoded paths - change standard directories so packages do not use Windows variables to resolve those
Change management – base test software stack, including versions, becomes out of synch with what was used to package/test; this includes how users authenticate
OS version checks - wired into vendor packages that terminate the install if deployed to Windows 10; unknown at the time of package creation
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

19. Conclusion Keep image customizations to the barest minimum
11/28/2018 5:35 AM
Conclusion Keep image customizations to the barest minimum
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

20. Windows 7 COTS packages with no pre-requisites
11/28/2018 5:35 AM
Windows 7 COTS packages with no pre-requisites
“…99 percent of apps are compatible with new Windows updates…”
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

21. 11/28/2018 5:35 AM
Conclusion All COTS packages that have zero customizations, and zero pre-requisites are compatible with vanilla Windows 10 Updates
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

22. 11/28/2018 5:35 AM
Conclusions
The more the base image is customized, the more likely there are to be application compatibility issues
Testing all applications against vanilla builds is of limited to no value
It is critical that the processes and infrastructure required to continually test in-house and customized applications cater for all pre-requisites
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

23. 11/28/2018 5:35 AM
Conclusions
Package quality is key. Applications not packaged to Microsoft best practice carry a higher risk of failure
The assertion that 99% of applications are compatible is true of COTS applications with zero prerequisites when deployed to a vanilla Windows 10 build
All outcomes and conclusions are equally applicable to service providers and internal IT departments / IT Pro’s
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

24. 11/28/2018 5:35 AM
Next Steps
Develop the Apptimized Maintain service to cater for the variables present in the typical enterprise apps estate
Engage with potential pilot customers
Automate the abstraction of build customizations and apply them to Insider builds
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

25. Thank You Simon May | s.may@apptimized.com www.apptimized.com
11/28/2018 5:35 AM
Thank You Simon May |
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

26. Please evaluate this session Your feedback is important to us!
11/28/2018 5:35 AM
Please evaluate this session Your feedback is important to us!
Please evaluate this session through MyEvaluations on the mobile app or website.
Download the app:
Go to the website:
© 2014 Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

27. 11/28/2018 5:35 AM
© Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.