Snapdragon and AI at the Edge Qualcomm is bringing life, enabling human-like understanding and behaviors on devices and things to enrich life. Qualcomm is developing cognitive technologies, such as brain-inspired machine learning, human-like computer vision, intelligent connectivity, and always-on sensing. Cognitive technologies will raise the bar for user experiences, making devices more personal, intuitive, useful, productive, and easy to use. They’ll impact many devices and verticals, reshaping industries and bringing new possibilities to new frontiers. In this presentation, I’ll explain why this is happening now, how it’s possible, and all the amazing benefits that are in store for us. We are already on the journey to humanizing technology. Qualcomm Technologies, Inc. Sep. 2017

Devices, machines, and things are becoming more intelligent Making machines more intelligent has been a vision for a very long time. Back in 1950, pioneering computer scientist Alan Turing proposed the question “can machines think?” To give empirical meaning to this question, he invented his Turing test (the imitation game) to determine whether or not a computer could be considered intelligent. If machines can imitate humans closely enough to fool humans into thinking that they are human, then they pass the test. Since then, computing devices have been getting smarter. But, can today’s machines and devices pass the Turing test? Today, let’s think of all the devices and objects in your life, whether it is your smartphone, car, or washing machine. They increasingly have a wider variety of sensors (and better sensors), more capable processors, and faster connectivity. Isn’t it time for these devices to know us better and become more useful? Shouldn’t they take all these inputs, whether it is the sensor, the camera, the microphone, your location, your calendar, your repetitive patterns and behaviors, and help us in our daily lives? We started to see this happening. Mobile devices are becoming more aware, always listening to what users are saying and understanding what they mean (even users with different accents). Right now, our smartphone’s camera captures a high-quality image, but what if it could understand the image and not just sees it as millions of individual pixels. What if it could recognize objects, figure out context, draw conclusions, and take actions.

Intelligence & Analytics AI Workload Migration Server/Cloud Intelligence & Analytics Mobile/Edge Key Use Cases Vision | Audio | Security Benefits Low Latency | Privacy Execution/Inference Training Execution/Inference

Making On-device Intelligence Pervasive Focusing on high performance HW/SW and optimized network design Powerful Hardware Algorithmic Innovations Software & Data

>8.5 Billion Mobile is becoming the largest AI platform Mobile technology is the largest technology platform in human history >8.5B cumulative smartphone shipments between 2016-2021 High pace of innovation, massive scale of devices, and the need for highly integrated, power- and thermal-efficient processing provides capabilities needed to advance ML on the device The smartphone has been the largest platform for computer vision technologies, accelerating development Make a little less wireless focused – add camera, gaming, etc. icons Cumulative smartphone unit shipments forecast between 2017–2021 Source: Gartner Mar. ‘17

Mobile Drives Everything… Drones Automotive Mobile VR/AR IOT The Machine Learning Platform serves as the foundation for more natural, intuitive and intelligent on-device interactions through the implementation of myriad machine learning technologies that make devices smarter.  Cameras Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.

Qualcomm® Artificial Intelligence Platform Qualcomm Technologies’ first on-device AI platform for Qualcomm® Snapdragon™ A high-performance platform designed to enable myriad intelligent-on-device-capabilities that utilize: Audio Intelligence Snapdragon processor’s heterogeneous compute capabilities within a highly integrated SoC Visual Intelligence Qualcomm™ Machine Learning Platform enables the Snapdragon 820 processor to provide optimized deep learning and neural network processing. Using heterogeneous compute engines, the platform realizes robust cognitive intelligence solely on the device. Innovations in AI, machine learning algorithms, and enabling software Extending Qualcomm Technologies’ legacy and expertise in smart computing Intuitive security

Optimal Power & Performance for DNN Workloads Choose the Snapdragon core to fit the use case (Inception V3 on SDM835) Energy Efficiency 8x 25x Qualcomm® Kryo™ CPU Qualcomm® Adreno™ GPU Qualcomm® Hexagon™ DSP 4x 8x Performance Inception V3 on SDM835

Qualcomm® Snapdragon™ Neural Processing Engine Software accelerated runtime for the execution of deep neural networks on device Efficient execution on Snapdragon Takes advantage of Snapdragon heterogeneous computing capabilities Runtime and libraries accelerate DNN processing on all cores – CPU, GPU and DSP/HVX Model framework and network support Convolutional Neural Networks and LSTMs Support of Caffe/Caffe2, Tensorflow and User/Developer Defined layers Optimization and debugging tools Offline network conversion tools Debug and analyze network performance API and SDK documentation with sample code Ease of integration into customer applications Smartphone IP Camera Automotive Drones What’s new for 835 Tensorflow support HVX 8-bit support Custom Layers Performance optimizations across all cores IoT Qualcomm® Kryo™ CPU Qualcomm® Adreno™ GPU Qualcomm® Hexagon™ DSP Qualcomm Kryo, Qualcomm Adreno and Qualcomm Hexagon are products of Qualcomm Technologies, Inc.

Snapdragon Neural Processing Engine Workflow Home Mobile VR/AR Auto Cameras Faster RCNN ResNet Alexnet GoogleNet/ Inception SqueezeNet NPE Object Classification Face Detection Scene Segmentation Natural Language Understanding Speaker Recognition Security/Authentication Resource Management

Social Media Apps: Camera + AR + AI = Consumer Delight AI workloads moving from cloud to the edge Leading social media apps using AR & AI tech in abundance Camera at the center – key to consumer delight and communication Augmented reality features powered by AI Style Transfer & Filters Frames & Masks Photo and live videos, including 360 Contextual awareness (e.g. location/sensor metadata) Progression of high level tasks Detection, Perception, Understanding, Prediction Why on device? Lower latency, privacy, connection independent

Facebook Chooses Qualcomm On-Device AI with Snapdragon Applied Machine Learning (AML) Team Launch of Caffe2 @F8 (4/18) Announced Snapdragon Neural Processing Engine integration in all Facebook apps Accelerates on-device neural nets on Snapdragon cores QCOM first mobile launch partner - early access and spotlight demos @F8 5x performance upside on GPU (compared to CPU) – HVX to come Demonstrates critical need for shared edge + cloud ”intelligence” burden “On-device machine learning is made possible by the Qualcomm Snapdragon NPE which does the heavy lifting needed to run neural networks more efficiently on Snapdragon devices.” Source: XDA Confidential and Proprietary – Qualcomm Technologies, Inc.

Today’s On-Device AI Use Cases – Tip of the Iceberg Snapdragon offers the optimal processor for Artificial Intelligence Scene/ Classification Voice/ Speech Recog. Audio ID Text Recog. Cont. Auth.– Liveness Scene/ Classification Object tracking/ Location Face & people recog Video Summarization Gestures/ hand tracking Face recog. Voice/Audio/ Keyword Object tracking Depth/location Scene/ Classification Object tracking Object location Object avoidance Video Summarization Scene/ Classification ADAS/ Autonomous Object tracking & avoidance Voice/Speech Rec. Diagnostics Speech and speaker recognition Audio ID Keyword detection Natural language understanding “…less than 1% of software developers incorporate cognitive capabilities into their applications today and IDC expected this percentage to exceed 50% by 2018.” International Data Corp – April 2016 Confidential and Proprietary – Qualcomm Technologies, Inc. 13

20 BILLION CONNECTED DEVICES BY 2020 Machina Research, Dec. ’16, Gartner, Dec. ’16

Bring AI to the edge with Snapdragon Snapdragon Neural Processing Engine SDK is available for download Developer.Qualcomm.com/AI