1. Snapdragon and AI at the Edge
Qualcomm is bringing life, enabling human-like understanding and behaviors on devices and things to enrich life.
Qualcomm is developing cognitive technologies, such as brain-inspired machine learning, human-like computer vision, intelligent connectivity, and always-on sensing.
Cognitive technologies will raise the bar for user experiences, making devices more personal, intuitive, useful, productive, and easy to use.
They’ll impact many devices and verticals, reshaping industries and bringing new possibilities to new frontiers.
In this presentation, I’ll explain why this is happening now, how it’s possible, and all the amazing benefits that are in store for us. We are already on the journey to humanizing technology.
Qualcomm Technologies, Inc.
Sep. 2017

2. Devices, machines, and things are becoming more intelligent
Making machines more intelligent has been a vision for a very long time. Back in 1950, pioneering computer scientist Alan Turing proposed the question “can machines think?” To give empirical meaning to this question, he invented his Turing test (the imitation game) to determine whether or not a computer could be considered intelligent. If machines can imitate humans closely enough to fool humans into thinking that they are human, then they pass the test. Since then, computing devices have been getting smarter. But, can today’s machines and devices pass the Turing test?
Today, let’s think of all the devices and objects in your life, whether it is your smartphone, car, or washing machine. They increasingly have a wider variety of sensors (and better sensors), more capable processors, and faster connectivity. Isn’t it time for these devices to know us better and become more useful? Shouldn’t they take all these inputs, whether it is the sensor, the camera, the microphone, your location, your calendar, your repetitive patterns and behaviors, and help us in our daily lives?
We started to see this happening. Mobile devices are becoming more aware, always listening to what users are saying and understanding what they mean (even users with different accents). Right now, our smartphone’s camera captures a high-quality image, but what if it could understand the image and not just sees it as millions of individual pixels. What if it could recognize objects, figure out context, draw conclusions, and take actions.

3. Intelligence & Analytics
AI Workload Migration
Server/Cloud
Intelligence & Analytics
Mobile/Edge
Key Use Cases Vision | Audio | Security
Benefits Low Latency | Privacy
Execution/Inference
Training
Execution/Inference

4. Making On-device Intelligence Pervasive
Focusing on high performance HW/SW and optimized network design
Powerful Hardware
Algorithmic Innovations
Software & Data

5. >8.5 Billion Mobile is becoming the largest AI platform
Mobile technology is the largest technology platform in human history
>8.5B cumulative smartphone shipments between
High pace of innovation, massive scale of devices, and the need for highly integrated, power- and thermal-efficient processing provides capabilities needed to advance ML on the device
The smartphone has been the largest platform for computer vision technologies, accelerating development
Make a little less wireless focused – add camera, gaming, etc. icons
Cumulative smartphone unit shipments forecast between 2017–2021
Source: Gartner Mar. ‘17

6. Mobile Drives Everything…
Drones
Automotive
Mobile
VR/AR
IOT
The Machine Learning Platform serves as the foundation for more natural, intuitive and intelligent on-device interactions through the implementation of myriad machine learning technologies that make devices smarter. 
Cameras
Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.

7. Qualcomm® Artificial Intelligence Platform
Qualcomm Technologies’ first on-device AI platform for Qualcomm® Snapdragon™
A high-performance platform designed to enable myriad intelligent-on-device-capabilities that utilize:
Audio Intelligence
Snapdragon processor’s heterogeneous compute capabilities within a highly integrated SoC
Visual Intelligence
Qualcomm™ Machine Learning Platform enables the Snapdragon 820 processor to provide optimized deep learning and neural network processing.
Using heterogeneous compute engines, the platform realizes robust cognitive intelligence solely on the device.
Innovations in AI, machine learning algorithms, and enabling software
Extending Qualcomm Technologies’ legacy and expertise in smart computing
Intuitive security

8. Optimal Power & Performance for DNN Workloads
Choose the Snapdragon core to fit the use case (Inception V3 on SDM835)
Energy Efficiency 8x
25x
Qualcomm®
Kryo™ CPU
Qualcomm®
Adreno™ GPU
Qualcomm®
Hexagon™ DSP 4x 8x
Performance
Inception V3 on SDM835

9. Qualcomm® Snapdragon™ Neural Processing Engine
Software accelerated runtime for the execution of deep neural networks on device
Efficient execution on Snapdragon
Takes advantage of Snapdragon heterogeneous computing capabilities
Runtime and libraries accelerate DNN processing on all cores – CPU, GPU and DSP/HVX
Model framework and network support
Convolutional Neural Networks and LSTMs
Support of Caffe/Caffe2, Tensorflow and User/Developer Defined layers
Optimization and debugging tools
Offline network conversion tools
Debug and analyze network performance
API and SDK documentation with sample code
Ease of integration into customer applications
Smartphone
IP Camera
Automotive
Drones
What’s new for 835
Tensorflow support
HVX 8-bit support
Custom Layers
Performance optimizations across all cores
IoT
Qualcomm®
Kryo™ CPU
Qualcomm®
Adreno™ GPU
Qualcomm®
Hexagon™ DSP
Qualcomm Kryo, Qualcomm Adreno and Qualcomm Hexagon are products of Qualcomm Technologies, Inc.

10. Snapdragon Neural Processing Engine Workflow
Home
Mobile
VR/AR
Auto
Cameras
Faster
RCNN
ResNet
Alexnet
GoogleNet/
Inception
SqueezeNet
NPE
Object Classification
Face Detection
Scene Segmentation
Natural Language
Understanding
Speaker Recognition
Security/Authentication
Resource Management

11. Social Media Apps: Camera + AR + AI = Consumer Delight
AI workloads moving from cloud to the edge
Leading social media apps using AR & AI tech in abundance
Camera at the center – key to consumer delight and communication
Augmented reality features powered by AI
Style Transfer & Filters
Frames & Masks
Photo and live videos, including 360
Contextual awareness (e.g. location/sensor metadata)
Progression of high level tasks
Detection, Perception, Understanding, Prediction
Why on device?
Lower latency, privacy, connection independent

12. Facebook Chooses Qualcomm
On-Device AI with Snapdragon
Applied Machine Learning (AML) Team
Launch of (4/18)
Announced Snapdragon Neural Processing Engine integration in all Facebook apps
Accelerates on-device neural nets on Snapdragon cores
QCOM first mobile launch partner - early access and spotlight
5x performance upside on GPU (compared to CPU) – HVX to come
Demonstrates critical need for shared edge + cloud ”intelligence” burden
“On-device machine learning is made possible by the Qualcomm Snapdragon NPE which does the heavy lifting needed to run neural networks more efficiently on Snapdragon devices.”
Source: XDA
Confidential and Proprietary – Qualcomm Technologies, Inc.

13. Today’s On-Device AI Use Cases – Tip of the Iceberg
Snapdragon offers the optimal processor for Artificial Intelligence
Scene/ Classification
Voice/ Speech Recog.
Audio ID
Text Recog.
Cont. Auth.– Liveness
Scene/ Classification
Object tracking/ Location
Face & people recog
Video Summarization
Gestures/ hand tracking
Face recog.
Voice/Audio/ Keyword
Object tracking
Depth/location
Scene/ Classification
Object tracking
Object location
Object avoidance
Video Summarization
Scene/ Classification
ADAS/ Autonomous
Object tracking & avoidance
Voice/Speech Rec.
Diagnostics
Speech and speaker recognition
Audio ID
Keyword detection
Natural language understanding
“…less than 1% of software developers incorporate cognitive capabilities into their applications today and IDC expected this percentage to exceed 50% by 2018.”
International Data Corp – April 2016
Confidential and Proprietary – Qualcomm Technologies, Inc. 13

14. 20 BILLION CONNECTED DEVICES BY 2020
Machina Research, Dec. ’16, Gartner, Dec. ’16

15. Bring AI to the edge with Snapdragon
Snapdragon Neural Processing Engine SDK
is available for download
Developer.Qualcomm.com/AI