Snapdragon and AI at the Edge

Slides:



Advertisements
Similar presentations
Qualcomm Demos Meeting of the Minds October 10, 2012.
Advertisements

Designing for energy-efficient vision-based interactivity on mobile devices Miguel Bordallo Center for Machine Vision Research.
Pat McGarry Ryft Systems, Inc. Closing Keynote Harnessing the Flood of IoT Data With Heterogeneous Computing at the Edge.
Internet of Things. Creating Our Future Together.
1© 2015 IBM Corporation Unlocking the power of the API economy Client Briefing Nov.
Decision Support and Business Intelligence Systems (9 th Ed., Prentice Hall) Chapter 12: Artificial Intelligence and Expert Systems.
WEB API AND CLOUD DEVELOPMENT BY TRAWEX TECHNOLOGIES.
INDUSTRY 4.0: FROM THINGS TO OUTCOMES
READ ME FIRST Use this template to create your Partner datasheet for Azure Stack Foundation. The intent is that this document can be saved to PDF and provided.
5G Wireless Technology.
i.MX 8 Series: 3 Processor Families with Targeted Features
It’s Time for Cognitive Computing
Teck Chia Partner, Exponent.vc
AuraPortal Cloud Helps Empower Organizations to Organize and Control Their Business Processes via Applications on the Microsoft Azure Cloud Platform MICROSOFT.
Device Maintenance and Management, Parental Control, and Theft Protection for Home Users Made Easy with Remo MORE and Power of Azure MICROSOFT AZURE APP.
TensorFlow CS 5665 F16 practicum Karun Joseph, A Reference:
The world’s most advanced mobile platform
Nicho Joins Microsoft Azure Certified Program to Transform Brand Engagement, Boost Customer Acquisition and Conversions with Scalable Ease MICROSOFT AZURE.
Trial.iO Makes it Easy to Provision Software Trials, Demos and Training Environments in the Azure Cloud in One Click, Without Any IT Involvement MICROSOFT.
Industrial IoT Derive business value from the Internet of Things, People and Services Ronald Binkofski General Manager Microsoft MC CIS.
Enabling machine learning in embedded systems
Primal and Microsoft Azure Deliver Personalized Content, Intelligence, and Analytics That Match Your Content to the Interests of Your Audience MICROSOFT.
Utilizing AI & GPUs to Build Cloud-based Real-Time Video Event Detection Solutions Zvika Ashani CTO.
Introduction to Azure Bot Framework
Wonderware Online Cost-Effective SaaS Solution Powered by the Microsoft Azure Cloud Platform Delivers Industrial Insights to Users and OEMs MICROSOFT AZURE.
Building Innovative Apps using the Microsoft Developer Platform
Texas Instruments TDA2x and Vision SDK
Asad Khan Managing Director Health & Public Service.
H3 Solutions and the Azure Government Cloud Team Up to Power Contextual Intelligence Platform – Where Big Data Meets Business Productivity MICROSOFT AZURE.
Mobile edge computing Report by Weiqing huang.
Running on the Powerful Microsoft Azure Platform,
Scalable SoftNAS Cloud Protects Customers’ Mission-Critical Data in the Cloud with a Highly Available, Flexible Solution for Microsoft Azure MICROSOFT.
A STEP-BY-STEP GUIDE FOR ANDROID MIGRATION
Layer-wise Performance Bottleneck Analysis of Deep Neural Networks
Artificial Intelligence Changes the Security Landscape
Voice Analytics on Microsoft Azure Allows Various Customers to Get the Most Out of Conversations with Clients Through Efficient Content Analysis MICROSOFT.
I-POWER JAPAN Gives Small Businesses the Ability to Get Their Work Done from Anywhere, Even a Construction Site, by Using Microsoft Azure MICROSOFT AZURE.
Innovative content & language solutions: Transforming digital.
Get Enterprise-Grade Call Handling and Control for Microsoft Office 365 and Skype for Business with the Bridge Boss-Admin Executive Console OFFICE 365.
The Only Digital Asset Management System on Microsoft Azure, MediaValet Is Uniquely Equipped to Meet Any Company’s Needs MICROSOFT AZURE ISV PROFILE: MEDIAVALET.
Accelerate Your Self-Service Data Analytics
Securing the Internet of Things: Key Insights and Best Practices Across the Industry Theresa Bui Revon IoT Cloud Strategy.
Keep Your Digital Media Assets Safe and Save Time by Choosing ImageVault to be Your Digital Asset Management Solution, Hosted in Microsoft Azure Partner.
SAS Deep Learning: From Toolkit to Fast Model Prototyping
What's New in eCognition 9
AIMS for BizTalk, Built on the Microsoft Azure Platform, Empowers Enterprises to Automate Insight and Analytics and Boost Value Creation MICROSOFT AZURE.
Innovation at the Edge How rapid experimentation with emerging technologies is achieving results on Earth and in Space Tom Soderstrom, JPL IT Chief Technology.
JPL’s Acquisition Intelligent Assistant Results
The Pitfalls and Guidelines for Mobile ML Benchmarking
AI Stick Easy to learn and use, accelerate the industrialization of artificial intelligence, and let the public become an expert in AI.
Smart Learning concepts to enhance SMART Universities in Africa
Make it easy to be secure E.g. derived credentials test lab
Improve Patient Experience with Saama and Microsoft Azure
Technical Capabilities
© 2016 Global Market Insights, Inc. USA. All Rights Reserved Fuel Cell Market size worth $25.5bn by 2024 Low Power Wide Area Network.
A Mobile Application for the Blind and Dyslexic
The Sense Add-On Module for MarineCFO’s Vessel 365 Solution Uses Microsoft Azure Services and IoT Technologies to Provide Advanced Data Analytics MICROSOFT.
IoT, Tekoäly ja wearables
Agenda Need of Cloud Computing What is Cloud Computing
Company Overview.
Global megatrends (relevant for our business)
Automotive Semiconductors are essential to realizing key trends like electro-mobility, automated driving and secure, connected cars. We are the leading.
What's New in eCognition 9
Utilizing the Network Edge
What's New in eCognition 9
PRELIMINARY DESIGN REVIEW
The Intelligent Enterprise and SAP Business One
COGNITIVE SERVICES MACHINE LEARNING FOR DEVELOPERS
How will Technology shake up Procurement?
Martin Croome VP Business Development GreenWaves Technologies.
Presentation transcript:

Snapdragon and AI at the Edge Qualcomm is bringing life, enabling human-like understanding and behaviors on devices and things to enrich life. Qualcomm is developing cognitive technologies, such as brain-inspired machine learning, human-like computer vision, intelligent connectivity, and always-on sensing. Cognitive technologies will raise the bar for user experiences, making devices more personal, intuitive, useful, productive, and easy to use. They’ll impact many devices and verticals, reshaping industries and bringing new possibilities to new frontiers. In this presentation, I’ll explain why this is happening now, how it’s possible, and all the amazing benefits that are in store for us. We are already on the journey to humanizing technology. Qualcomm Technologies, Inc. Sep. 2017

Devices, machines, and things are becoming more intelligent Making machines more intelligent has been a vision for a very long time. Back in 1950, pioneering computer scientist Alan Turing proposed the question “can machines think?” To give empirical meaning to this question, he invented his Turing test (the imitation game) to determine whether or not a computer could be considered intelligent. If machines can imitate humans closely enough to fool humans into thinking that they are human, then they pass the test. Since then, computing devices have been getting smarter. But, can today’s machines and devices pass the Turing test? Today, let’s think of all the devices and objects in your life, whether it is your smartphone, car, or washing machine. They increasingly have a wider variety of sensors (and better sensors), more capable processors, and faster connectivity. Isn’t it time for these devices to know us better and become more useful? Shouldn’t they take all these inputs, whether it is the sensor, the camera, the microphone, your location, your calendar, your repetitive patterns and behaviors, and help us in our daily lives? We started to see this happening. Mobile devices are becoming more aware, always listening to what users are saying and understanding what they mean (even users with different accents). Right now, our smartphone’s camera captures a high-quality image, but what if it could understand the image and not just sees it as millions of individual pixels. What if it could recognize objects, figure out context, draw conclusions, and take actions.

Intelligence & Analytics AI Workload Migration Server/Cloud Intelligence & Analytics Mobile/Edge Key Use Cases Vision | Audio | Security Benefits Low Latency | Privacy Execution/Inference Training Execution/Inference

Making On-device Intelligence Pervasive Focusing on high performance HW/SW and optimized network design Powerful Hardware Algorithmic Innovations Software & Data

>8.5 Billion Mobile is becoming the largest AI platform Mobile technology is the largest technology platform in human history >8.5B cumulative smartphone shipments between 2016-2021 High pace of innovation, massive scale of devices, and the need for highly integrated, power- and thermal-efficient processing provides capabilities needed to advance ML on the device The smartphone has been the largest platform for computer vision technologies, accelerating development Make a little less wireless focused – add camera, gaming, etc. icons Cumulative smartphone unit shipments forecast between 2017–2021 Source: Gartner Mar. ‘17

Mobile Drives Everything… Drones Automotive Mobile VR/AR IOT The Machine Learning Platform serves as the foundation for more natural, intuitive and intelligent on-device interactions through the implementation of myriad machine learning technologies that make devices smarter.  Cameras Qualcomm Snapdragon is a product of Qualcomm Technologies, Inc.

Qualcomm® Artificial Intelligence Platform Qualcomm Technologies’ first on-device AI platform for Qualcomm® Snapdragon™ A high-performance platform designed to enable myriad intelligent-on-device-capabilities that utilize: Audio Intelligence Snapdragon processor’s heterogeneous compute capabilities within a highly integrated SoC Visual Intelligence Qualcomm™ Machine Learning Platform enables the Snapdragon 820 processor to provide optimized deep learning and neural network processing. Using heterogeneous compute engines, the platform realizes robust cognitive intelligence solely on the device. Innovations in AI, machine learning algorithms, and enabling software Extending Qualcomm Technologies’ legacy and expertise in smart computing Intuitive security

Optimal Power & Performance for DNN Workloads Choose the Snapdragon core to fit the use case (Inception V3 on SDM835) Energy Efficiency 8x 25x Qualcomm® Kryo™ CPU Qualcomm® Adreno™ GPU Qualcomm® Hexagon™ DSP 4x 8x Performance Inception V3 on SDM835

Qualcomm® Snapdragon™ Neural Processing Engine Software accelerated runtime for the execution of deep neural networks on device Efficient execution on Snapdragon Takes advantage of Snapdragon heterogeneous computing capabilities Runtime and libraries accelerate DNN processing on all cores – CPU, GPU and DSP/HVX Model framework and network support Convolutional Neural Networks and LSTMs Support of Caffe/Caffe2, Tensorflow and User/Developer Defined layers Optimization and debugging tools Offline network conversion tools Debug and analyze network performance API and SDK documentation with sample code Ease of integration into customer applications Smartphone IP Camera Automotive Drones What’s new for 835 Tensorflow support HVX 8-bit support Custom Layers Performance optimizations across all cores IoT Qualcomm® Kryo™ CPU Qualcomm® Adreno™ GPU Qualcomm® Hexagon™ DSP Qualcomm Kryo, Qualcomm Adreno and Qualcomm Hexagon are products of Qualcomm Technologies, Inc.

Snapdragon Neural Processing Engine Workflow Home Mobile VR/AR Auto Cameras Faster RCNN ResNet Alexnet GoogleNet/ Inception SqueezeNet NPE Object Classification Face Detection Scene Segmentation Natural Language Understanding Speaker Recognition Security/Authentication Resource Management

Social Media Apps: Camera + AR + AI = Consumer Delight AI workloads moving from cloud to the edge Leading social media apps using AR & AI tech in abundance Camera at the center – key to consumer delight and communication Augmented reality features powered by AI Style Transfer & Filters Frames & Masks Photo and live videos, including 360 Contextual awareness (e.g. location/sensor metadata) Progression of high level tasks Detection, Perception, Understanding, Prediction Why on device? Lower latency, privacy, connection independent

Facebook Chooses Qualcomm On-Device AI with Snapdragon Applied Machine Learning (AML) Team Launch of Caffe2 @F8 (4/18) Announced Snapdragon Neural Processing Engine integration in all Facebook apps Accelerates on-device neural nets on Snapdragon cores QCOM first mobile launch partner - early access and spotlight demos @F8 5x performance upside on GPU (compared to CPU) – HVX to come Demonstrates critical need for shared edge + cloud ”intelligence” burden “On-device machine learning is made possible by the Qualcomm Snapdragon NPE which does the heavy lifting needed to run neural networks more efficiently on Snapdragon devices.” Source: XDA Confidential and Proprietary – Qualcomm Technologies, Inc.

Today’s On-Device AI Use Cases – Tip of the Iceberg Snapdragon offers the optimal processor for Artificial Intelligence Scene/ Classification Voice/ Speech Recog. Audio ID Text Recog. Cont. Auth.– Liveness Scene/ Classification Object tracking/ Location Face & people recog Video Summarization Gestures/ hand tracking Face recog. Voice/Audio/ Keyword Object tracking Depth/location Scene/ Classification Object tracking Object location Object avoidance Video Summarization Scene/ Classification ADAS/ Autonomous Object tracking & avoidance Voice/Speech Rec. Diagnostics Speech and speaker recognition Audio ID Keyword detection Natural language understanding “…less than 1% of software developers incorporate cognitive capabilities into their applications today and IDC expected this percentage to exceed 50% by 2018.” International Data Corp – April 2016 Confidential and Proprietary – Qualcomm Technologies, Inc. 13

20 BILLION CONNECTED DEVICES BY 2020 Machina Research, Dec. ’16, Gartner, Dec. ’16

Bring AI to the edge with Snapdragon Snapdragon Neural Processing Engine SDK is available for download Developer.Qualcomm.com/AI