Copyright © 2014 Chappell & Associates

Open source technologies are a fundamental part of Microsoft Azure i i

Is Microsoft really serious about supporting open source on Azure? ? ANSWER Yes: - Its competitors do this - Cloud platforms sell cycles, storage, and bandwidth. Who cares what software uses these? ANSWER Yes: - Its competitors do this - Cloud platforms sell cycles, storage, and bandwidth. Who cares what software uses these?

Do customers care about open source on Azure? ? ANSWER Yes: - For running Linux workloads - For open source development on Linux and Windows ANSWER Yes: - For running Linux workloads - For open source development on Linux and Windows

Compute IaaS, PaaS, and mobile services Data SQL, NoSQL, and big data analytics

Cloud Services Worker Roles Web Roles Application Virtual Machines User-Supplied VMs Gallery VHDs Infrastructure as a Service (IaaS) Platform as a Service (PaaS) Web Sites IIS Application IISApplication Platform as a Service (PaaS)

Mobile Services Mobile Backend as a Service (MBaaS) Authentication Notifications Custom Logic...

Virtual Machines User-Supplied VMs Gallery VHDs Windows Server and Linux images provided by customers Windows Server images provided by Microsoft; Linux images provided by partners VM Depot VHDs Linux images provided by the community

Canonical Ubuntu! Oracle Linux! SUSE Linux Enterprise - Targets enterprises! openSUSE Linux - Community distro! Microsoft provides forum-based support for all (today) CENTOS by Open Logic - Binary compatible with Red Hat Enterprise Linux! Canonical Ubuntu - With preinstalled Puppet Enterprise from Puppet Labs!

Windows VMs Linux VMs Puppet Console Chef Management Console Puppet/Chef Agents

Other Linux distributions are available Example: Debian Images typically include other software Examples: Django, Tomcat/EJB, Drupal, WordPress, Subversion, Jenkins, SugarCRM, … An image’s provider can offer paid support Example: Bitnami The Linux images in the gallery provide just an OS

Windows Server Linux $0.09/hour Small A1 (1 core, 1.75 GB) $0.06/hour Medium A2 (2 cores, 3.5 GB) $0.18/hour$0.12/hour Large A3 (4 cores, 7 GB) $0.36/hour$0.24/hour Extra Large A4 (8 cores, 14 GB) $0.72/hour$0.48/hour Memory Intensive A5 (2 cores, 14 GB) $0.33/hour$0.25/hour Memory Intensive A6 (4 cores, 28 GB) $0.66/hour$0.50/hour Memory Intensive A7 (8 cores, 56 GB) $1.32/hour$1.00/hour Linux is as much as 1/3 cheaper than Windows Server

Cloud Services Worker Roles Web Roles Application Base images are Windows Server Provides a pre-built, managed environment for running Windows applications Can install open source software in Windows Server VMs

VMs IIS Open Source Web Applications Custom Web Applications Websites Code HTML TFS, Git TFS, Git FTP, WebDeploy Users Microsoft Azure Web Sites Base images are Windows Server From the Web App Gallery

What It Provides Technology Foundation WordPress Content management system/blogging PHP/MySQL Joomla Content management system PHP/MySQL (and others) Apache Tomcat Web server/ servlet container Java MediaWiki Wiki package PHP/MySQL (and others) Python Django Web framework Express JavaScript/Node.js Web framework

PHP Scripting language and environment for web development Python General-purpose dynamic programming language Node.js Environment for web development with JavaScript ASP.NET and Java applications are also supported

Microsoft Azure VM Node.js V8 JavaScript Engine JavaScript Server Code Created by Google for the Chrome browser Web Browser JavaScript Engine JavaScript Client Code HTML/JSON Same programming language on client and server Node.js can run in Virtual Machines, Cloud Services, and Web Sites Written as a set of event handlers, each dispatched by the Node.js event loop

Web Browser JavaScript Engine JavaScript Client Code AngularJS Created by Google, provides data binding and more Microsoft Azure VM Many useful modules are available as open source, e.g., Express Node.js V8 JavaScript Engine JavaScript Server Code HTML/JSON Perhaps a single-page app (SPA)

Web Browser Microsoft Azure VM Node.js V8 JavaScript Engine JavaScript Server Code Visual Studio Online “Monaco” Works with Node.js on Microsoft Azure Web Sites (today) Windows Node.js Tools for Visual Studio Cloud9 IDE WebMatrix

What is TypeScript? A typed superset of JavaScript that compiles to ordinary JavaScript Who’s creating it? A group led by Anders Hejlsberg at Microsoft Why? To help make JavaScript a more effective language for creating large-scale applications

Microsoft Azure Mobile Services Microsoft provides SDKs for all User Authentication Notifications Custom Code REST/JSON Data Access Windows Store Apps iOS Apps Windows Phone Apps Android Apps Using services from Microsoft or Apple Using identities from Microsoft, Google, etc. Built with Node.js or ASP.NET

Microsoft Azure Virtual Machines (IaaS) Pros: Linux and Windows support; complete control of the VM Cons: Complete responsibility for VM management Microsoft Azure Cloud Services (PaaS) Pros: Least amount of required management Cons: Windows only; must reinstall open source software each time a VM starts Microsoft Azure Web Sites (PaaS) Pros: Easiest to use; built-in support for many options Cons: Windows only; using more than the options Microsoft provides takes extra work Use Mobile Services to support mobile apps

Operational Data Analytical Data Provided by Microsoft Azure Key/Value Store (Microsoft Azure Tables, Redis, …) Runs in Microsoft Azure Virtual Machines NoSQL Technologies SQL Technologies Big Data Analytics (HDInsight, Hadoop) Document Store (MongoDB, CouchDB, …) Relational Database (SQL Database, SQL Server, Oracle, MySQL, …) Column Family Store (Cassandra, HBase, …) Relational Reporting (SQL Server, Oracle, MySQL, …) Graph Database (Neo4J, …) Relational Analytics (SQL Server, Oracle, MySQL, …) Runs in Microsoft Azure Virtual Machines and is open source

SQL Query SQL Query Database Table Schema Relation MySQL, etc. can run in a Microsoft Azure Virtual Machines VM ClearDB provides MySQL as a managed service on Microsoft Azure Application

To scale for lots of users and lots of data Pros: NoSQL technologies can offer more scalability than relational databases Cons: Often lose some benefits of relational databases, e.g., secondary indexes, full transactions To work better with different data formats, e.g., JSON Pros: Avoiding object/relational mapping makes code easier to write Cons: Persistent data designed for a single application is harder to share; limited BI tools To analyze lots of data in parallel Pros: Hadoop has a large and growing ecosystem of tools and people Cons: Moving lots of on-premises data to Microsoft Azure can take time To work with data in a more flexible way Pros: NoSQL technologies don’t have fixed schemas Cons: Fixed schemas help prevent errors; data often isn’t normalized Developers vs. DBAs?

Database 3 3 B B Shard A A 1 1 A A 2 2 A A 3 3 B B 1 1 B B 2 2 B B 3 3 C C 1 1 C C 2 2 C C 3 3 Value (String, List, Set, Hash) Key NoSQL technologies are typically deployed in Microsoft Azure Linux VMs Application

Example Technologies What It Provides Key/value stores Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Example Use Case Online shopping cart Roots are in Amazon Dynamo

5 5 Column Family Keyspace Column Family Name Y Y X X B B X X 5 5 Row Key A A B B C C B B Row Data that’s frequently accessed together should be stored in the same column family Column Value 1 1 Column Name Application Columns store multiple time- stamped versions of a value

Example Technologies What It Provides Key/value stores Column family stores Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Cassandra, HBase Example Use Case Fast access to large amounts of more structured data Online shopping cart A table storing web pages Roots are in Google Bigtable

Shard Database JSON Query Targets a specific collection MongoLab provides a managed database service based on MongoDB for Microsoft Azure Application Collection Document JSON Can create indexes on multiple keys

Example Technologies What It Provides Key/value stores Column family stores Document databases Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Cassandra, HBase MongoDB, CouchDB Example Use Case Fast access to large amounts of more structured data Scalable store for JSON documents Online shopping cart A table storing web pages Persistent store for Node.js application

Web Browser JavaScript Application PC/Phone/Tablet Apps Microsoft Azure Node.js JavaScript Server Code VM JSON Collection JSON Mongo DB VM JSON Mongoose and other packages support connecting to MongoDB Query JSON

NoSQL offerings are largely open source today NoSQL is among the first new software categories to arise since open source became so important This is likely to be how many new markets go The traditional software revenue model won’t apply NoSQL companies can’t make money selling ones and zeros They must sell other things The company MongoDB (formerly 10gen) provides good examples

NoSQL Example Other Examples Running open source software and charging users for execution services MongoDB in Microsoft Azure IaaS VMs Cloud platforms/hosting Running open source software and charging users for the value the software provides MongoLab on Microsoft Azure WordPress on Microsoft Azure Web Sites Providing services to maintain and update open source software MongoDB Enterprise Red Hat Enterprise Linux Providing services to help install, customize, and use open source software MongoDB Consulting Systems integrator open source practice Selling hardware that relies on open source software Android phones Google’s Linux-based services Running open source software and charging advertisers for your users’ attention All of these are also possible with proprietary software

Query Node Relationship Graph A A B B D D Property X X Y Y D D B B Hard to shard, so not intended for massive scale Relationships are first-class data items Application

Example Technologies What It Provides Key/value stores Column family stores Document databases Graph databases Redis, Microsoft Azure Tables Fast access to large amounts of simply structured data Cassandra, HBase MongoDB, CouchDB Neo4J Example Use Case Fast access to large amounts of more structured data Scalable store for JSON documents Fast access to data organized into graphs Online shopping cart A table storing web pages Persistent store for Node.js application Social graph

Hadoop Distributed File System (HDFS) Allows storing and accessing very large binary files across a cluster of commodity servers and disk drives Hadoop MapReduce Supports applications that process large amounts of analytical data in parallel Data is typically stored in HDFS HBase Column family store built on HDFS Designed for operational data, not analytical data Hive/Pig Tools for querying, transforming, and analyzing data Both generate MapReduce jobs Hadoop 2.0 adds YARN, supporting frameworks other than MapReduce

Data Hadoop Distributed File System (HDFS) Hadoop MapReduce Job Logic Hive Pig... Provides HiveQL, a SQL- like query language Microsoft allows submitting HiveQL queries from Excel Excel

Microsoft Azure Blobs Data Hadoop MapReduce Job HDFS API VM Logic Hive Pig... Excel Using HDInsight will typically make more sense than building your own Hadoop cluster on Microsoft Azure

Open source technologies are a fundamental part of Microsoft Azure i i

David Chappell is Principal of Chappell & Associates ( in San Francisco, California. Through his speaking, writing, and consulting, he helps people around the world understand, use, and make better decisions about new technology. David has been the keynote speaker for more than a hundred events and conferences on five continents, and his seminars have been attended by tens of thousands of IT leaders, architects, and developers in forty-five countries. His books have been published in a dozen languages and used regularly in courses at MIT, ETH Zurich, and other universities. In his consulting practice, he has helped clients such as Hewlett-Packard, IBM, Microsoft, Stanford University, and Target Corporation adopt new technologies, market new products, and educate their customers and staff. Earlier in his career, David wrote networking software, chaired a U.S. national standards working group, and played keyboards with the Peabody-award-winning Children’s Radio Theater. He holds a B.S. in Economics and an M.S. in Computer Science, both from the University of Wisconsin-Madison.

Having a friend buy your coffee? Yea, it’s kind of like that. MSDN Subscribers get up to $150/mo in Azure credits. Stop by the Developer Platform and Tools booth and visit the MSDN Subscriptions station to activate your benefits and receive a gift! 3 Steps to New Gear! With Application Insights

Microsoft Engineering Stories Visual Studio Industry Partner Program Visual Studio | Integrate