Download presentation
Presentation is loading. Please wait.
1
BUILDING TOOLS FOR THE HADOOP DEVELOPER matt winkler @mwinkle
2
Agenda What are we up to? Overview of the problem space Dives and demos
5
Existing Ecosystem Actively contributing to: Core Pig Hive HCatalog Branching to other projects Simple one-box developer install on Windows
6
.NET Map/Reduce LINQ to Hive Client APIs WebHCat Ambari WebHDFS Azure Visual Studio Tooling Local debugging support
7
JavaScript MRjs – Map/Reduce in JavaScript Node.js client APIs WebHCat WebHDFS Ambari Azure
8
Management UI Tooling Cluster usage Job authoring Result consumption in common tools PowerShell & Cross platform scripting API Surface RDFE – Azure provisioning Ambari – Cluster monitoring WebHCatalog – Metadata and job submission WebHDFS, Blob Storage – Storage Management Portal >_ Scripting (Windows, Linux and Mac) REST API
9
Sources http://hadoopsdk.codeplex.com http://www.github.com/windowsazure NuGet packages Microsoft.Hadoop.MapReduce Microsoft.Hadoop.Hive Microsoft.Hadoop.WebHDFS => WebClient NPM packages Azure Azure-cli Hadoop REST clients pending… open
10
Big Data. Small Data. All Data. www.microsoft.com/bigdata Learn More: February 28 9:05amMicrosoft Keynote by Dave Campbell 9:45amMicrosoft Keynote by Kate Crawford 10:40amMicrosoft Sponsored Session in Partnership with Ascribe 11:30amDave Campbells Office Hours
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.