Self-Service Data Integration with Power Query Stéphane Fréchette.

Slides:



Advertisements
Similar presentations
AGILE BI Company profile Today’s Format ● Registration ● Presentation 1 ● Demonstration 1 ● Break ● Demonstration 2 ● Q & A.
Advertisements

In a cube in the office there lived an information worker…
INTELLIGENT DATA SOLUTIONS Introduction to Power BI Devin
© 2012 IBM Corporation 1 IBM Cognos 10 family Analytics in the hands of everyone Address all your analytic needs Report, Analyze, Model, Plan and Collaborate.
Power BI Sites and Mobile BI. What You Will Learn Sharing and Collaboration Introducing Power BI Exploring Power BI Features and Services Partner Opportunities.
Setting Big Data Capabilities Free How to Make Business on Big Data? Stig Torngaard, Partner Platon.
FAST FORWARD WITH MICROSOFT BIG DATA Vinoo Srinivas M Solutions Specialist Windows Azure (Hadoop, HPC, Media)
BUILD EFFICIENCY IN YOUR ORGANIZATION WITH SHAREPOINT 2010 Steve Deming Partner Solutions Advisor Microsoft US Partner Group
Powerful Self-Service BI with Excel 2013.
Accelerate Business Success With CRM CRM Interoperability.
Integration and Insight Aren’t Simple Enough Laura Haas IBM Distinguished Engineer Director, Computer Science Almaden Research Center.
Unlock Your Data Rich connectivity Robust data integration Enterprise-class manageability Deliver Relevant Information Intuitive design environment.
Matt Masson| Senior Program Manager
SQL Server 2014 Enterprise Edition Brad Jarocki Adam Bogobowicz Matt Haynes.
Business Intelligence System September 2013 BI.
Introduction to Building a BI Solution 권오주 OLAPForum
Business Intelligence
UNCLASSIFIED Business Intelligence and SharePoint 2010 Steve McDonnell.
Enables self-service data discovery, query, transformation and mashup experiences in Excel Discovery and connectivity to a wide range of data sources,
Business Intelligence Overview Marc Schöni Technical Solution Professional | Business Intelligence Microsoft Switzerland.
Enhanced Collaboration and other benefits of Sharepoint Technologies Kern Sutton Business Productivity Group Microsoft Corporation.
BUSINESS INTELLIGENCE/DATA INTEGRATION/ETL/INTEGRATION AN INTRODUCTION Presented by: Gautam Sinha.
Realizing Business Insights with PowerPivot
SharePoint Server 2013 Features and Scenarios for IT Professionals First Lastname, Title March, 2014 Software Assurance Planning Services.
SPONSORS. Microsoft PowerPivot for SQL Server, Excel 2010, and SharePoint 2010 Michael Herman Syntergy, Inc.
SharePoint 2010 Business Intelligence Module 2: Business Intelligence.
SQL Server 2014: The Data Platform for the Cloud.
Our Powers Combined: Query, Pivot, Map, and View A quick tour through the 4 pillars of Power BI February 11, 2014.
Virtual techdays INDIA │ November 2010 PowerPivot for Excel 2010 and SharePoint 2010 Joy Rathnayake │ MVP.
PO320: Reporting with the EPM Solution Keshav Puttaswamy Program Manager Lead Project Business Unit Microsoft Corporation.
Presentation Outline (hidden slide) Technical Level: 100 Intended Audience: TDMs, ITPros, ITDMs, BI specialists Objectives (what do you want the audience.
Agenda TimeSession 9:15Microsoft Business Intelligence Overview Break 10:40Creating High Impact Data Warehouse with Integration and Analysis Services 11:55Lunch.
Microsoft TechForge 2009 SQL Server 2008 Unplugged Microsoft’s Data Platform Vinod Kumar Technology Evangelist – DB and BI
The Last Mile: Delivering the Facts – Client Side Analysis.
IMPROVED PRODUCTIVITY THROUGH BREAKTHROUGH INSIGHTS.
April 10-12, Chicago, IL Microsoft Data Explorer for Excel Faisal Mohamood, Lead PM, Microsoft.
MICROSOFT CODENAME “DATA EXPLORER”. “Data Explorer” is a self-service experience in the cloud and on the desktop for discovering, transforming and publishing.
Sofia Event Center ноември 2013 г. Маги Наумова/ Боряна Петрова.
Why Power Query? What’s New in Power Query? Coming Soon to Power Query.
SQL Server 2008 Analysis Services. END USER TOOLS & PERFORMANCE MANAGEMENT APPS Excel PerformancePoint Server BI PLATFORM SQL Server Reporting Services.
Natural Language Querying Using Q&A. Data & Analytics Self-service BI with the familiarity of Office and the power of the cloud.
Purpose of this presentation: Describe the capabilities and value of Power BI for the IT Professional Target audience: Business Intelligence IT Professionals.
INTELLIGENT DATA SOLUTIONS Understanding Microsoft Self-Service BI Devin
Ben Robb MVP, SharePoint Server cScape Ltd OFC204.
Business Intelligence for everyone 2 For BI to deliver maximum value, all Information Workers must participate: Broad access to uncover and share insights.
Intro to Power BI Azhagappan Arunachalam.  Senior Database Architect   PowerBICentral.com  (blog on getting started.
4/9/2016 SharePoint Saturday Omaha Kerry Dirks MCP, MCSD Manager Consultant, Sogeti SharePoint Solution Architect.
Superhero Power BI Peter Myers Bitwise Solutions.
Play video Click hereClick here to jump to a slide in the appendix with more technical information on this solution.
Share your Excel workbooks in the web Use slicer targets to optionally filter dashboard items Interact with your workbook with all of the rich.
Excel Services Displays all or parts of interactive Excel worksheets in the browser –Excel “publish” feature with optional parameters defined in worksheet.
Microsoft Power Query: an Excel Users Dream for Data Extraction and Cleansing Presented by: Belinda Allen Smith & Allen Consulting, Inc.
MAKING BUSINESS INTELLIGENT Brought to you by your local PASS Community! Self Service ETL with Power Query Welcome.
Introductions Trevor Gilchrist, CPA, CMA Technology Solution Professional Specialty: Microsoft Dynamics AX Technology Services.
Microsoft Power Query 101 Belinda Allen Smith & Allen Consulting, Inc.
Give us a call or at: (856) x 111, SharePoint is the place to share ideas, content and the vision of your company.
Data Platform and Analytics Foundational Training
Getting started with Power BI
Getting Started with Power Query
07 | Analyzing Big Data with Excel
Welcome! Power BI User Group (PUG)
Business Intelligence for Project Server/Online
SAP LUMIRA Jeffrey Hook Giovanni Navarro Mason Wong Michelle Zuckerman.
Sandy Rivas | Program Manager
Linda Nguyen, John Swinehart, Yiwen (Cathy) Sun, Nargiza Nosirova
Welcome! Power BI User Group (PUG)
Power Query Discovery and connectivity to a wide range of data sources
Delivering an End-to-End Business Intelligence Solution
Alex Kelly | Program Manager
TechEd /23/2019 9:35 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks.
Presentation transcript:

Self-Service Data Integration with Power Query Stéphane Fréchette

Who am I? My name is Stéphane Fréchette SQL Server MVP | Data & Business Intelligence Solutions Architect | Consultant | Speaker | Big Data | NoSQL | Data Science. Drums, good food and fine wine. Founder I have a passion for architecting, designing and building solutions that matter. Twitter: Blog: stephanefrechette.comstephanefrechette.com SQLSaturday Boston #364

Topics  What is Power Query?  Who should use Power Query?  Power BI Designer...  Sources, Transformations and Destinations - “ETL”  Power Query Formula Language (M)  Demos  Resources  Q&A SQLSaturday Boston #364

Self-Service Data Integration 46% “engaging in self-service tasks” 26% “planning to do so in the future” Source: BI Survey BARC’s annual survey of over 3,000 business intelligence professionals SQLSaturday Boston #364

Challenges with Data Discovery Exploring, finding and connecting to data is somewhat difficult Data often needs to be cleansed and reshaped before being consumed and analyzed Any shaping is one-off and sometimes not repeatable Combining and merging data from multiple sources is not an easy task Volume, Velocity, Variety and Variability… (Big Data) SQLSaturday Boston #364

Enable self-service data discovery, query, transformation and mashup experiences for Information Workers, via Excel and PowerPivot Discovery and connectivity to a wide range of data sources, spanning volume as well as variety of data. Highly interactive and intuitive experience for rapidly and iteratively building queries over any data source, any size. Consistency of experience, and parity of query capabilities over all data sources. Joins across different data sources; ability to create custom views over data that can then be shared with team/department. What is Power Query? SQLSaturday Boston #364

What is Power Query? Discover, combine, and refine Big Data, small data, and any data!  An Excel add-in for Excel 2010 and Excel 2013  Identify and import external data  Discover relevant data by using search  Combine and transform multiple data sources  Power Query Language M SQLSaturday Boston #364

Who should use Power Query? Data Wranglers  Harmonizes and rationalizes data  Brings together and creates meaning out of data Data Stewards  Ensures data standards and cohesion  Develops and enforces policies Power Analysts  Develops dashboards and interactive reports  Uses data models Collaborative Users  Adds perspective based on their business knowledge Everyone should use it! SQLSaturday Boston #364

Power Query  Connectors (Data Sources)  Transformations (GUI)  Power Query Formula Language (M)  Saving and Sharing Queries SQLSaturday Boston #364

Data Sources Windows Azure Marketplace Azure SQL Database Azure HDInsight SQLSaturday Boston #364

Transformations SQLSaturday Boston #364

Power Query Formula Language (M)  Informally known as “M”  Functional Language similar to F#  A superset of the Excel formula language  Flexible, can be invoke dynamically  Familiar, easy to remember  Note to self: case sensitive SQLSaturday Boston #364

Saving and Sharing Queries Share Queries and Functions  Requires Office 365 and Power BI Accessible through “Online Search”  Query copied and executed locally  No server-side execution Data Steward  Monitor usage  Certify queries  Evangelize SQLSaturday Boston #364

Demo [Wrangling some data… and more!] SQLSaturday Boston #364

Enabling, Supporting Self-Service From Corporate to Self-Service BI, providing data;  Use Views  Use Natural (Business) Keys  Data Warehouse, Data Marts and OLTP… expose them!  Keep complex transforms centralized, self-service for simple ones  Metadata Repository  Classify Sources  Data Stewards SQLSaturday Boston #364

Power Query vs. SSIS SQL Server Integration Services To industrialize data integration, focusing on development and scalability Developer  Visual IDE – Source Control  Extensibility  Fine tuning  Automation Power Query To help end users create and share easily “self-service ETL” Business User Document centric Exploration Real-time, WYSYWYG Easy to learn Collaborative SQLSaturday Boston #364

Oh, But Wait… There’s More!

What is Power BI Designer? A stand-alone tool providing rich data transformation and visual analytics in a unified, seamless experience  Currently in Preview - Free download  Connect to all you data  Visual analytics and reports  Transform and clean data  Complete analytics life-cycle  Design once, view everywhere SQLSaturday Boston #364

Demo [Power BI Designer] SQLSaturday Boston #364

Summary Power Query provides users with the ability to extract data that previously seemed impossible without a large IT footprint. Once extracted, Power Query can easily manipulate data through many simple transformation commands that can be done with ease. Gives us the ability to get new data sources into a familiar environment where we can further analyze and create beautiful data visualization. SQLSaturday Boston #364

Resources  [Download] Microsoft Power Query for Excel  Microsoft Power Query for Excel Help  [Book] Power Query for Power BI and Excel  Microsoft Power BI  Power BI Preview  Channel 9 (Power Query)  Faster Insights to Data with Power BI Jump Start (MVA)  Chris Webb’s BI Blog  Reza Rad’s Technical Blog  Twitter: SQLSaturday Boston #364

What Questions Do You Have? SQLSaturday Boston #364

Thank You For attending this session SQLSaturday Boston #364