An Introduction to the magical world of BIML!

Slides:



Advertisements
Similar presentations
Creating a Meta Data Driven SSIS Solution with Biml
Advertisements

Copyright © 2013 Varigence, Inc. Biml - Introduction Session Peter Avenant
WPSM Programming Language A simple language that transform simple data structure into complex xML format Wai Y. Wong Peter Chen Seema Gupta Miqdad Mohammed.
Copyright © 2013 Varigence, Inc. CSV files import automation Kostya Khomyakov
XML Primer. 2 History: SGML vs. HTML vs. XML SGML (1960) XML(1996) HTML(1990) XHTML(2000)
Chapter 7 Managing Data Sources. ASP.NET 2.0, Third Edition2.
SQL Server Management Studio Introduction
UFCEKG-20-2 Data, Schemas & Applications Lecture 4 Server Side Scripting & PHP.
 Introduction  What is LINQ  Syntax  How to Query  Example Program.
Integrating XML with Microsoft SQL Server ©NIITeXtensible Markup Language/Lesson 9/Slide 1 of 31 Objectives In this lesson, you will learn to: * Generate.
What’s New in SSIS with SQL 2008 Bret Stateham Training Manager Vortex Learning Solutions blogs.netconnex.com.
Lesley Bross, August 29, 2010 ArcGIS 10 add-in glossary.
Oracle9 i JDeveloper for Database Developers and DBAs Brian Fry Principal Product Manager Oracle JDeveloper Oracle Corporation.
NetTech Solutions Working with Web Elements Lesson 6.
Using JavaBeans and Custom Tags in JSP Lesson 3B / Slide 1 of 37 J2EE Web Components Pre-assessment Questions 1.The _____________ attribute of a JSP page.
By: Matt Batalon, MCITP  Another form of temporary storage that can be queried or joined against, much like a table variable, temp.
Data Management Console Synonym Editor
VB and C# Programming Basics. Overview Basic operations String processing Date processing Control structures Functions and subroutines.
Controlling Computers with Programs When you create a computer program you are creating a set of instructions that tell the computer exactly and completely.
Visual Studio 2012: A Complete IDE (Debugging & Source Control) Kevin Howell.
Metadata-driven Automatic Package Creation with Notes from the field.
XML Extensible Markup Language
Easy ETL with Thank you to our AWESOME sponsors!
Easy ETL with Andrzej Kukuła – Marcin Szeliga –
Copyright 2015 Varigence, Inc. Unit and Integration Testing in SSIS A New Approach Scott @varigence.
E Copyright © 2006, Oracle. All rights reserved. Using SQL Developer.
Biml Recipes: Automatically Create T-SQL Scripts for Common Tasks
Building Your ETL Framework with Biml Meagan Longoria March 19, 2016.
XML Databases Presented By: Pardeep MT15042 Anurag Goel MT15006.
PROJECT ORIENTED ONLINE TRAINING ON MSBI (IS,AS,RS)
Advanced BIML topics Be a W.I.S.E. A.S.S. Me ! Self-employed BI consultant Author Trainer MCT
9/24/2017 7:27 AM © Microsoft Corporation. All rights reserved. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN.
Moving Data from Oracle to SQL with Biml
Building Enterprise Applications Using Visual Studio®
SSIS Templates, Configurations & Variables
BIML: Step by Step Julie Smith.
Presented By: Jessica M. Moss
Visual Studio 2010 Database Projects
Getting Started with Biml
How to move a ton of data from the mainframe to the cloud with BIML
Report Builder as Self Service BI Solution
Efficiently Searching Schema in SQL Server
Andrzej Kukuła Easy ETL with and SSIS.
Course Name: QTP Trainer: Laxmi Duration: 25 Hrs Session: Daily 1 Hr.
Using Biml to Automate the Generation of SSIS Packages
Introduction to BIML & Bimlscript
Chapter 23 – ASP.NET Outline 23.1 Introduction NET Overview
Populating a Data Warehouse
Populating a Data Warehouse
Populating a Data Warehouse
Simon Kingaby #SimonKingaby
Implementing Data Models & Reports with Microsoft SQL Server
Microsoft Ignite NZ October 2016 SKYCITY, Auckland.
Automating SSIS Design Patterns with Biml
Populating a Data Warehouse
Populating a Data Warehouse
Orchestration and data movement with Azure Data Factory v2
Introduction to .NetTiers
Populating a Data Warehouse
SSIS Deployment Smackdown!
ETL Automation using Biml
SSDT and Database Project Basics
Make Your PACKAGES Communicate BETTER
Using Biml to Automate the Generation of SSIS Packages
SSIS Data Integration Data Warehouse Acceleration
SSIS Data Integration Data Warehouse Acceleration
SSIS Data Integration Data Warehouse Acceleration
Improving the Performance of Functions
Optimizing the ETL Development process using BIML
Presentation transcript:

An Introduction to the magical world of BIML! Jonathan Stewart

An Introduction to… The magical world of Biml! http://www.starseeds.net/photo/magical-world

Agradecimiento a los patrocinadores Premium Silver Personal

Business Intelligence Consultant Jonathan Stewart Business Intelligence Consultant @sqllocks jonathan.stewart@sqllocks.net

Agenda History Problems solved by Biml Biml Basics Biml Script Reusability Where to learn more!

CEO of Varigence and Creator of Biml Scott Currie CEO of Varigence and Creator of Biml

What is it?

Business Intelligence Markup Language XML Based Can be used to create SSIS packages, SSAS cubes and SQL Server DDL (Databases, Tables, Columns, Views, Etc).

What problems can Biml Help you solve?

Tedium

Repetition and limited reuse

Inconsistency

The super quick xml primer

The basic xml statement… <root> < parent name="Goku" age="37"> <child name="Gohan" age="17" SuperSaiynLevel=”3”/></child> <child name="Goten" age="6" SuperSaiynLevel=”1”></child> </parent> </ root >

The basic xml statement… <root> < parent name="Goku" age="37"> <child name="Gohan" age="17" SuperSaiynLevel=”3”></child> <child name="Goten" age="6" SuperSaiynLevel=”1”></child> </parent> </ root >

The basic xml statement… <root> < parent name="Goku" age="37"> <child name="Gohan" age="17" SuperSaiynLevel=”3”></child> <child name="Goten" age="6" SuperSaiynLevel=”1”></child> </parent> </ root >

The basic xml statement… <root> < parent name="Goku" age="37"> <child name="Gohan" age="17" SuperSaiynLevel=”3”></child> <child name="Goten" age="6" SuperSaiynLevel=”1”></child> </parent> </ root >

The basic xml statement… <root> < parent name="Goku" age="37"> <child name="Gohan" age="17" SuperSaiynLevel=”3”></child> <child name="Goten" age="6" SuperSaiynLevel=”1”></child> </parent> </ root >

The basic xml statement… <root> < parent name="Goku" age="37"> <child name="Gohan" age="17" SuperSaiynLevel=”3”></child> <child name="Goten" age="6" SuperSaiynLevel=”1”></child> </parent> </ root >

The basic Biml syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <Package Name="Package1"></Package> <Package Name="Package2"/> </Packages> </Biml>

The basic Biml syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <Package Name="Package1"></Package> <Package Name="Package2"/> </Packages> </Biml>

The basic Biml syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <Package Name="Package1"></Package> <Package Name="Package2"/> </Packages> </Biml>

The basic Biml syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <Package Name="Package1"></Package> <Package Name="Package2"/> </Packages> </Biml>

The basic Biml syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <Package Name="Package1"></Package> <Package Name="Package2"/> </Packages> </Biml>

Biml and XML similarities Reeves Smith, Andy Leonard

What do we need to get started?

How does it work?

How does it work?

Root types (AKA Elements) Connection Packages Databases Script Projects Schemas Cubes Tables Principals Dimensions Facts

Biml Script Allows you to extend Biml with C# or VB. Allows all of the configurable magic that you’ve come to expect. Begins and ends with delimiters.

The Basic BimlScript syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <# for (int i = 1; i <= 5, i++) { #> <Package Name="MyPackage<#=i#>" ConstraintMode=“Linear”> </Package> <# } #> </Packages> </Biml>

The Basic BimlScript syntax <Biml xmlns="http://schemas.varigence.com/biml.xsd"> <Packages> <# for (int i = 1; i <= 5, i++) { #> <Package Name="MyPackage<#=i#>" ConstraintMode=“Linear”> </Package> <# } #> </Packages> </Biml>

Directives Two main type of directives: Template - <#@ template language=“C#” #> Import - <# import namespace=“Varigence.Languages.Biml.Connection” #> Other directives: Annotation Import Target Assembly Output Dependency Property

Delimiters <#@ #> Directives <# #> Standard Control Block <# #> Standard Control Block <#= #> Expression Control Block <#+ #> Class Feature Control Block

Standard Control blocks Defines .NET code commonly referred to as Biml Script or Code Nuggets. <# for (int i = 1; i <= 5; i++) { #>

Expression control blocks Evaluates the .NET code, converts it to a string, then embeds it in the Biml file. <#= UppercaseFirst("hello world") #>

Class feature control blocks Defines properties, methods, and files that are excluded from the Biml file but may be accessed by other BimlScript code nuggets.

?

How to reuse Biml files Tiered Biml files Include files CallBimlScript using parameters

Tiered Biml Files Uses the template directive with the following syntax: <#@ template language=”C# or VB” tier=”tier number” #> Used when requiring objects from a previous file to enforce order. Files from the same tier will compile in any order. Root Node

<#@ include file=”ImportedBimlFile.biml” #> Include Directives Include directives allow you to import other Biml files. <#@ include file=”ImportedBimlFile.biml” #>

CallBimlScript using parameters Like a stored procedure! Or Method/Function (if you are a programmer ) Callee Script to be called Caller Active script

Callee

Caller

BimlFy-ing your current SSIS packages How do you get your current SSIS packages into Biml? Biml Online!

Where to learn more… Varigence BimlScript Samples - https://varigence.com/Documentation/Samples/Biml/ Forums - https://www.varigence.com/Forums?forumName=Biml Documentation - https://www.varigence.com/Documentation/Language/Index BimlScript Intros/Tutorials - http://bimlscript.com Quick Reference - http://bimlscript.com/Develop/Resources Walkthroughs - http://www.bimlscript.com/#home/category/walkthrough Cathrine Wilhelmsen - http://www.cathrinewilhelmsen.net Stairway to BIML- http://www.sqlservercentral.com/stairway/100550/ BIML Academy - http://biml.academy

Questions

Business Intelligence Consultant Jonathan Stewart Business Intelligence Consultant @sqllocks jonathan.stewart@sqllocks.net