Module 6: Creating Pipelines

Overview Lesson 1: Introduction to Pipelines Lesson 2: Building a Pipeline

Lesson 1: Introduction to Pipelines What Is a Pipeline? Pipeline Scenarios Receive Pipeline Stages Send Pipeline Stages Pipeline Components What Are the Default Pipelines? What Are Custom Pipeline Components? Types of Pipeline Components

Receive Pipeline Send Pipeline Orchestration What Is a Pipeline? Pipeline Components Use pipelines to: Normalize data from various formats to XML Translate data from XML to various formats Assemble and disassemble documents Decode and encode documents Decrypt and encrypt documents Assign and verify digital signatures Normalize data from various formats to XML Translate data from XML to various formats Assemble and disassemble documents Decode and encode documents Decrypt and encrypt documents Assign and verify digital signatures

Pipeline Scenarios Receive Pipelines: Decrypt inbound messages from trading partners Split batched messages Validate messages against known schemas Verify the sender of a message for non- repudiation Create custom processors to extend built-in functionality Decrypt inbound messages from trading partners Split batched messages Validate messages against known schemas Verify the sender of a message for non- repudiation Create custom processors to extend built-in functionality Send Pipelines: Encrypt outbound messages to trading partners Digitally sign outbound messages Provide a wrapper for outbound messages Validate messages against known schemas Encrypt outbound messages to trading partners Digitally sign outbound messages Provide a wrapper for outbound messages Validate messages against known schemas

Receive Pipeline Stages Decode Drop Here! ! Disassemble Drop Here! ! Resolve Party Validate Drop Here! ! Drop Here! ! Disassemble Use to parse or disassemble components Use to probe messages and verify context properties BizTalk Server includes an XML, flat file, and a BTF disassembler Use to parse or disassemble components Use to probe messages and verify context properties BizTalk Server includes an XML, flat file, and a BTF disassembler Validate Use to validate the format of an XML message Use to compare a message to a known schema Use to validate the format of an XML message Use to compare a message to a known schema Resolve Party Use to verify the sending party for a received message Use with public certificates to validate sender Use to verify the sending party for a received message Use with public certificates to validate sender Decode Use to decode or decrypt messages Use when secure document exchange is required BizTalk includes a MIME/SMIME Decoder Use to decode or decrypt messages Use when secure document exchange is required BizTalk includes a MIME/SMIME Decoder

Send Pipeline Stages Drop Here! ! Pre-Assemble Drop Here! ! ! AssembleEncode Pre-assemble Use to process a message before it is sent Use for custom components only Use to process a message before it is sent Use for custom components only Assemble Use to assemble or serialize a message Use to convert a message from XML to native format Use to assemble or serialize a message Use to convert a message from XML to native format Encode To encode or encrypt messages Use when secure document exchange is required BizTalk includes a MIME/SMIME decoder To encode or encrypt messages Use when secure document exchange is required BizTalk includes a MIME/SMIME decoder

Pipeline Components Built-in pipeline components XML assembler/disassembler Flat File assembler/disassembler MIME/SMIME encoding and decoding XML validation Party resolution XML assembler/disassembler Flat File assembler/disassembler MIME/SMIME encoding and decoding XML validation Party resolution A pipeline component defines a processing action Numerous pipeline components ship with BizTalk Server You can write custom pipeline components Numerous pipeline components ship with BizTalk Server You can write custom pipeline components

What Are the Default Pipelines? PipelineUsage Pass-Through Receive (PassThruReceive) Contains no components No decoding, disassembling, or validation required Pass-Through Send (PassThruTransmit) Contains no components No encoding or assembling required Use for basic message routing XML Receive (XMLReceive) Contains the XML disassembler component Party resolution component for security No decoding or validation stage XML Send (XMLTransmit) Contains the XML assembler component Other stages empty by default

What Are Custom Pipeline Components? Use Scenarios Non-XML validations Non-supported decryption algorithms Non-supported signature formats Custom data conversions Advanced routing requirements Specialized processing Non-XML validations Non-supported decryption algorithms Non-supported signature formats Custom data conversions Advanced routing requirements Specialized processing Custom Pipeline Components Use to extend message processing capabilities Use when standard pipeline components are not sufficient Use to extend message processing capabilities Use when standard pipeline components are not sufficient

Types of Pipeline Components Interfaces IBaseComponent IComponent IComponentUI IPersistPropertyBag IBaseComponent IComponent IComponentUI IPersistPropertyBag Promoting a Distinguished Field msg.Context.Write("ItemDescription", " “X-Ray machine"); Promoting a Property Field msg.Context.Promote("OrderTotal", " “ "); Three types of components General Assembling Disassembling General Assembling Disassembling

Lesson 2: Building a Pipeline Using the Pipeline Designer Securing Data by Using a Pipeline Processing Interchanges by Using a Pipeline Creating Schemas for Interchange Processing Testing an Envelope Schema Demonstration: Creating and Testing a Pipeline

Using the Pipeline Designer Pipeline Files Properties Window Design Surface Toolbox

Securing Data by Using a Pipeline Pipeline MIME/SMIME Encoder Component Message MIME/SMIME Encoder Use for secure exchange of messages Can use to encode, sign, and encrypt Supports multi-part messages Use for secure exchange of messages Can use to encode, sign, and encrypt Supports multi-part messages

Processing Interchanges by Using a Pipeline May Require Multiple Schemas Header (Envelope) Body Trailer Header (Envelope) Body Trailer Interchange Processing Standard Recoverable Standard Recoverable Disassembler Properties

Flat Files Creating Schemas for Interchange Processing Sender: Contoso Recipient: AdvWorks POs Header_FF.xsd (Company, address, batch#) PurchaseOrder_FF.xsd Trailer_FF.xsd XML Files Envelope.xsd (Envelope attributes) PurchaseOrder.xsd Sender: Contoso Recipient: AdvWorks POs

Testing an Envelope Schema ToolsUsage Pipeline.exe Accepts XSD schemas and input message Produces output document FFAsm.exe Executes the flat-file assembler component FFDasm.exe Executes the flat-file disassembler component XMLAsm.exe Executes the XML assembler component XMLDasm.exe Executes the XML disassembler component

Demonstration: Creating and Testing a Pipeline In this demonstration, you will see how to: Create and configure a receive pipeline Create and configure a send pipeline Use the pipeline command-line tools

Lab: Creating Pipelines Exercise 1:Configure a Send Pipeline to Encrypt Outgoing Messages Exercise 2:Configure a Send Port to Use the Encryption Pipeline and Certificate Exercise 3:Examine the Interchange Message to Be Disassembled Exercise 4:Configure a Receive Pipeline to Disassemble a Message Interchange Exercise 5:Configure a Receive Location to Use the Pipeline Exercise 6:Submit Test Messages Exercise 7:Enable and Test Recoverable Interchange