Marcelo R.N. Mendes

What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems; Main Characteristics: Flexible; Independent of particular workloads; Not bound to any specific CEP product; Scalable. 2CISUC, University of Coimbra

FINCoS: Architecture 3CISUC, University of Coimbra

FINCoS: Components Driver Simulates external sources of events; Submits load to the SUT; Includes data generation mechanism; Sink Receives query results from CEP engine; Stores output events in log files for subsequent validation. 4CISUC, University of Coimbra

FINCoS: Components Controller Main Interface with the user. Allows to: Create reusable test setups; Control Drivers and Sinks (e.g., load, start, stop); Alter workload parameters on-the- fly (e.g., event submission rates, switch phases) 5CISUC, University of Coimbra

FINCoS: Components Performance Monitor Collect Metrics of Performance Runs Two Modes: Online (integrated into FINCoS Controller); Offline (log files). 6CISUC, University of Coimbra

Lesson 1: Creating a Test Setup 1. Configure a Driver 1. Decomposable Workload 2. Synthetic vs. Thirdy-Party Dataset 3. Data Generation Options 4. Event Arrival Process 2. Configure a Sink July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - unique identifier number of threads used for load generation save generated data to disk? to where Driver send the events machine that hosts the Driver

July, 2012CISUC, University of Coimbra - Workload can be split in independent phases

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Chooses the type of workload for this phase Sets events arrival process Event Mix Events are generated in a ordered way When data generation happens To ensure repeatability…

July, 2012CISUC, University of Coimbra - Configure event types…

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Configure Event Type Schema

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Column Name

July, 2012CISUC, University of Coimbra - Column Type

July, 2012CISUC, University of Coimbra - Data Generation Options

July, 2012CISUC, University of Coimbra - Add Values

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - unique identifier List of event types this Sink subscribes to from where Sink receive events machine that hosts the Sink save generated data to disk?

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Done!

Lesson 2: Configuring a new Connection 1. Configure a reusable connection with a CEP engine or JMS Provider July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - unique identifier name of the CEP engine (out-of-the-box support for Esper) Properties used to connect with the CEP engine type of the connection

July, 2012CISUC, University of Coimbra - * supporting new CEP engines requires coding

July, 2012CISUC, University of Coimbra - Done!

Lesson 3: Running Tests 1. Load Drivers and Sinks 2. Start Load Submission 3. Control Load Submission NOTE: At this point the following steps must have been completed: 1. Creation of a test setup; 2. Initialization of the FINCoS Daemon Service at the machines where Drivers and Sinks are intended to run; July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Load components

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Start Load Submission

July, 2012CISUC, University of Coimbra - Sent/Received counts

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

Lesson 4: Collecting Performance Metrics 1. Online Performance Measurement 1. During tests 2. Offline Performance Measurement 1. After test completion, use FINCoS Performance Monitor to process log files July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

Lesson 4: Collecting Performance Metrics (...cont) 1. Online Performance Measurement 1. During tests 2. Offline Performance Measurement 1. After test completion, use FINCoS Performance Monitor to process log files July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Configure M.I. here: Optionally, save collected metrics to a file

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra - Select the stream

July, 2012CISUC, University of Coimbra - Select the metric

July, 2012CISUC, University of Coimbra - Select exhibition scale

July, 2012CISUC, University of Coimbra - Add Metrics to the Chart

July, 2012CISUC, University of Coimbra - Change Visualization Options

Lesson 5: Setting Test Options 1. Response Time Measurement July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

July, 2012CISUC, University of Coimbra -

Response Time Measurement Mode July, 2012CISUC, University of Coimbra - DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send 1 1

Response Time Measurement Mode July, 2012CISUC, University of Coimbra - DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send Δt = t4 – t1 End-to-end: From Driver up to Sink

Response Time Measurement Mode July, 2012CISUC, University of Coimbra - DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send Δt = t3 – t2 Process Time: From immediately before the input event is forwarded to CEP engine to immediately after the result is received

Download and Feedback FINCoS is available at: Any suggestions or bug reports: July, 2012CISUC, University of Coimbra -