1. Marcelo R.N. Mendes

2. What is FINCoS? A Java-based set of tools for data generation, load submission, and performance measurement of event processing systems; Main Characteristics: Flexible; Independent of particular workloads; Not bound to any specific CEP product; Scalable. 2CISUC, University of Coimbra - mnunes@dei.uc.ptOctober, 2012

3. FINCoS: Architecture 3CISUC, University of Coimbra - mnunes@dei.uc.ptOctober, 2012

4. FINCoS: Components Driver Simulates external sources of events; Submits load to the SUT; Includes data generation mechanism; Sink Receives query results from CEP engine; Stores output events in log files for subsequent validation. 4CISUC, University of Coimbra - mnunes@dei.uc.ptOctober, 2012

5. FINCoS: Components Controller Main Interface with the user. Allows to: Create reusable test setups; Control Drivers and Sinks (e.g., load, start, stop); Alter workload parameters on-the- fly (e.g., event submission rates, switch phases) 5CISUC, University of Coimbra - mnunes@dei.uc.ptOctober, 2012

6. FINCoS: Components Performance Monitor Collect Metrics of Performance Runs Two Modes: Online (integrated into FINCoS Controller); Offline (log files). 6CISUC, University of Coimbra - mnunes@dei.uc.ptOctober, 2012

7. Lesson 1: Creating a Test Setup 1. Configure a Driver 1. Decomposable Workload 2. Synthetic vs. Thirdy-Party Dataset 3. Data Generation Options 4. Event Arrival Process 2. Configure a Sink October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt7

8. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt8

9. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt9

10. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt10 unique identifier number of threads used for load generation save generated data to disk? to where Driver send the events machine that hosts the Driver

11. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt11 Workload can be split in independent phases

12. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt12

13. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt13 Chooses the type of workload for this phase Sets events arrival process Event Mix Events are generated in a ordered way When data generation happens To ensure repeatability…

14. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt14 Configure event types…

15. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt15

16. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt16

17. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt17 Configure Event Type Schema

18. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt18

19. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt19

20. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt20 Column Name

21. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt21 Column Type

22. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt22 Data Generation Options

23. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt23 Add Values

24. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt24

25. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt25

26. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt26

27. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt27

28. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt28

29. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt29

30. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt30

31. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt31

32. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt32

33. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt33

34. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt34

35. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt35

36. October, 2012 CISUC, University of Coimbra - mnunes@dei.uc.pt36 Path for data file. Character used to separate the fields of the records in the data file Timestamp options Type options Fields order Number of times the data in the file must be submitted Controls event submission speed

37. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt37

38. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt38

39. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt39

40. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt40

41. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt41 unique identifier List of event types this Sink subscribes to from where Sink receive events machine that hosts the Sink save generated data to disk?

42. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt42

43. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt43

44. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt44

45. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt45 Done!

46. Lesson 2: Configuring a new Connection 1. Configure a reusable connection with a CEP engine or JMS Provider October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt46

47. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt47

48. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt48

49. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt49

50. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt50 unique identifier name of the CEP engine (out-of-the-box support for Esper) Properties used to connect with the CEP engine type of the connection

51. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt51 * supporting new CEP engines requires coding

52. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt52 Done!

53. Lesson 3: Running Tests 1. Load Drivers and Sinks 2. Start Load Submission 3. Control Load Submission NOTE: At this point the following steps must have been completed: 1. Creation of a test setup; 2. Initialization of the FINCoS Daemon Service at the machines where Drivers and Sinks are intended to run; October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt53

54. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt54 Load components

55. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt55

56. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt56 Start Load Submission

57. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt57 Sent/Received counts

58. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt58

59. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt59

60. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt60

61. Lesson 4: Collecting Performance Metrics 1. Online Performance Measurement 1. During tests 2. Offline Performance Measurement 1. After test completion, use FINCoS Performance Monitor to process log files October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt61

62. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt62

63. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt63

64. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt64

65. Lesson 4: Collecting Performance Metrics (...cont) 1. Online Performance Measurement 1. During tests 2. Offline Performance Measurement 1. After test completion, use FINCoS Performance Monitor to process log files October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt65

66. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt66

67. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt67

68. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt68 Configure M.I. here: Optionally, save collected metrics to a file

69. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt69

70. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt70 Select the stream

71. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt71 Select the metric

72. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt72 Select exhibition scale

73. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt73 Add Metrics to the Chart

74. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt74 Change Visualization Options

75. Lesson 5: Setting Test Options 1. Response Time Measurement October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt75

76. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt76

77. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt77

78. October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt78

79. Response Time Measurement Mode October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt79 DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER 2 2 3 3 4 4 send convert input convert output process input forward generate result forward send 1 1

80. Response Time Measurement Mode October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt80 DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send Δt = t4 – t1 End-to-end: From Driver up to Sink 2 2 3 3 4 4 1 1

81. Response Time Measurement Mode October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt81 DRIVER CEP ENGINE CEP ENGINE SINK ADAPTER send convert input convert output process input forward generate result forward send Δt = t3 – t2 Process Time: From immediately before the input event is forwarded to CEP engine to immediately after the result is received. 2 2 3 3 4 4 1 1

82. Download and Feedback FINCoS is available at: http://code.google.com/p/fincos/ Any suggestions or bug reports: mnunes@dei.uc.pt October, 2012CISUC, University of Coimbra - mnunes@dei.uc.pt82