1. Alignment-based Precision Checking A. Adriansyah 1, J. Munoz Gamma 2, J. Carmona 2, B.F. van Dongen 1, W.M.P. van der Aalst 1 Tallinn, 3 September 2012 1)Department of Mathematics and Computer Science, Eindhoven University of Technology, The Netherlands 2)Software Department, Universitat Politècnica de Catalunya, Spain

2. Model needs to be precise 1 Event Log Process Models ad a b b c end c ab d aabd abd acd aabd c a d Unfitting How to measure precision for unfitting event logs? d

3. Overview 2 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Alignment Precision Metrics

4. Optimal alignment: least #deviations 3 ad a b b c end Trace adab a Alignment d b aa b a d Process Model Fitting trace, closest to the original Deviation Log Moves Model Moves aabd Reference: W.M.P. van der Aalst, A. Adriansyah, B.F. van Dongen (2012). Replaying history on process models for conformance checking and performance analysis. WIREs Data Mining and Knowledge Discovery, 2(2), 182-192.

5. Optimal alignments can be many 4 ad a b b c end Trace ad Alignment 1Alignment 2 Process Model b a ad d c a ad d Both alignments are optimal abd or acd

6. Overview 5 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments Precision Metrics aabd acd … Fitting Traces Alignment

7. a b b a d 2 44 2 22 d 2 aabd abd abd or acd aabd 1-Alignment automaton (Prefix-based) 6 Fitting Traces ad a b b c end Process Model 1-Align Automaton aabd abd aabd

8. b d b a a d 44 2 22 1-Alignment automaton (Prefix-based) 7 0 c Fitting Traces ad a b b c end Process Model 1-Align Automaton aabd abd aabd Imprecision 22 … …

9. a 2 2 3 d b 1.5 1 1 b 1a d 3 All-Alignment Automaton (Prefix-based) 8 c Fitting Traces ad a b b c end Process Model All-Alignments Automaton aabd abd abd or acd aabd 1 1 0.5 d 44 2 22

10. Comparison of log automata 9 aabd abd ad adab Event Log ad a b b c end Process Model Without alignment 1-Align All-Align Prefix-based Log Automata aabd abd abd/acd aabd Fitting Traces

11. Overview 10 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Alignment Precision Metrics Reference: J. Muñoz-Gama, J. Carmona (2010). A Fresh Look at Precision in Process Conformance. 8 th International Conference of Business Process Management (BPM): 211-226.

12. Overview 11 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Precision Metrics Alignment

13. Implementation in ProM 6 Package: “ETConformance” 12

14. Experiment settings 13 Event Log Flower (F) Precise (P) Flower’ (F’) Precise’ (P’) Duplicate LogCombined Log Precise-Precise (PP’) Precise-Flower (PF’) Flower -Precise (FP’) Flower-Flower (FF’)

15. Experiment 1: Measuring precision stability 14 Perfectly fitting logs and models Non-fitting logs and models P FP’ PF’ PP’ F P FF’ FP’ PF’ PP’

16. Experiment 2: Sensitivity to unfitting trace 15 Model P Precision #Removed events Model PF’ Precision #Removed events Precision #Removed events Model FP’ Precision #Removed events Model PP’

17. Experiment 3: Real life cases 16

18. Overview 17 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Precision Metrics Alignment

19. Conclusion and Future Work 18

20. Questions 19

21. Thanks! 20