Alignment-based Precision Checking A. Adriansyah 1, J. Munoz Gamma 2, J. Carmona 2, B.F. van Dongen 1, W.M.P. van der Aalst 1 Tallinn, 3 September )Department of Mathematics and Computer Science, Eindhoven University of Technology, The Netherlands 2)Software Department, Universitat Politècnica de Catalunya, Spain
Model needs to be precise 1 Event Log Process Models ad a b b c end c ab d aabd abd acd aabd c a d Unfitting How to measure precision for unfitting event logs? d
Overview 2 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Alignment Precision Metrics
Optimal alignment: least #deviations 3 ad a b b c end Trace adab a Alignment d b aa b a d Process Model Fitting trace, closest to the original Deviation Log Moves Model Moves aabd Reference: W.M.P. van der Aalst, A. Adriansyah, B.F. van Dongen (2012). Replaying history on process models for conformance checking and performance analysis. WIREs Data Mining and Knowledge Discovery, 2(2),
Optimal alignments can be many 4 ad a b b c end Trace ad Alignment 1Alignment 2 Process Model b a ad d c a ad d Both alignments are optimal abd or acd
Overview 5 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments Precision Metrics aabd acd … Fitting Traces Alignment
a b b a d d 2 aabd abd abd or acd aabd 1-Alignment automaton (Prefix-based) 6 Fitting Traces ad a b b c end Process Model 1-Align Automaton aabd abd aabd
b d b a a d Alignment automaton (Prefix-based) 7 0 c Fitting Traces ad a b b c end Process Model 1-Align Automaton aabd abd aabd Imprecision 22 … …
a d b b 1a d 3 All-Alignment Automaton (Prefix-based) 8 c Fitting Traces ad a b b c end Process Model All-Alignments Automaton aabd abd abd or acd aabd d
Comparison of log automata 9 aabd abd ad adab Event Log ad a b b c end Process Model Without alignment 1-Align All-Align Prefix-based Log Automata aabd abd abd/acd aabd Fitting Traces
Overview 10 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Alignment Precision Metrics Reference: J. Muñoz-Gama, J. Carmona (2010). A Fresh Look at Precision in Process Conformance. 8 th International Conference of Business Process Management (BPM):
Overview 11 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Precision Metrics Alignment
Implementation in ProM 6 Package: “ETConformance” 12
Experiment settings 13 Event Log Flower (F) Precise (P) Flower’ (F’) Precise’ (P’) Duplicate LogCombined Log Precise-Precise (PP’) Precise-Flower (PF’) Flower -Precise (FP’) Flower-Flower (FF’)
Experiment 1: Measuring precision stability 14 Perfectly fitting logs and models Non-fitting logs and models P FP’ PF’ PP’ F P FF’ FP’ PF’ PP’
Experiment 2: Sensitivity to unfitting trace 15 Model P Precision #Removed events Model PF’ Precision #Removed events Precision #Removed events Model FP’ Precision #Removed events Model PP’
Experiment 3: Real life cases 16
Overview 17 aabbd adabd a d … Unfitting Log Process Model Alignment Automaton Experiments aabd acd … Fitting Traces Precision Metrics Alignment
Conclusion and Future Work 18
Questions 19
Thanks! 20