Presentation is loading. Please wait.

Presentation is loading. Please wait.

Jorge Munoz-Gama Advisor: Josep Carmona December 2014 CONFORMANCE CHECKING AND DIAGNOSIS IN PROCESS MINING.

Similar presentations


Presentation on theme: "Jorge Munoz-Gama Advisor: Josep Carmona December 2014 CONFORMANCE CHECKING AND DIAGNOSIS IN PROCESS MINING."— Presentation transcript:

1 Jorge Munoz-Gama Advisor: Josep Carmona December 2014 CONFORMANCE CHECKING AND DIAGNOSIS IN PROCESS MINING

2 PRECISION DECOMPOSITION CONFORMANCE CHECKING CONCLUSIONS

3 PRECISION DECOMPOSITION CONFORMANCE CHECKING CONCLUSIONS

4 Conformance Checking in a Nutshell MODELREALITY PROCESS DOMAIN EXPERTS 4

5 5 Biased Vision

6 Conformance Checking in a Nutshell MODELREALITY PROCESS LOGS DOMAIN EXPERTS 6

7 Conformance Checking in a Nutshell MODELREALITY PROCESS LOGS 7

8 Conformance Checking in a Nutshell MODELREALITY PROCESS LOGS 8

9 Structure and Outline Structure of the Presentation Problem – Context – Contributions Outline of the Presentation Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking 9

10 PRECISION DECOMPOSITION CONFORMANCE CHECKING CONCLUSIONS

11 11 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

12 Problem “Low Criticality Diagnosis” Process 12 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Hospital Process-aware Information System Hospital Staff “Low Criticality Diagnosis” Process Model

13 Problem “Low Criticality Diagnosis” Process 13 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care

14 Problem “Low Criticality Diagnosis” Process 14 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Radiology Test …

15 Context The Importance of Precision A good model must be fitting but also be precise 15

16 Context Efficient and Comprehensive Approach to measure precision Based on potential points of improvement Not require an exhaustive model state-space exploration Previous works require model exploration/simulation Identify precision problems with a fine granularity Results for analysis and process improvement 16

17 Contributions Precision based on Escaping Arcs 17 MODEL BEHAVIOR LOG BEHAVIOR Exploration of the model’s behavior: costly, possibly infinite, or require simulation.

18 Contributions Precision based on Escaping Arcs 18 LOG BEHAVIOR Model behavior traversal restricted by the log behavior. Escaping arcs: points where the model allows more behavior than the one observed in the log. ESCAPING ARC

19 Compute Precision Modeled Behavior Observed Behavior log Minimal Imprecise Traces ETC Precision (etcp) 0.81 19 Contributions Outline of Precision based on Escaping Arcs a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i model a b c d e f h g i a, c, f a, c, d, f a, c, d, e, e a, c, e, d, e a, c, e, e

20 Compute Precision Modeled Behavior Observed Behavior log Minimal Imprecise Traces ETC Precision (etcp) 0.81 20 Contributions Outline of Precision based on Escaping Arcs a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i model a b c d e f h g i a, c, f a, c, d, f a, c, d, e, e a, c, e, d, e a, c, e, e

21 Contributions Observed Behavior 21 a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i a 1 1 b 1 g 1 d 1 i 1

22 Contributions Observed Behavior 22 a c b d gi i h f d e 2 2 1 1 1 1 a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i 1 1 1 1 1 1

23 Contributions Observed Behavior 23 a c b d gi i i i h h h f f f d d d e e a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i 4 4 1 1 1 1 11 1 1 1 1 1 1 1 3 2 1 1 1 1

24 Compute Precision Modeled Behavior Observed Behavior log Minimal Imprecise Traces ETC Precision (etcp) 0.81 24 Contributions Outline of Precision based on Escaping Arcs a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i model a b c d e f h g i a, c, f a, c, d, f a, c, d, e, e a, c, e, d, e a, c, e, e

25 Contributions Modeled Behavior 25 a c b d gi i i i h h h f f f d d d e e f f e e e a b c d e f h g i

26 Compute Precision Modeled Behavior Observed Behavior log Minimal Imprecise Traces ETC Precision (etcp) 0.81 26 Contributions Outline of Precision based on Escaping Arcs a, b, d, g, i a, c, d, e, f, h, i a, c, e, d, f, h, i a, c, e, f, d, h, i model a b c d e f h g i a, c, f a, c, d, f a, c, d, e, e a, c, e, d, e a, c, e, e

27 Contributions Compute Precision For each state of the automaton we take into account the weight, the observed arcs and the allowed arcs: 27 observed states weightescaping arcs allowed arcs

28 Contributions Computing Precision 28 a c b d gi i i i h h h f f f d d d e e f f e e e 4 4 1 3 2 1 1 1 111 1 1 1 11 1 11 1 1 … + 4 · 0 +… … + 4 · 2 +… 1 -

29 Contributions Computing Precision 29 a c b d gi i i i h h h f f f d d d e e f f e e e 4 4 1 3 2 1 1 1 111 1 1 1 11 1 11 1 1 … + 1 · 1 +… … + 1 · 2 +… 1 -

30 Contributions Challenges Addressed The precision based on escaping arcs does not require a complete exploration of the model behavior. Instead, the model exploration is restricted by the behavior observed in the log. Escaping arcs pinpoint the situations that need to be fixed to achieve a completely precise system. Collect imprecisions in terms of event log - Minimal Imprecise Log 30 a, c, f a, c, d, f a, c, d, e, e a, c, e, d, e a, c, e, e

31 31 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

32 Problem The Effects of Exceptional Behavior 32 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care

33 Problem The Effects of Exceptional Behavior 33 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care

34 Problem Variability of Precision in the Future 34 ETC Precision 0.81 ETC Precision ? ?? Current Moment Close Future Far Future future present

35 Problem Limited Resources and Imprecision Points 35 Hospital Process Imprecision Points Limited Analysts and Resources

36 Context Robustness, Confidence and Severity Precision based on Escaping Arcs more robust to exceptional behavior. Estimate the possible variability of the metric in the future. Asses the severity of imprecision points and compare them. 36

37 Contributions Robustness on Escaping Arcs 37 a c b d gi i i i h h h f f f d d d e e f f e e e 3199 1435 1765 946 0 0 0 0 0 818 764 54

38 Contributions Robustness on Escaping Arcs 38 a c b d gi i i i h h h f f f d d d e e f f e e e 3200 1435 1765 947 946 0 0 0 0 818 764 54 1 i h f e 0 1 1 1

39 Contributions Robustness on Escaping Arcs 39 Threshold parameter to cut exceptional behavior. Parametric threshold High cut factor for main behavior Low cut factor for extreme cases Local-context cut, not global-context cut 499 1 500 2 1 3 499 1 500 200 300 500

40 Contributions Robustness on Escaping Arcs 40 a c b d gi i i i h h h f f f d d d e e f f e e e 3200 1435 1765 947 946 0 0 0 0 818 764 54 1 i h f e 0 1 1 1 1 i h f e 0 1 1 1

41 log K Low ConfidenceHigh Confidence 41 Contributions Confidence on Escaping Arcs Metric

42 log K 42 Contributions Confidence on Escaping Arcs Metric

43 log K 43 Contributions Confidence on Escaping Arcs Metric

44 44 Contributions Upper Estimation of Precision a c b d gi i i i h h h f f f d d d e e f f e e e 3200 1435 1765 947 946 0 0 0 0 818 764 54 1 1 K = 3 Best scenario = covering escaping arcs

45 45 Contributions Upper Estimation of Precision Problem of optimization. Cover escaping arcs with the given k to maximize the metric. Cost of covering a escaping arc: the number of traces to overpass the threshold. Gain of covering a escaping arc: the weight of the state.  BIP Formulation  Upper Estimation

46 46 Contributions Lower Estimation of Precision a c b d gi i i i h h h f f f d d d e e f f e e e 3200 1435 1765 947 946 0 0 0 0 818 764 54 1 1 K = 1 Worst scenario = new escaping arcs 0 1 1 1 1 1  Lower Estimation avg A-1

47 Subjective and multifactor Weight, Alternation, Stability, Criticality 47 A AE B D CDGHFA 94 6 AFH G 1111 14 35 G DHFA 76 4 H DFA 54 81 8 94 7 32 00 17 65 0 H 0 H 0 G 0 G 0 G DHFA 76 4 H DFA 54 81 8 0 G 0 G A AE B D CDGHFA 94 6 AFH G 1111 14 35 G DHFA 76 4 H DFA 54 81 8 94 7 32 00 17 65 0 H 0 H 0 G 0 G 0 G DHFA 76 4 H DFA 54 81 8 0 G 0 G 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H 0 H All imprecisions equally important? sever mid low Contributions Severity of the Escaping Arcs

48 Escaping arcs in parts with more weight more sever 48 10000 0 7000 3000 10 0 7 3 sever Contributions Weight of an Escaping Arc

49 More chances to make a mistake more sever 49 sever Contributions Alternation of an Escaping Arc

50 Apply perturbation increase the number of instances in that point proportional to the current occurrence number Measure how easy is to overpass the threshold Imprecision stable to perturbation more sever 50 10000 0 7000 3000 10000 99 6901 3000 sever Contributions Stability of an Escaping Arc

51 Importance of the task involved in the escaping arc 51 sever Check Date Format Bank Transfer Contributions Criticality of an Escaping Arc

52 Contributions Challenges Addressed Robustness on the Precision based on Escaping Arcs. Confidence interval on the Precision metric. Severity assessment on the precision problems. 52

53 53 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

54 Problem Precision on Unfitting Scenarios 54 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care Perfect fitness is uncommon in real life

55 Contributions Unfitting Observed Behavior 55 Log Trace Model Behavior ?

56 Problem Fitness effects on Precision based on Log 56 a, a, b, b, d What state reaches the model when the trace does not fit? a b c a b d b a a 1 1 1 1 ??? Option: Not considering the unfitting part. The position of the fitting problem influences the precision.

57 Context Precision Independent of Fitness Unfitting scenarios are common in real-life Precision independent from Fitness A precision not based directly on the log but on a pre-alignment between the observed behavior and the modeled behavior. 57

58 Context Aligning Observed and Modeled Behavior 58 Log Trace Model Behavior

59 Context Aligning Observed and Modeled Behavior 59 Find the closest model trace in the model behavior for a given log trace From a global perspective Able to deal with unfitting behavior Optimal guaranteed Time-consuming problem based on A* search algorithms * Adriansyah, A.: Aligning Observed and Modeled Behavior. PhD Thesis. Eindhoven University of Technology. 2014

60 Compute Precision Modeled Behavior Observed Behavior Minimal Imprecise Traces ETC Precision (etcp) 0.81 60 Alignments ad b aa b a d Contributions Precision based on Alignments

61 Contributions Aligning Observed and Modeled Behavior 61 a b c a b d adab a ad b aa d b Log Trace Alignment Process Model

62 Contributions Aligning Observed and Modeled Behavior 62 a b c a b d Log Trace adab aabd a ad b aa d b Alignment Process Model Log Moves Model Moves Deviation Fitting trace, closest to the original

63 Contributions Aligning Observed and Modeled Behavior 63 a b c a b d Log Trace ad abd/acd a d a d Alignment 1 Process Model b a d a d Alignment 2 c Both alignments are optimal

64 Compute Precision Modeled Behavior Observed Behavior Minimal Imprecise Traces ETC Precision (etcp) 0.81 64 Alignments ad b aa b a d New weight function Contributions Precision based on Alignments

65 Contributions Observed Behavior from 1-Alignment 65 a, a, b, d a, b, d a, d, a, b a, d Event Log / a b c a b d Process Model a, a, b, d a, b, d a, a, b, d a, b, d Fitting Traces a, c, d d b b d a c 2 2 2 2 2 a 4 4

66 Contributions Observed Behavior from All-Alignment 66 a, a, b, d a, b, d a, d, a, b a, d Event Log / a b c a b d Process Model a, a, b, d a, b, d a, a, b, d a, b, d Fitting Traces a, c, d d b b d a c 2 2 2 1 1 a 3 3 0.5 d 4 4 1.5

67 Compute Precision Modeled Behavior Observed Behavior Minimal Imprecise Traces ETC Precision (etcp) 0.81 67 Alignments ad b aa b a d New weight function Contributions Precision based on Alignments

68 68 Contributions Challenges Addressed Precision based on alignments. Precision for unfitting cases. Precision independent of fitness. Precision based on 1-alignment or All-alignments.

69 Contributions Extensions to Precision based on Alignments Extensions to represent the modeled behavior. Use of Representative-alignments. Multi-sets to represent automaton states. Backwards use of the alignments. 69 b b a a b b a a a, c, d, e b, c, d, e e dc a b

70 PRECISION DECOMPOSITION CONFORMANCE CHECKING CONCLUSIONS

71 71 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

72 Problem Fitness in Large Models 72 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care

73 Problem Fitness in Large Models 73

74 Problem Fitness in Large Models 74

75 Problem Fitness in Large Models 75

76 Context Fast, Comprehensible and Guaranteed Decompose the Fitness checking problem. Comprehensible decomposition and understandable diagnosis results. Formal guarantees. There is a fitness problem on the original net iff there is a fitness problem in one or more of the components. Fast compared to the monolithic approach. 76 The decomposition preserves the fitness.

77 Contributions Alignment Fitness Checking 77 Log Trace Model Behavior

78 Contributions Decomposing Alignment Fitness Checking 78 Log Trace Model Behavior

79 Contributions Decomposition based on Graphs Based on Graph Decomposition 79 t1 t2 t3 t4 t5 t6 t7 Decomposition based on: Single-Entry Single-Exit Components (SESE) Refined Process Structure Tree (RPST) * Artem Polyvyanyy: Structuring Process Models. PhD Thesis. University of Potsdam (Germany), January 2012 * Hopcroft, J., Tarjan, R.E.: Dividing a graph into triconnected components. SIAM J. Com- put. 2(3), 1973

80 80 Contributions Interior, Boundary, Entry, and Exit nodes Entry node: boundary where no incoming edge or all outgoing edges Exit node: boundary where no outgoing edge or all incoming edges

81 Example of SESE and RPST SESE: set of edges which graph has a Single Entry node and a Single Exit node Refined Process Structure Tree (RPST) containing non overlapping SESEs Unique Modular Linear Time 81 Contributions SESE and RPST

82 Why SESE? Only one entry; only one exit Represent subprocesses within the process Intuitive for conformance diagnosis Why RPST? Partitioning over the RPST Any cut is a partitioning Algorithm to partitioning by size (k) 82 Contributions SESE and RPST

83 K<5 16 4 8 44 83 Contributions SESE and RPST Why SESE? Only one entry; only one exit Represent subprocesses within the process Intuitive for conformance diagnosis Why RPST? Partitioning over the RPST Any cut is a partitioning Algorithm to partitioning by size (k)

84 A decomposition based on SESEs preserves the fitness? Fitness Preservation: A model/log is perfectly fitting if and only if all the components are perfectly fitting 84 Contributions Preserving the Fitness

85 SESEs (per se) do not preserve fitness. 85 Contributions SESE Decomposition does not Preserve Fitness d e f p a b c p

86 SESEs (per se) do not preserve fitness. 0 tokens in pabcdefS2 is blocked 86 Contributions SESE Decomposition does not Preserve Fitness d e f p a b c p S2 S1

87 SESEs (per se) do not preserve fitness. 0 tokens in pabcdefS2 is blocked 1 token in pabcdef fits S but not S2 87 Contributions SESE Decomposition does not Preserve Fitness d e f p a b c p S2 S1

88 SESEs (per se) do not preserve fitness. 0 tokens in pabcdefS2 is blocked 1 token in pabcdef fits S but not S2 2 tokens in pabdecf fits S1 and S2 but not S 88 Contributions SESE Decomposition does not Preserve Fitness d e f p a b c p S2 S1

89 The problem is in the shared places No reflection on the log, therefore no synchronization. Valid Decomposition: a partition where only transitions are shared among components. No places neither arcs. There is a fitness problem on the original net iff there is a fitness problem in one or more of the components. 89 Contributions Valid Decomposition Theorem: Valid Decomposition preserves the fitness. * W.M.P. van der Aalst : Decomposing Petri nets for process mining: A generic approach. Distributed and Parallel Databases, 2013

90 Create a ‘bridge’ for each shared place 90 Contributions Bridging a SESE Decomposition d e f a b c b c p d e p S1’ S2’ B1 Notice that not a SESE anymore

91 Theorem: SESE decomposition with Bridging post- processing preserves the fitness. 91 Contributions SESE + Bridging Theorem SESE decomposition with Bridging is a valid decomposition.

92 Monolithic 1h 15min 92 Contributions Decomposition Fitness Results Decomposition(7) 2min

93 93 Contributions Decomposition Fitness Results

94 94 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

95 Problem Locate Fitness Problems in Large Models 95

96 Context Problematic Components More than just report the list of model components with fitness problems. Provide a structure among the components. Visualize the structure of the decomposition. Use the structure to detect conflictive components highly related. 96

97 97 Contributions Topological Fitness Checking

98 Non-Fitting (Weakly) Connected Components Non-Fitting Subnet 98 Contributions Topological Fitness Checking

99 99 Contributions Topological Fitness Checking

100 100 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological and Multi-level Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

101 Problem Fitness in Data-aware Models 101 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Home Care

102 Problem Fitness in Data-aware Models 102 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Initial Examination Allergy Test - FAIL Blood Test - PASS Radiology Test - PASS Diagnosis - HOME Home Care tests diagnosis

103 Problem Fitness in Data-aware Models 103 Large Medical Data-aware Models

104 Context Data-aware Conformance Checking Existing techniques for data-aware fitness checking are time-consuming based on A* (control-flow) + ILP (data) Decompose the data-aware fitness problem. Meaningful decomposition and diagnostic results. Formal guarantees on the fitness correctness. Fast compared with the monolithic approach. 104

105 Contributions Valid Decomposition of Data-aware Models 105 t1 t2 t3 t4 p t5 t6 t7 p No Synchronization Shared places can be out of synchronization during the fitness checking. Valid Decompositions (no places or arcs shared) preserve the fitness.

106 Contributions Valid Decomposition of Data-aware Models 106 Theorem: Valid Decomposition of Petri nets with data (no shared places, arcs, or data variables) preserves the fitness. No Synchronization t5 t6 t7 t4 data t1 t2 t3 t4 data  Details in the thesis

107 Contributions Valid Decomposition of Data-aware Models 107 Petri nets with Data are graphs. Decomposition based on SESEs for comprehensive results. t5 t6 t7 t4 data t1 t2 t3 t4 data

108 Contributions Valid Decomposition of Data-aware Models 108 Improve in the control flow + improve in the data Average number of events per event-log trace Average computation time (s) Real case: Dutch municipality From 52891 seconds to 52 seconds (99%)

109 109 Precision Precision based on the Log Qualitative Analysis of Precision Checking Precision based on Alignments Fitness Decomposition Decomposed Conformance Checking Topological and Multi-level Conformance Diagnosis Data-aware Decomposed Conformance Checking Event-based Real-time Decomposed Conformance Checking

110 Problem Real-life Monitoring of Hospital Processes 110 Hospital Processes running Large Process Model Process-aware Monitoring System Conformance Reports Conformance Alarms

111 Context Event-based, Fast, and Comprehensible Fitness real-life monitoring architecture for large process models. Based on events, not in complete traces. Real-time requires time efficiency Comprehensive results as part of the monitoring procedure. 111

112 Contributions Event-based Real-time Decomposed Fitness 112 Decomposed Model Stream of Events

113 Contributions Decomposition based on SESE 113

114 Contributions Event-based Real-time Decomposed Fitness 114 Heuristic Replay Faster compared with alignments. Consequences of bad decisions are limited to the fragment. Event based. Not optimal, but heuristic. a bc f de acf a c f ac f Log Trace Replay b Look-ahead Heuristic

115 Contributions Example of Real-time Decomposed Fitness 115

116 PRECISION DECOMPOSITION CONFORMANCE CHECKING CONCLUSIONS

117 Contributions of the Thesis Contribution Precision  Approach to quantify and analyze the precision between a log and a model based on escaping arcs.  Robustness and confidence interval for precision based on escaping arcs.  Severity assessment of the imprecision point detected.  Precision checking based on aligning observed and modeled behavior.  Abstraction and directionality in precision based on alignments. Fitness Decomposition  Decomposed conformance checking based on SESE components.  Hierarchical and topological decomposition based on SESE components for conformance diagnosis.  Decomposed conformance checking for data-aware models.  Decomposed conformance checking for real-time scenarios. 117

118 Publications of the Thesis (Precision) Jorge Munoz-Gama, Josep Carmona A Fresh Look at Precision in Process Conformance BPM 2010 – pp. 211 - 226 Jorge Munoz-Gama, Josep Carmona Enhancing precision in Process Conformance: Stability, confidence and severity. CIDM 2011 – pp. 184-191 Jorge Munoz-Gama, Josep Carmona A General Framework for Precision Checking Journal of Innovative Computing, Information and Control – vol.8 no.7B Arya Adriansyah, Jorge Munoz-Gama, Josep Carmona, Boudewijn F. van Dongen, Wil M. P. van der Aalst Alignment Based Precision Checking BPM Workshops 2012 – pp. 137-149 Arya Adriansyah, Jorge Munoz-Gama, Josep Carmona, Boudewijn F. van Dongen, Wil M. P. van der Aalst Measuring precision of modeled behavior Information Systems and e-Business Management 118

119 Publications of the Thesis (Decomposition) Jorge Munoz-Gama, Josep Carmona, Wil M. P. van der Aalst Conformance Checking in the Large: Partitioning and Topology BPM 2013 – pp. 130-145 – Best Student Paper Award Jorge Munoz-Gama, Josep Carmona, Wil M. P. van der Aalst Hierarchical Conformance Checking of Process Models Based on Event Logs Petri Nets 2013 – pp. 291-310 Jorge Munoz-Gama, Josep Carmona, Wil M. P. van der Aalst Single-Entry Single-Exit Decomposed Conformance Checking Information Systems – vol.46 pp. 102-122 Massimiliano de Leoni, Jorge Munoz-Gama, Josep Carmona and Wil M.P. van der Aalst Decomposing Conformance Checking on Petri Nets with Data CoopIS 2014 – pp. 3-20 Seppe K.L.M. vanden Broucke, Jorge Munoz-Gama, Josep Carmona, Bart Baesens and Jan Vanthienen Event-based Real-time Decomposed Conformance Analysis CoopIS 2014 – pp. 345-363 119

120 Impact of the Thesis Published in international journals and international conferences Best Student Paper Award in BPM 2013 (Acceptance Rate 14%) Extensively used in the field 150 citations Used for:  measure precision and fitness in models  evaluate discovery algorithms  guide discovery techniques based on genetic algorithms  CoBeFra framework  recommender systems trainning 120

121 Directions for Future Work New metrics, new dimensions Decomposed alignment of observed and modeled behavior Decomposed conformance for other dimensions Visualization and diagnosis Model repair 121

122 Thesis and Acknowledgements More details in: … and to all the people that made this work possible, THANKS! 122

123 Jorge Munoz-Gama Advisor: Josep Carmona December 2014 CONFORMANCE CHECKING AND DIAGNOSIS IN PROCESS MINING

124 Backup Slides 124

125 Contributions Precision based on Escaping Arcs 125 Escaping arcs: points where the model allows more behavior than the one observed in the log.

126 126

127 127

128 128

129 129

130 130

131 131

132 132

133 133

134 Problem “Low Criticality Diagnosis” Process 134 Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care Process Simulation Software “Low Criticality Diagnosis” Process Model Simulation Results

135 Problem “Low Criticality Diagnosis” Process 135 Process Simulation Software “Low Criticality Diagnosis” Process Model Simulation Results Initial Examination Allergy Test Blood Test Radiology Test Diagnosis Hospital Treatment Home Care


Download ppt "Jorge Munoz-Gama Advisor: Josep Carmona December 2014 CONFORMANCE CHECKING AND DIAGNOSIS IN PROCESS MINING."

Similar presentations


Ads by Google