1. MCS 101: Algorithms Instructor Neelima Gupta ngupta@cs.du.ac.in

2. Table of Contents String Matching – Naïve Method – Finite Automata Approach – Rabin Karp – KMP

3. Pattern Matching Given a text string T[0..n-1] and a pattern P[0..m-1], find all occurrences of the pattern within the text. Example: T = ababcabdabcaabc and P = abc, the occurrences are: – first occurrence starts at T[3] – second occurrence starts at T[9] – third occurrence starts at T[13]

4. Let Σ denotes the set of alphabet. Given: A string of alphabets T[1..n] of size “n” and a pattern P[1..m] of size “m” where, m<<<n. To Find: Whether the pattern P occurs in text T or not. If it does, then give the first occurrence of P in T. The alphabets of both T and P are drawn from finite set Σ.

5. NAÏVE APPROACH T : P : a b c a b d a a b c d e a b d

6. Example ( Step – 1 ) T : P : c a b d a a b c d e d Mismatch after 3 Comparisons a b

7. Example ( Step – 2 ) T : P : a b c a b d a a b c d e a b d Mismatch after 1 Comparison

8. Example ( Step – 3 ) T : P : a b c a b d a a b c d e a b d Mismatch after 1 Comparison

9. Example ( Step – 4 ) T : P : a b c a b d Match found after 3 Comparisons a b da a b c d e Thus, after 8 comparisons the substring P is found in T.

10. Worst Case Running Time T : a a a a a……..a a f of size say “n” P : a a a f of size 4

11. Example ( Step – 1 ) T : P : a a a a..... a a f a a a f Mismatch found after 4 comparisons

12. Example ( Step – 2 ) T : P : a a a a a,,,, a a f a a a f Mismatch found after 4 comparisons

13. T : P : a a a f a a a a a.... Match found after 4 comparisons a a a f Example

14. This will continue to happen until (n-4)th alphabet in T is compared with the characters in P and thus the no. of comparisons required is (n-4)4 + 4. Worst Case Running Time

15. At every step, after ‘m’ comparisons a mismatch will be found. These ‘m’ comparisons will be done for (n- m) characters in T. Thus, the running time obtained is (n-m)m + m.

16. Finite Automata s0s0 s1s1 a f s2s2 s3s3 f aa # a ∑

17. Worst Case Running Time In finite automata, each character is scanned atmost once. Thus in the worst case, the searching time is O(n). Preprocessing time:- As for every character in ∑ an edge has to be formed, thus the preprocessing time is O(m*|∑|). Thus total running time is O(n) + O(m*|∑|).

18. Drawback:- If the alphabet set ∑ is very large, then the time required to construct the FA will be very large.

19. BRUTE FORCE STRATEGY In this strategy whenever a mismatch was found, the pattern was shifted right by 1 character. But this wasn’t an efficient strategy as it required a large number of comparisons. Hence a better algorithm was required. 19

20. T : …… t j.. …...t j+r-1 ….t j+k-r …...t j+k-2 t j+k-1 … ……………………………… P : p 1 …… p r …… ……… p k-1 p k …… p 1 …… p r p k … If t j+k-1 ≠ p k Shifting of the pattern is required. But instead of shifting right by 1 character, we look for longest prefix of p 1 … p k-1 that matches the suffix of t j … t j+k-1. Since t j … t j+k-1 has already been matched with p 1 … p k-1, this means we need to look for longest prefix of p 1 … p k-1 that matches with its own suffix. 20 KMP : Knuth Morris Pratt Algorithm

21. KMP Contd.. Let r be the length of the longest prefix of P that matches with the matched part of P. Then the pattern can be shifted by r positions instead of 1 and t j+k-1 should be compared with p r+1. Claim 1: We have not missed any match i.e. the pattern does not exist at any position from j to j+k-r- 1. Proof: Had it been, we would have a longer prefix matching with its suffix.

22. Why LONGEST? T : a b c a b c a b c a b c a f mismatch found P : a b c a b c a b c a f 22

23. 23 T : a b c a b c a b c a b c a f mismatch found P : a b c a b c a b c a f the longest prefix. Correct alignment for the pattern will be by shifting it 3 characters right.

24. 24 T : a b c a b c a b c a b c a f P : a b c a b c a b c a f Pattern found.

25. 25 T : a b c a b c a b c a b c a f mismatch P : a b c a b c a b c a f Pattern not found. By finding a smaller prefix and aligning the pattern accordingly as shown, the pattern’s occurrence in the text got missed (that is we shifted by more positions than we should have)

26. So it is known that we need to find the longest prefix in the pattern that matches its suffix. But HOW? 26

27. P : p 1 ….………….…………… p k ………… Let the length of the longest prefix of p 1 … p k-1 that matches its suffix be ‘r.’ 27

28. T : …… t j.. …...t j+r-1 ….t j+k-r …...t j+k-2 t j+k-1 … ……………………………… P : p 1 …… p r …… ……… p k-1 p k …… p 1 …… p r p k … If t j+k-1 ≠ p k Let Fail[k] be a pointer which says that if a mismatch occurs for p k then what is the character in P that should come in place of p k by shifting P accordingly. How to compute Fail[k]? 28

29. P : p 1 … p r-1 p r p r+1 …….…. p k-1 p k … p 1 … p r’-1 p r’ p r’+1 p 1….... p s-1 p s p s+1 Look at fail[k-1]. Let it be r’. If p r’ = p k-1 (which has already been matched with t j+k-1 ) fail[k] = r’+1 1 else { look at fail[r’] = s, say if s>0 { if p s = p k-1 then fail[k] = s+1 else goto 1 with r’ = s } } else (i.e s = 0) fail[k] =1 29

30. EXAMPLE P: abcabcabcaf for k=1, fai[k]=0 (assumed) for k=2, s=fail[1]=0 therefore, fail[k]=0+1=1 for k=3, s=fail[2]=1 check whether p2=p1 since p2!=p1 so, s=fail[1]=0 therefore, fail[k]=0+1=1

31. P: abcabcabcaf for k=4, s=fail[3]=1 check whether p1=p3 since p1!=p3 so, s=fail[1]=0 therefore, fail[k]=0+1=1 For k=5 s=fail[4]=1 check whether p1=p4 yes therefore, fail[k]=1+1=2 Similarly, for others.

32. kfail[k] 10 21 31 41 52 63 74 85 96 107 118

33. Example : T : a b c a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Mismatch found at k=11 position. Look at fail[11] = 8 which implies the pattern must be shifted such that p 8 comes in place of p 11 33 kFail[k] 10 21 31 41 52 63 74 85 96 107 118

34. Example : T : a b c a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Pattern found 34 kFail[k] 10 21 31 41 52 63 74 85 96 107 118

35. Another Example : T : a b c b a b c b a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Mismatch found at k=4 position. Look at fail[4] = 1 which implies the pattern must be shifted such that p 1 comes in place of p 4 35 kFail[k] 10 21 31 41 52 63 74 85 96 107 118

36. 36 Another Example : T : a b c b a b c b a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Mismatch found at k=1 position. Look at fail[1] = 0 which implies read the next character in text. kFail[k] 10 21 31 41 52 63 74 85 96 107 118

37. 37 Another Example : T : a b c b a b c b a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Mismatch found at k=4 position. Look at fail[4] = 1 which implies the pattern must be shifted such that p 1 comes in place of p 4 kFail[k] 10 21 31 41 52 63 74 85 96 107 118

38. 38 Another Example : T : a b c b a b c b a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Mismatch found at k=1 position. Look at fail[1] = 0 which implies read the next character in text. kFail[k] 10 21 31 41 52 63 74 85 96 107 118

39. 39 kFail[k] 10 21 31 41 52 63 74 85 96 107 118 Another Example : T : a b c b a b c b a b c a b c a b c a f P : a b c a b c a b c a f k: 1 2 3 4 5 6 7 8 9 10 11 Pattern found

40. Analysis of KMP # of mismatch: For mismatch the pattern is shifted by at least 1 position. The maximum number of shifts is determined by the largest suffix. T:......a b c a b c a b c a b c d a f d........ P: d e b mismatch For every mismatch pattern is shifted by atleast1postion.  Total no. of shifts <= n-m  Total no. of mismatches <=n-m+1....

41. Analysis of KMP contd. # of matches: For every match, pointer in the text moves up by 1 position. T:......a b c a b c a b c a b c d a f d........ P: a b c b d e For every match pointer moves up by 1 position. P: a b c b d e => # of matches <= length of text <= n..... The complexity of KMP is linear in nature. O(m+n)

42. ACKNOWLEDGEMENTS 42 MSc (CS) 2009 Abhishek Behl(02) Aarti Sethiya(01) Akansha Aggarwal(03) Alok Prakash (04) Vibha Negi(31)