1. Synchronizing Words for Probabilistic Automata Laurent Doyen LSV, ENS Cachan & CNRS Thierry Massart, Mahsa Shirmohammadi Université Libre de Bruxelles 5th Gasics meeting

2. Example [AV04] Block factory conveyor beltstorage

3. Block factory conveyor belt HighLow storage Example [AV04]

4. Example Block factory conveyor belt HighLow H H H H

5. Example Block factory conveyor belt HighLow L L LL

6. Example Block factory conveyor belt HighLow H,LH,L H H H L LL Deterministic finite automaton

7. {,,, } Example Block factory H,LH,L H H H L LL no sensor

8. {,,, } Example Block factory H,LH,L H H H L LL no sensor robust control: w { } w ∈ { H,L } * ∈ { H,L } *

9. {,,, } Example Block factory H,LH,L H H H L LL no sensor robust control: w { } The word w is synchronizing: no matter the initial state, the automaton ends up in a singleton w ∈ { H,L } * Reachability in subset construction ∈ { H,L } *

10. Example Block factory no sensor robust control: w w = L H H H L H H H L synchronizing word H,LH,L H H H L LL H

11. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

12. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

13. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

14. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

15. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

16. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

17. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

18. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word H

19. Example Block factory H,LH,L H H H L LL no sensor robust control: w w = L H H H L H H H L synchronizing word Existence of a synchronising word can be decided in PTIME Cerny’64 H

20. Applications Discrete-event systems Planning Biocomputing Robotics Robust control, reset from unknown state See [Vol08]

21. Probabilistic systems Block factory conveyor beltstorage.5 HighLow

22. Probabilistic automata H,LH,L H H H L LL.5 Probabilistic automaton What is a synchronizing word for probabilistic automata ?

23. Probabilistic automata Outcome of a word: w = aaba …

24. Probabilistic automata Outcome of a word: w = aaba …

25. Probabilistic automata Outcome of a word: w = aaba …

26. Probabilistic automata Outcome of a word: w = aaba …

27. Probabilistic automata Outcome of a word: w = aaba …

28. Probabilistic automata An infinite word What is a synchronizing word for probabilistic automata ? The probability mass tends to accumulate in a single state.

29. Probabilistic automata Outcome of a word:

30. Probabilistic automata Outcome of a word:

31. Probabilistic automata Outcome of a word:

32. Probabilistic automata Outcome of a word:

33. Probabilistic automata What is a synchronizing word for probabilistic automata ? Outcome of a word: where

34. Probabilistic automata What is a synchronizing word for probabilistic automata ? Outcome of a word: is synchronizing if where

35. Synchronizing words Two variants: strongly synchronizing weakly synchronizing

36. Decision Problems

37. Decision problems Emptiness Universality Does there exist a synchronizing word ? Are all words synchronizing ? Note: we consider randomized words Words are called pure words.

38. Synchronizing words for DFA If we view DFA as special case of probabilistic automata: there exists a synchronizing (finite) word for DFA A iff there exists a synchronizing (infinite) word for A with. uniform initial distribution H,LH,L H H H L LL H,LH,L H H H L LL

39. Emptiness problem Does there exist a synchronizing word ? Pure words are sufficient The emptiness problem is PSPACE-complete

40. Emptiness problem Does there exist a synchronizing word ? Pure words are sufficient The emptiness problem is PSPACE-complete

41. Emptiness problem Does there exist a synchronizing word ? Pure words are sufficient The emptiness problem is PSPACE-complete witness sequence

42. Emptiness problem States in the witness sequence have exactly one successor

43. Emptiness problem States in the witness sequence have exactly one successor All other states have to inject some probability in the witness sequence

44. Emptiness problem Does there exist a synchronizing word ? Pure words are sufficient The emptiness problem is PSPACE-complete PSPACE upper bound: emptiness of a Büchi automaton subset sonctruction obligation set witness sequence Büchi condition: o is empty infinitely often

45. Emptiness problem Does there exist a synchronizing word ? Pure words are sufficient The emptiness problem is PSPACE-complete PSPACE upper bound: emptiness of a Büchi automaton subset sonctruction obligation set witness sequence Büchi condition: o is empty infinitely often

46. Emptiness problem Does there exist a synchronizing word ? Pure words are sufficient The emptiness problem is PSPACE-complete PSPACE lower bound: universality of NFA

47. Decision problems Emptiness Universality Does there exist a synchronizing word ? Are all words synchronizing ? Note: we consider randomized words Words are called pure words.

48. Universality problem Are all words synchronizing ? All pure words are synchronizing, not all randomized words. Pure words are not sufficient

49. Universality problem Are all words synchronizing ? is not synchronizing All pure words are synchronizing, not all randomized words. Pure words are not sufficient The uniformly randomized word is not sufficient

50. Universality problem Are all words synchronizing ? No, if there are two absorbing components. (from which there is a word to stay inside).

51. Universality problem Are all words synchronizing ? If there is only one absorbing component, then it is sufficient to check whether the uniformly randomized word is synchronizing.

52. Universality problem Are all words synchronizing ? If there is only one absorbing component, then it is sufficient to check whether the uniformly randomized word is synchronizing. Uniformly randomized word is synchronizing.

53. Universality problem Are all words synchronizing ? If there is only one absorbing component, then it is sufficient to check whether the uniformly randomized word is synchronizing. Uniformly randomized word is synchronizing. universal not universal

54. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. existence of absorbing component, check in PSPACE whether unif. rand. word is synchronizing, check in PTIME

55. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. existence of absorbing component, check in PSPACE whether unif. rand. word is synchronizing, check in PTIME - Guess component U  Q - Guess state q  U and finite word w - Check that all runs from q on w stay in U U

56. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. existence of absorbing component, check in PSPACE whether unif. rand. word is synchronizing, check in PTIME - Guess component U  Q - Guess state q  U and finite word w - Check that all runs from q on w stay in U q U

57. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. existence of absorbing component, check in PSPACE whether unif. rand. word is synchronizing, check in PTIME - Guess component U  Q - Guess state q  U and finite word w - Check that all runs from q on w stay in U q U w

58. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. Towards PSPACE-hardness ? Nondeterm.  Probabilistic Accepting  prob. ½ to leave There exists a state q and a word w such that all runs of from q on w avoid accepting states iff is not universal.

59. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. Towards PSPACE-hardness ? Nondeterm.  Probabilistic Accepting  prob. ½ to leave There exists a state q and a word w such that all runs of from q on w avoid accepting states iff is not universal. Existential blind safety game Positive coBüchi automaton

60. Universality problem Are all words synchronizing ? The universality problem is in PSPACE. Towards PSPACE-hardness ? Nondeterm.  Probabilistic Accepting  prob. ½ to leave There exists a state q and a word w such that all runs of from q on w avoid accepting states iff is not universal. Existential blind safety game PSPACE-hard ? Positive coBüchi automaton PSPACE-hard ?

61. Summary Infinite synchronizing words for PA Generalizes finite sync. words for DFA Emptiness is PSPACE-complete Universality is in PSPACE – lower bound ? Outlook Labeled automata, MDPs Universality in pure words Optimal synchronization Stochastic games

62. Thank you ! Questions ?

63. Probabilistic automata

64. References [AV04] D. S. Ananichev and M. V. Volkov. Synchronizing Monotonic Automata. Theor. Comput. Sci. 327(3): 225-239 (2004) [Vol08] M. V. Volkov. Synchronizing Automata and the Cerny Conjecture. LATA 2008: 11-27