1. TUDelft Knowledge Based Systems Group Zuidplantsoen 4 2628 BZ Delft, The Netherlands 26-8-99 Dialogue Control in the Alparon System Niels Andeweg

2. TUDelft Dialogue Control in the Alparon System 2  Information Technology and Systems  Knowledge Based Systems –Artificial Intelligence  Alparon –multi-media –automatic speech processing –dialogue management

3. TUDelft Dialogue Control in the Alparon System 3 Assignment  design dialogue control for the Alparon system  implement prototypes of the components for dialogue control

4. TUDelft Dialogue Control in the Alparon System 4 Contents  Automatic speech processing (ASP)  Alparon system  Dialogue control  Train timetable information system  Conclusions

5. TUDelft Dialogue Control in the Alparon System 5 Contents  Automatic speech processing (ASP)  Alparon system  Dialogue control  Train timetable information system  Conclusions

6. TUDelft Dialogue Control in the Alparon System 6 ASP system dialogue manager application speech recognition speech generation natural language component meaning extraction response generation

7. TUDelft Dialogue Control in the Alparon System 7 Dialogue management Why dialogue management?  spread out user requirements  discourse phenomena Tasks:  provide context  problem solving  response generation

8. TUDelft Dialogue Control in the Alparon System 8 Contents  Automatic speech processing (ASP)  Alparon system  Dialogue control  Train timetable information system  Conclusions

9. TUDelft Dialogue Control in the Alparon System 9 Alparon system  information retrieval and transaction services  natural language  speech interface  mixed-initiative  focus on dialogue management  strategies in human-human dialogues

10. TUDelft Dialogue Control in the Alparon System 10 Alparon model Text to speech ParserCoder Speech recognition Text generation Dialogue manager User interface by telephone Language atmosphere

11. TUDelft Dialogue Control in the Alparon System 11 Alparon DM Task coordinator Blackboard system Discourse manager Database manager Rest of the ASP system Dialogue manager

12. TUDelft Dialogue Control in the Alparon System 12 Discourse Manager Task coordinator Disambi- guation Context updating Reference handling Query Response generation Dialogue act generation Discourse Manager

13. TUDelft Dialogue Control in the Alparon System 13 Blackboard system Task coordinator Blackboard system Information board Status board History Board Control board Presentation board

14. TUDelft Dialogue Control in the Alparon System 14 Contents  Automatic speech processing (ASP)  Alparon system  Dialogue control  Train timetable information system  Conclusions

15. TUDelft Dialogue Control in the Alparon System 15 Dialogue control Tasks  structure dialogue  generate responses Two kinds of information ‘What time does the train to Amsterdam leave?’

16. TUDelft Dialogue Control in the Alparon System 16 Approach  task-oriented dialogues  plan-based  goal structure –level of abstraction –task & dialogue goals  determine departure station  verify departure station –dynamic

17. TUDelft Dialogue Control in the Alparon System 17 Achievement  operations –deductions –default behaviour  interaction –‘Departure at 8:30.’ –‘What is your departure station?’  strategy

18. TUDelft Dialogue Control in the Alparon System 18 Implementation  framework  rulesets Two steps –determine consequences of user’s turn  dialogue updating module –generate response  response generation module  Java

19. TUDelft Dialogue Control in the Alparon System 19 Dialogue updating module Process effects of user’s turn  new information  conflicts  choices  reaction

20. TUDelft Dialogue Control in the Alparon System 20 Response generation module Generate a system response  actions  candidates  combine

21. TUDelft Dialogue Control in the Alparon System 21 Control board Store information for dialogue control  goalstack  conflicts  choices  response

22. TUDelft Dialogue Control in the Alparon System 22 Strategy 1  decomposition  achievement  slot Time contains departure time  slot DeparturePlace is verified  communicated  operations  city(Delft)  station(Delft)   date = today CdetermineNeed ….. AdetermineDep, AdetermineArr ….. AdetermineTime, AdetermineDate

23. TUDelft Dialogue Control in the Alparon System 23 Strategy 2  reactions reconfirmation of departure place  reconfirm(DepPlace) start dialogue  ChelpUser  actions Averify(time)  [VerifyExplicit(time), VerifyImplicit(time)] Adetermine(DepPlace)  [Ask(DepPlace), Ask(Where), Encourage)]  combinations –VerifyImplicit(*): {Ask(*)}

24. TUDelft Dialogue Control in the Alparon System 24 Contents  Automatic speech processing (ASP)  Alparon system  Dialogue control  Train timetable information system  Conclusions

25. TUDelft Dialogue Control in the Alparon System 25 Train timetable information  travelplan for train connections  mixed-initiative  information needed –departure station –arrival station –departure or arrival time –date

26. TUDelft Dialogue Control in the Alparon System 26 Phases  greeting  determination of user’s need  query  presentation  further needs  goodbye

27. TUDelft Dialogue Control in the Alparon System 27 Example actions Adetermine(DepPlace): [Ask(DepPlace), Ask(Place), Encourage] Adetermine(ArrPlace): [Ask(ArrPlace), Ask(Place), Encourage] Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)] Adetermine(Date): [Ask(date), Ask(When)] Averify(*): [VerifyExplicit(*), VerifyImplicit(*)]

28. TUDelft Dialogue Control in the Alparon System 28 Example dialogue 1 U1:User connects. Gs:Cclose Ctravelplan Agreet Res:Greetings S1:Hello, train timetable information service. DA Sys(Start_conversation): send(CB, clear, dummy), send(IB, clear, dummy), goal(ChelpUser) ChelpUser: [[Cclose], [Ctravelplan], [Cgreet]] Cgreet: [[Agreet]] Agreet: [Greetings]

29. TUDelft Dialogue Control in the Alparon System 29 Example dialogue 2 U2:Hello, I want to travel from Baarn/Maarn to Den Haag. Gs:Cclose Ctravelplan Achoice(DepPlace, city(Baarn), city(Maarn)) Res:Choice(DepPlace, city(Baarn), city(Maarn)) S2:Do you want to travel from Baarn or Maarn? Agreet: communicated Achoice(*): [Choice(*)]

30. TUDelft Dialogue Control in the Alparon System 30 Example dialogue 3 U3:I want to travel from Baarn. Gs:Cclose CfurtherNeeds Cpresent Cquery Adetermine(Time) Adetermine(ArrPlace) Achoice(ArrPlace, station(Den Haag cs), station(Den Haag hs)) Res:Choice(ArrPlace, station(Den Haag cs), station(Den Haag hs)) S0:Which station in Den Haag do you want to go to, central station or Holland Spoor? Achoice(*): communicated Ctravelplan: [[CfurtherNeeds], [Cpresent], [Cquery], [CdetermineNeed]] CdetermineNeed: [[Adetermine(Date), Adetermine(Time)], [Adetermine(DepPlace), Adetermine(ArrPlace)]] Adetermine(Date): Date has empty : put(Date, today, default) Adetermine(Date): Date hasnot empty Adetermine(DepPlace): DepPlace is station(*) & DepPlace has user Adetermine(ArrPlace): ArrPlace is city(Den Haag) : goal(Achoice(ArrPlace, station(Den Haag cs), station(Den Haag hs)) Achoice(*): [Choice(*)]

31. TUDelft Dialogue Control in the Alparon System 31 Example dialogue 4 U4:I want to go to Den Haag central station. Gs:Cclose CfurtherNeeds Cpresent Cquery Adetermine(Time) Res:Ask(When) S4:When do you want to travel? Achoice(*): communicated Adetermine(ArrPlace): ArrPlace is station & ArrPlace has user Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

32. TUDelft Dialogue Control in the Alparon System 32 Example dialogue 5 U5:…???… Gs:Cclose CfurtherNeeds Cpresent Cquery Adetermine(Time) Res:Ask(Time) S5:At what time do you want to travel? Adetermine(Time): [Ask(DepTime), Ask(Time), Ask(When)]

33. TUDelft Dialogue Control in the Alparon System 33 Example dialogue 6 U6:I want to arrive at half past nine. Gs:Cclose CfurtherNeeds ApresentPart(3) ApresentPart(2) ApresentPart(1) Res:PresentPart(1) S6:OK. Departure at 7:35 in Baarn to Utrecht. Adetermine(Time): Time is ArrTime(*) Cquery: [[Aquery]] Aquery: true : send(QM, query, empty body, queryDone) Cpresent: [[ApresentPart(*)]] ApresentPart(*): [PresentPart(*)]

34. TUDelft Dialogue Control in the Alparon System 34 Example dialogue 7 U7:When do I depart again? Gs:Cclose CfurtherNeeds ApresentPart(3) ApresentPart(2) Areconfirm(Time (DepTime)) Res:Reconfirm(Time (DepTime)) S7:Departure at 7:35. ApresentPart(*): communicated DA Rec(*) : goal(Areconfirm(*)) Areconfirm(*): [Reconfirm(*)]

35. TUDelft Dialogue Control in the Alparon System 35 Example dialogue 8 U8:OK. Gs:Cclose CfurtherNeeds ApresentPart(3) ApresentPart(2) Res:PresentPart(2) S8:Departure at 8:32 to Den Haag cs in Utrecht. ApresentPart(*): communicated ApresentPart(*): [PresentPart(*)]

36. TUDelft Dialogue Control in the Alparon System 36 Example dialogue 9 U9:8:32 to Den Haag. Gs:Cclose CfurtherNeeds ApresentPart(3) Res:PresentPart(3) S9:Arrival at 9:13. ApresentPart(*): communicated ApresentPart(*): [PresentPart(*)]

37. TUDelft Dialogue Control in the Alparon System 37 Example dialogue 10 U10:9:13 in Den Haag. Gs:Cclose AfurtherNeeds Res:AskFurtherNeeds S10:Do you want another travelplan? ApresentPart(*): communicated CfurtherNeeds: [[AfurtherNeeds]] AfurtherNeeds: [AskFurtherNeeds]

38. TUDelft Dialogue Control in the Alparon System 38 Example dialogue 11 U11:No thanks. Gs:Aclose Res:Bye S11:Have a nice day. AskFurtherNeeds: communicated Cclose: [[Aclose]] Aclose: [Bye]

39. TUDelft Dialogue Control in the Alparon System 39 Example dialogue 12 U12:Goodbye. and the user disconnects Gs:... Res:... Aclose: communicated

40. TUDelft Dialogue Control in the Alparon System 40 Contents  Automatic speech processing (ASP)  Alparon system  Dialogue control  Train timetable information system  Conclusions

41. TUDelft Dialogue Control in the Alparon System 41 Conclusions  two modules and a blackboard  generic framework with rulesets  mixed-initiative  reactions  adequate rulesets  testing with complete system

42. TUDelft Dialogue Control in the Alparon System 42 Example goalstack & actions Cclose CfurtherNeeds Cpresent Cquery Adetermine(Time) Adetermine(DepPlace), Averify(Date) Adetermine(ArrPlace) Goalstack Actions [Ask(DepTime), Aks(Time), Ask(When)] [Ask(DepPlace), Ask(Place), Encourage] [Ask(ArrPlace), Ask(Place), Encourage] [VerifyExplicit(Date), VerifyImplicit(Date)]