1 Approaches to dialogue Peter KühnleinHannes Rieser

2 Approaches to dialogue Peter KühnleinHannes Rieser

3 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00Intro 14:45

4 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00Intro 14:45Dialogue Games I

5 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II 14:45Dialogue Games I

6 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II 14:45Dialogue Games I Dialogue Games III

7 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II Dialogue Macro Games 14:45Dialogue Games I Dialogue Games III

8 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II Dialogue Macro Games 14:45Dialogue Games I Dialogue Games III Plan-based Accounts I

9 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II Dialogue Macro Games Plan-based Accounts II 14:45Dialogue Games I Dialogue Games III Plan-based Accounts I

10 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II Dialogue Macro Games Plan-based Accounts II 14:45Dialogue Games I Dialogue Games III Plan-based Accounts I Plan-based Accounts III

11 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II Dialogue Macro Games Plan-based Accounts II Plan-based Accounts IV 14:45Dialogue Games I Dialogue Games III Plan-based Accounts I Plan-based Accounts III

12 Approaches to dialogue Schedule Tue Feb 25 Wed Feb 26 Thu Feb 27 Fri Feb 28 Sat Mar 1 14:00IntroDialogue Games II Dialogue Macro Games Plan-based Accounts II Plan-based Accounts IV 14:45Dialogue Games I Dialogue Games III Plan-based Accounts I Plan-based Accounts III Intentions in Dialogue I

13 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II 14:45

14 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II 14:45Intentions in Dialogue III

15 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I 14:45Intentions in Dialogue III

16 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I 14:45Intentions in Dialogue III Coordina- tion in Dialogue II

17 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I Coordina- tion in Dialogue III 14:45Intentions in Dialogue III Coordina- tion in Dialogue II

18 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I Coordina- tion in Dialogue III 14:45Intentions in Dialogue III Coordina- tion in Dialogue II Psycholin- guistics of Dialogue I

19 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I Coordina- tion in Dialogue III Psycholin- guistics of Dialogue II 14:45Intentions in Dialogue III Coordina- tion in Dialogue II Psycholin- guistics of Dialogue I

20 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I Coordina- tion in Dialogue III Psycholin- guistics of Dialogue II 14:45Intentions in Dialogue III Coordina- tion in Dialogue II Psycholin- guistics of Dialogue I Psycholin- guistics of Dialogue III

21 Approaches to dialogue Schedule Mon Mar 3 Tue Mar 4 Wed Mar 5 Thu Mar 6 Fri Mar 7 14:00Intentions in Dialogue II Coordina- tion in Dialogue I Coordina- tion in Dialogue III Psycholin- guistics of Dialogue II Discussion: Comparing Frame- works 14:45Intentions in Dialogue III Coordina- tion in Dialogue II Psycholin- guistics of Dialogue I Psycholin- guistics of Dialogue III Discussion: Comparing Frame- works

22 Approaches to dialogue Acknowledgements

23 We thank the ERASMUS staff exchange program for a grant. Approaches to dialogue

24 We thank our colleagues from the computer science department for the VR pictures. Approaches to dialogue

25 We thank Trinity College Dublin for the organization of the seminar. Approaches to dialogue

26 We thank Carl Vogel for his support. Approaches to dialogue

27 Approaches to dialogue

28 Approaches to dialogue Introduction

29 Corpus : 22 construction dialogues, 15 to 32 min. 15 with screen Materials: transcripts, videos, speech recordings Dialogue examples, setting & corpus Introduction

30 (A) Inst:So, jetzt nimmst du Well, now you take Cnst:eine Schraube a screw. Inst:eine orangene mit einem Schlitz. an orange one with a slit Cnst:Ja. Yes Introduction Dialogue example & situation

31 (A) Inst:So, jetzt nimmst du Well, now you take Cnst:eine Schraube a screw. Inst:eine orangene mit einem Schlitz. an orange one with a slit Cnst:Ja. Yes Available Bolts Introduction Dialogue example & situation

32 Previous step  : highest coordination peak point   Coordination peak points & parts of construction Introduction

33 Coordination throughout the dialogue Introduction

34 (B) Inst: Und steckst sie dadurch, also And you put it through there, let’s see Cnst: Von oben. From the top. Inst: Von oben, daß also die drei festgeschraubt werden dann. From the top, so that the three bars get fixed. Cnst: Ja. Yes. Intended Junction Intended Result Dialogue example … c'td Introduction

35 (A) Inst: Well, now you take Cnst: a screw. Inst:an orange one with a slit Cnst: Yes. Dialogue example & situation c'td Introduction

36 (A) Inst: Well, now you take Cnst: a screw. Inst:an orange one with a slit Cnst: Yes. (B) Inst: And you put it through there, let’s see Cnst: From the top. Inst: From the top, so that the three bars get fixed. Cnst:Yes. Dialogue example & situation c'td Introduction

37 What is introduced: (A): object (screw; terminologically round head bolt) (B): direction (screwing bolt into port from designated top of fuselage) Dialogue example & situation c'td Introduction

38 What is introduced: (A): object (screw; terminologically round head bolt) (B): direction (screwing bolt into port from designated top of fuselage) Observations: 1.Cooperativity: Inst and Cnst produce a directive together. Stages in (A) : Inst starts production of an indirect speech act. Cnst wants to contribute the object-NP. Similarly in (B): Inst demands a put-through-action. Cnst contributes the direction-AvP. Dialogue example & situation c'td Introduction

39 2.Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply. Dialogue example & situation c'td Introduction

40 2.Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply. 3. Repair ++ : Confirmation of contribution of Cnst’s by Inst and extension of contribution (in B). Confirmation can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply. Motivation for sub-dialogue assumption: (A) and (B) can basically be seen as two conjoined speech acts etc.; precond., grounding Dialogue example & situation c'td Introduction

41 2.Repair-construction in (A): Inst adds repair to Cnst’s contribution. Repair-construction can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply. 3. Repair ++ : Confirmation of contribution of Cnst’s by Inst and extension of contribution (in B). Confirmation can be seen as a sub-dialogue initiated by Inst and completed by Cnst’s reply. Motivation for sub-dialogue assumption: (A) and (B) can basically be seen as two conjoined speech acts etc.; precond., grounding 4. Coordination: Inst and Cnst have to coordinate their grammar. Especially clear from (A).  Cnst continues production (application of rule) of Inst’s. Dialogue example & situation c'td Introduction

42 5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates. Dialogue example & situation c'td Introduction

43 5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates 6. Common knowledge of how to produce a stable bolt-nut- combination. Hence: Cnst can complete speech act on the basis of such knowledge. Additional source of common knowledge: aggregate built so far. Dialogue example & situation c'td Introduction

44 5. Common knowledge concerning the domain: Inst and Cnst have common knowledge concerning the properties of objects like bars, bolts, nuts, and aggregates 6. Common knowledge of how to produce a stable bolt-nut- combination. Hence: Cnst can complete speech act on the basis of such knowledge. Additional source of common knowledge: aggregate built so far. 7. Common knowledge concerning grammar and the speech act interface. Dialogue example & situation c'td Introduction

45 8. (A): Underlying intention of Inst’s forms utterance-level intention. intend(Inst, intend(Cnst, take (Cnst, bolt))) Dialogue example & situation c'td Introduction

46 8. (A): Underlying intention of Inst’s forms utterance-level intention. intend(Inst, intend(Cnst, take (Cnst, bolt))) 9. Recognition of intention on part of Cnst’s: Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt)))) Dialogue example & situation c'td Introduction

47 8. (A): Underlying intention of Inst’s forms utterance-level intention. intend(Inst, intend(Cnst, take (Cnst, bolt))) 9. Recognition of intention on part of Cnst’s: Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt)))) 10.Cooperativity on part of Cnst due to recognition of intention. Cnst takes over intention of Inst’s: intend(Cnst, take (Cnst, bolt) Similarly for the (B)-case. Dialogue example & situation c'td Introduction

48 8. (A): Underlying intention of Inst’s forms utterance-level intention. intend(Inst, intend(Cnst, take (Cnst, bolt))) 9. Recognition of intention on part of Cnst’s: Believe(Cnst, intend(Inst, intend(Cnst, take (Cnst, bolt)))) 10.Cooperativity on part of Cnst due to recognition of intention. Cnst takes over intention of Inst’s: intend(Cnst, take (Cnst, bolt) Similarly for the (B)-case. 11. Intentions linked to discourse segments Inst’s intention for (A) and (B): object selection and putting Dialogue example & situation c'td Introduction

Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies. Dialogue example & situation c'td Introduction

Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies. 13. Inst and Const know patterns for producing sub-dialogues: Proposal + repair + reply. Proposal + confirmation of proposal + extension of proposal + reply. Dialogue example & situation c'td Introduction

Inst and Cnst know how to produce task- relevant adjacency pairs: directives and replies. 13. Inst and Const know patterns for producing sub-dialogues: Proposal + repair + reply. Proposal + confirmation of proposal + extension of proposal + reply. 14. Words that facilitate communication, interaction and recognition of discourse structure: so/well/let’s see indicating next step in task Dialogue example & situation c'td Introduction

52 Co-operativity, Coordination Patterns: Speech acts Adjacency pairs Repairs, confirmation Sub-dialogues Intentions: Utterance level intentions Intentions linked to discourse segments Intention recognition Summary of observations Introduction

53 Common knowledge: Domain Actions (production of aggregates) Grammar-speech-act-interface Patterns for spoken language interaction Summary of observations c'td Introduction

54 References Dialogue (Macro)Games Start Levin & Moore (1977): Dialogue Games: Meta-communication structures for Natural Language Interaction. ISI/RR Sequel Mann (1988): Dialogue Games: Convention of Human Interaction. Argumentation 2, 511 – 532 Mann (2002): Dialogue Macro Games Plan-based Accounts Start Allen & Litman (1987): A Plan Recognition Model for Subdialogues in Conversations. Cognitive Science 11, pp Sequel Grosz & Sidner (): Plans for Discourse. Grosz & Kraus (1993): Collaborative Plans for Group Activities. Proceedings of IJCAI-93 Vol. 1, pp

55 Intentionalist Accounts Start Grosz & Sidner (1986): Attention, Intentions, and the Structure of Discourse. Comp. Ling., Vol. 12(3), pp Sequel Bratman (1999): Shared Intention, Ch.6 in: Faces of Intention, CUP Plan-based Accounts Start Allen & Litman (1987): A Plan Recognition Model for Subdialogues in Conversations. Cognitive Science 11, pp Sequel Litman, D. J., Allen, J., F.:1990, Discourse Processing and Commonsense Plans. Ch. 17 of Cohen, Ph. R et al. Eds, Intentions in Communication. MIT Press, pp Grosz & Sidner References

56 Coordinative Accounts Clark (1996): Using language, CUP Psycholinguistics of Dialogue Garrod & Pickering (to appear): The Interactive Alignment Model: Towards a mechanistic psychology of discourse, Behavioural and Brain Sciences References