1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 5.

Slides:



Advertisements
Similar presentations
Referring Expressions: Definition Referring expressions are words or phrases, the semantic interpretation of which is a discourse entity (also called referent)
Advertisements

Unit 4 - Referring Expressions
Understanding CP Writing Tasks
A guide to organizing your information to write a research paper
Albert Gatt LIN3022 Natural Language Processing Lecture 11.
TOWARDS A MODULAR APPROACH TO ANAPHORIC PROCESSING: semantic operations precede discourse operations Arnout Koornneef.
Eye Movements and Spoken Language Comprehension: effects of visual context on syntactic ambiguity resolution Spivey et al. (2002) Psych 526 Eun-Kyung Lee.
Sentence Processing III Language Use and Understanding Class 12.
Detail to attention: Exploiting Visual Tasks for Selective Rendering Kirsten Cater 1, Alan Chalmers 1 and Greg Ward 2 1 University of Bristol, UK 2 Anyhere.
Language and Cognition Colombo, June 2011 Day 2 Introduction to Linguistic Theory, Part 4.
Phonological Priming in Spontaneous Speech Production Katrina Housel H uman L anguage P rocessing L ab.
Automatic Essay Scoring Evaluation of text coherence for electronic essay scoring systems (E. Miltsakaki and K. Kukich, 2004) Universität des Saarlandes.
1 Discourse, coherence and anaphora resolution Lecture 16.
Linguistic Theory Lecture 8 Meaning and Grammar. A brief history In classical and traditional grammar not much distinction was made between grammar and.
CS 4705 Algorithms for Reference Resolution. Anaphora resolution Finding in a text all the referring expressions that have one and the same denotation.
Corpus 06 Discourse Characteristics. Reasons why discourse studies are not corpus-based: 1. Many discourse features cannot be identified automatically.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 4.
Final Review CS4705 Natural Language Processing. Semantics Meaning Representations –Predicate/argument structure and FOPC Thematic roles and selectional.
Lecture Eleven Entity-Relationship Modelling
CS 4705 Lecture 21 Algorithms for Reference Resolution.
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 4.
PROMPT: Algorithm and Tool for Automated Ontology Merging and Alignment Natalya Fridman Noy and Mark A. Musen.
Pragmatics I: Reference resolution Ling 571 Fei Xia Week 7: 11/8/05.
UAB UNIVERSITY WRITING CENTER Improving Word Choice.
MACHINE TRANSLATION A precious key to communicate beyond linguistic barriers 1.
Albert Gatt LIN 3098 Corpus Linguistics. In this lecture Some more on corpora and grammar Construction Grammar as a theoretical framework Collostructional.
Taxonomies of Learning Foundational Knowledge: Understanding and remembering information and ideas. Application: Skills Critical, creative, and practical.
Lecture 12: 22/6/1435 Natural language processing Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 3.
Software Engineering Chapter 8 Fall Analysis Extension of use cases, use cases are converted into a more formal description of the system.Extension.
Program Fidelity Influencing Training Program Functioning and Effectiveness Cheryl J. Woods, CSW.
Differential effects of constraints in the processing of Russian cataphora Kazanina and Phillips 2010.
A multiple knowledge source algorithm for anaphora resolution Allaoua Refoufi Computer Science Department University of Setif, Setif 19000, Algeria .
Team Building. Objective Explain What is a Team List the Differences between Group and Team Explain the Characteristics of a Team Explain What is Team.
Psycholinguistic Theory
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 2.
1 LIN 1310B Introduction to Linguistics Prof: Nikolay Slavkov TA: Qinghua Tang CLASS 24, April 3, 2007.
An event related potential investigation of complement set reference Joanne Ingram University of Bedfordshire Linda M Moxey University.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Fall 2005-Lecture 4.
Lecture 17 Ling 442. Exercises 1.What is the difference between (a) and (b) regarding the thematic roles of the subject DPs. (a)Bill ran. (b) The tree.
Economics 173 Business Statistics Lecture 4 Fall, 2001 Professor J. Petry
Creswell Qualitative Inquiry 2e 11.1 Chapter 11 Turning the Story and Conclusion.
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 7.
CHAPTER 3 DETERMINING THE TOPIC IN THIS CHAPTER YOU WILL LEARN:
Lecture 18 Ling 442. Exercises (part 1) 1.Explain the difference between grammatical relations and thematic roles. 2.Provide some examples of verbs with.
Introduction to Linguistics Class # 1. What is Linguistics? Linguistics is NOT: Linguistics is NOT:  learning to speak many languages  evaluating different.
MLS 570 Critical Thinking Reading Notes Fogelin: Ch. 1 Fall Term 2006 North Central College Dr. Sally Fowler.
1 Introduction to Computational Linguistics Eleni Miltsakaki AUTH Spring 2006-Lecture 1.
Deep structure (semantic) Structure of language Surface structure (grammatical, lexical, phonological) Semantic units have all meaning components such.
Unit 4: REFERRING EXPRESSIONS
1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 1.
Can we predict the interpretation of ambiguous symptoms from clinicians’ theories for disorders? Leontien de Kwaadsteniet & Nancy S. Kim.
Chapter 8. Situated Dialogue Processing for Human-Robot Interaction in Cognitive Systems, Christensen et al. Course: Robots Learning from Humans Sabaleuski.
Pragmatics Nuha Alwadaani.
1 By: Ms. Adina Malik (ALK) Agents, Constituencies, Audiences Coalitions Multiple Parties and Teams By: Ms. Adina Malik (ALK)
Teaching literature: what  What sort of literature is suitable for use with learners?  The criteria of suitability depend on group of students, their.
Grammatical and lexical coherence in writing group Done by: O`rinboyeva M. Checked by : RasulovaS.
An evolutionary approach for improving the quality of automatic summaries Constantin Orasan Research Group in Computational Linguistics School of Humanities,
Unit 11: Use observation, assessment and planning
Presentation skills Identify what makes an effective presentation Practise individual presentation skills and receive feedback from each other Demonstrate.
Revision Lecture Cognitive Science. Past papers What is the answer to the question? The answer will nearly always involve: “How amazing it is that people.
Chapter 11 Language. Some Questions to Consider How do we understand individual words, and how are words combined to create sentences? How can we understand.
Lec. 10.  In this section we explain which constituents of a sentence are minimally required, and why. We first provide an informal discussion and then.
Hannah Rohde, Andy Kehler, & Jeff Elman UC San Diego
Predictability affects pronoun production only for some verb types
Referring Expressions: Definition
Algorithms for Reference Resolution
Eleni Miltsakaki AUTH Fall 2005-Lecture 6
CS4705 Natural Language Processing
Structure of a Lexicon Debasri Chakrabarti 13-May-19.
Presentation transcript:

1 Special Electives of Comp.Linguistics: Processing Anaphoric Expressions Eleni Miltsakaki AUTH Fall 2005-Lecture 5

2 Brief review Referential and non-referential pronouns –What are they? Centering –Where is it coming from? –What is it? –What are the basics of the Centering Model? Anaphora resolution algorithms –What is the BFP algorithm? –What is ‘functional centering’? –What is the S-list algorithm?

3 Plan for today Semantic focusing and the relational hypothesis “Interpreting pronouns and connectives: Interactions among focusing, thematic roles and coherence relations” (2000) (R. Stevenson, A. Knott, J. Oberlander and S. McDonald) Still to come –Couple more psycholinguistic studies on anaphora resolution –Linguistic theories of anaphora resolution –Automated systems for anaphora resolution –PROJECTS!

4 The focusing hypothesis Verbs and connectives have focusing properties –The focusing properties of the verb direct attention to the endpoint or consequence of the described event –The focusing properties of the connective depends on its meaning

5 Example with ‘so’ John criticized Bill so he tried to correct the fault. The verb puts Bill, the patient, in focus The connective ‘so’ focuses on consequences and reinforces the focus on Bill

6 Example with ‘because’ John criticized Bill because he failed to correct his faults. Verb brings ‘Bill’ in focus The connective directs attention to the cause, shifts attention from ‘consequence’ to ‘cause’, so less likely to refer to ‘Bill’  The focus of the utterance changes as new input is processed

7 Stevenson et al (1994) 3 types of verbs –Transfer (e.g., pass) –Action (e.g., hit) –State (e.g., impress) Thematic roles –Transfer: Goal-Source –Action: Agent-Patient –State: Experiencer-Stimulus 2 thematic role orders –Goal-Source, Source-Goal –Agent-Patient, Patient-Agent –Experiencer-Stimulus, Stimulus-Experiencer 4 types of connectives –And –So –Full stop –because

8 Sample material for Stevenson et al (1994) John hit Bill/Bill was hit by John so/because/and/. John gave the book to Bill/Bill took the book from John so/because/and/. John liked Bill/Bill pleased John so/because/and/.

9 Results from Stevenson et al 1994

10 Analysis of results Goal and patient always preferred in transfer and action sentences The preferred thematic role in state sentences depends on the connective: Experiencer for ‘so’ and ‘and’, Stimulus for ‘because’ and ‘.’

11 The relational hypothesis The referent of a pronoun is determined by the choice of coherence relation and not what is in focus. RESULT: the thematic role associated with the endpoint of the eventuality, patient PURPOSE: the agent of an event (so this relation is incompatible with states) NARRATIVE: the agent of an event

12 Ambiguity ‘So’ is ambiguous –CONSEQUENCE Bill handed the plate to Bob so he balanced his glass on it. –PURPOSE Bill handed the plate to Bob so he could refill his glass.

13 Experiment 1 3 types of verb –Transfer (e.g., pass) –Action (e.g., hit) –State (e.g., impress) Thematic roles –Transfer: Goal-Source –Action: Agent-Patient –State: Experience-Stimulus 2 connectives –So (RESULT-PURPOSE) –because

14 Sample material from exp. 1 Transfer –Goal-Source: John seized the comic from Bill so/because he… –Source-Goal: John passed the comic to Bill so he… Action –Patient-Agent: Patrick was hit by Joseph so/because he… –Agent-Patient: Joseph hit Patrick so/because he… State –Experiencer-Stimulus: Ken admired Geoff because/so he… –Stimulus-Experience: Ken impressed Geoff so/because he…

15 Results from Exp. 1

16 Analysis of results of Exp. 1 In transfer and action verbs, the preferences fro Goal and Patient were reinforced with ‘so’ and reduced with ‘because’ In state verbs, there was a preference for Experiencer with ‘so’ and for the Stimulus with ‘because’ About relations: –Transfer verbs (pronoun refers to Goal): PURPOSE continuations significantly greater than chance in both thematic orders. RESULT continuations did not differ from chance –Action verbs (pronoun refers to Patient): RESULT continuations were significantly greater than chance in both thematic orders. PUPROSE continuations were significantly less frequent in Patient-Agent, chance for Agent-Patient –State verbs (pronoun refers to Experiencer). RESULT continuations were significantly greater than chance in both thematic orders. PURPOSE continuations significantly lower in Stimulus-Experiencer. No PURPOSE continuations in Experiencer-Stimulus

17 Conclusions from Exp. 1 Focusing hypothesis –Action and transfer: pronoun resolves to Patient-Goal respectively. The focus is maintained when the connective is ‘so’ –State: Connective must be encountered before attention can be directed: Experiencer in state verbs when the connective is ‘so’  Results consistent with the focusing hypothesis Relational hypothesis –Do the preferred pronominal interpretations co-occur with RESULT coherence relations? –YES for actions and states –NO for transfers (PURPOSE predominated in this case) BUT! –A unique coherence relation is consistent with the interpretation of the pronoun within each verb type but not across verbs. PURPOSE in transfer  Goal referents, RESULT in action  Patient referents, RESULT in states  Experiencer referents  Strong view of the relational hypothesis is not supported  Weak view of the relational hypothesis is supported

18 Summary for Exp. 1 Thematic role focusing and coherence relations go together –Action/State: pronoun refers to the focused thematic role associated with the consequence of the event and the relation is RESULT. –Transfer: pronoun refers to the focused thematic role associated with the endpoint of the event and the relation is PURPOSE. –Cf ranking is based on functional information status Participants’ continuations reveal that they selected the meaning of ‘so’ in a way that maximized consistency between the meaning of the verb, the focused entity, the coherence relation and the interpretation of the pronoun.  “Language users strive to keep verb meaning, focusing, coherence relation and pronominal interpretation in alignment.”