Kees van Deemter Computing Science University of Aberdeen

Slides:



Advertisements
Similar presentations
Kees van Deemter Matthew Stone Formal Issues in Natural Language Generation Lecture 4 Shieber 1993; van Deemter 2002.
Advertisements

Generation of Referring Expressions: the State of the Art SELLC Winter School, Guangzhou 2010 Kees van Deemter Computing Science University of Aberdeen.
Some common assumptions behind Computational Generation of Referring Expressions (GRE) (Introductory remarks at the start of the workshop)
SELLC Winter School 2010 Evaluating Algorithms for GRE Kees van Deemter (work with Albert Gatt, Ielka van der Sluis, and Richard Power) University of Aberdeen,
Conceptual coherence in the generation of referring expressions Albert Gatt & Kees van Deemter University of Aberdeen {agatt,
Generation of Referring Expressions: the State of the Art SELLC Summer School, Harbin 2010 Kees van Deemter Computing Science University of Aberdeen.
Charting the Potential of Description Logic for the Generation of Referring Expression SELLC, Guangzhou, Dec Yuan Ren, Kees van Deemter and Jeff.
Generation of Referring Expressions: the State of the Art LOT Winter School, Tilburg 2008 Kees van Deemter Computing Science University of Aberdeen.
Generation of Referring Expressions: the State of the Art LOT Winter School, Tilburg 2008 Kees van Deemter Computing Science University of Aberdeen.
Generation of Referring Expressions: the State of the Art SELLC Winter School, Guangzhou 2010 Kees van Deemter Computing Science University of Aberdeen.
Vagueness: a problem for AI Kees van Deemter University of Aberdeen Scotland, UK.
1 Long term changes to P3P Long Term Future of P3P Workshop Giles Hogben Joint Research Centre European Commission.
CS4018 Formal Models of Computation weeks Computability and Complexity Kees van Deemter (partly based on lecture notes by Dirk Nikodem)
Dr. Ehud Reiter, Computing Science, University of Aberdeen1 NLG Shared Tasks: Lets try it and see what happens Ehud Reiter (Univ of Aberdeen)
Generation of Referring Expressions: the State of the Art LOT Winter School, Tilburg 2008 Kees van Deemter Computing Science University of Aberdeen.
Computational Artistic Creativity and its Evaluation DAVID C BROWN Computer Science Department WPI, Worcester, MA 01609, USA.
Presenting your thesis as a series of papers – to do or not to do.... Dr Sato Juniper Manager, Graduate Research and Scholarships.
Ways to solve problems Top down approach – Break problem up into smaller problems Bottom up approach – Solve smaller problem and then add features – Examples:
School of Computer ScienceG53FSP Formal Specification1 Dr. Rong Qu Introduction to Formal Specification
Problem Statement Give a formal Problem statement showing the input / output; objective (e.g. minimizing computational cost or other relevant metrics)
WXGB6106 INFORMATION RETRIEVAL Week 3 RETRIEVAL EVALUATION.
Preparing for the Verbal Reasoning Measure. Overview Introduction to the Verbal Reasoning Measure Question Types and Strategies for Answering General.
WRITING SKILLS, LANGUAGE SKILLS, AND LANGUAGE-FOR-WRITING SKILLS Coutinho, April 2012 MIKE HANNAY, VU AMSTERDAM.
Research Problem. Outline 1. Learn how to define a research problem in CS field.
Advanced Research Methodology
Robert's Drawers (and other variations on GRE shared tasks) Gatt, Belz, Reiter, Viethen.
Older Adults’ More Effective Use of Context: Evidence from Modification Ambiguities Robert Thornton Pomona College Method Participants: 32 young and 32.
CS3518 Languages and Computability Kees van Deemter Lectures Monday14:00New King’s 14 Tuesday11:00KC T2 Tutorials/Practicals Tuesday13:00-15:00.
How to Read Research Papers? Xiao Qin Department of Computer Science and Software Engineering Auburn University
RANLP, Borovets Sept Evaluating Algorithms for GRE (Going beyond Toy Domains) Ielka van der Sluis Albert Gatt Kees van Deemter University of.
Logic. What is logic? Logic (from the Ancient Greek: λογική, logike) is the use and study of valid reasoning. The study of logic features most prominently.
IB Computer Science – Logic
Corpus-based evaluation of Referring Expression Generation Albert Gatt Ielka van der Sluis Kees van Deemter Department of Computing Science University.
Delphi Evaluation Results PBA Back-End development, Autumn 2012.
Challenge the future Delft University of Technology Peter van Oosterom STW User Committee meeting, Oracle, Utrecht, 19 September 2012 Explanation.
Charting the Potential of Description Logic for the Generation of Referring Expression SELLC, Guangzhou, Dec Yuan Ren, Kees van Deemter and Jeff.
Kees van Deemter Generation of Referring Expressions: a crash course Background information and Project HIT 2010.
Presentation of a paper on “Model-based Software Testing”
Logic You will learn three common logical operations that will be applied in much of the course (spreadsheets, databases, web searches and both programming.
Algorithms and Problem Solving
Engineering Fundamentals and Problem Solving, 6e
Reflective Writing.
Logic You will learn three common logical operations that will be applied in much of the course (spreadsheets, databases, web searches and both programming.
Writing a Thesis for The Research Project
Logical Agents.
Observations on assignment 3 - Reviews
Bin Packing Optimization
Unit 4 Introducing the Study.
Preparing for the Verbal Reasoning Measure
NP-Completeness Yin Tat Lee
Chapter 10: Mathematical proofs
Ontology.
Logic You will learn three common logical operations that will be applied in much of the course (spreadsheets, databases, web searches and both programming.
CSc4730/6730 Scientific Visualization
How to Read Research Papers?
The Argumentative Essay
Stephen Hess Dr. Jeffery Heer Discussion for 4/21 CS 376.
Network Screening & Diagnosis
Flowcharting & Algorithms
Ontology.
Project collaborators’ names
Algorithms and Problem Solving
A programming language
CSCD 506 Research Methods for Computer Science
Synthesis.
Some Programming Paradigms
Getting started with ENDNOTE
From Use Cases to Implementation
Presentation transcript:

Kees van Deemter Computing Science University of Aberdeen Generation of Referring Expressions: the State of the Art LOT Winter School, Tilburg 2008 Kees van Deemter Computing Science University of Aberdeen

Reference to sets: taking stock

Reference to sets: taking stock Remarkably little computational or psycholinguistic work has been done on reference to sets. This stands in contrast to a significant amount of formal semantics work, mostly focussing on collectivity (e.g., Scha 1981, Link 1983) and intensionality (Landman 1989). Problems with computational complexity are even greater than with reference to single objects (but only if brevity is an issue). – Most people agree that getting “the right” descriptions is a more important problem.

Reference to sets: taking stock 3. Gardent (2002, ACL) criticised Van Deemter (2002) for producing overly elaborate descriptions. This can be partly prevented by logical optimisation. [Project: try this, for example using Quine/McCluskey optimisation.] Gardent’s own proposal re-instates Full Brevity. Constraint satisfaction techniques are used to combine declarative problem statement with (relatively!) fast search. Horacek (2004) has proposed alternative techniques for weeding out infelicitous descriptions. Also van Deemter & Krahmer 2007, and especially Gatt 2007 (PhD thesis).

Reference to sets: taking stock Evaluation of algorithms that refer to sets lags behind evaluation in GRE more generally. TUNA evaluation (Van der Sluis et al 2007, Gatt et al 2007) limited this to references to sets of 2. All algoritms performed badly. STEC invited people to submit algorithms that refer to sets, but none was received.

Reference to sets: taking stock 5. Gatt’s work has put the spotlight on intra-NP coherence, e.g. “the Greek and the Italian” is better than “the Greek and the cook” Gatt’s research method is exemplary, and coherence might prove to be an important aspect of text quality more generally (also outside GRE). E.g., Coherence between different NPs: “The Greek ....; The Italian ...” Coherence between all the words in a text. For example, it seems plausible that all the words should have similar degrees of formality

Reference to sets: taking stock 6. Collective reference. Stone (2000) proposes a (constraint-based) GRE algorithm that produces references like “The parallel lines at the top of the screen” ---------------------------- ---------------