Semantic Annotation Meeting April 14, 2005 NomBank & the Down-to-Earth Parts of Pie-in-the-Sky Adam Meyers New York University April 14, 2004

Semantic Annotation Meeting April 14, 2005 Status of NomBank Arguments of Common Nouns in Penn II Corpus About 200,000 noun instances Speed = approximately 25 instances/hour About 75% Complete Annotation Agreement is about 86% Complete Distribution – August 2005

Semantic Annotation Meeting April 14, 2005 NomBank Examples Verb-Related –His/ARG0 gift of a book/ARG1 to me/ARG2 Adjective Related –The absence of patent lawyers/ARG1 on the court/ARG2 Classes of Nouns (16 Total) –Her/ARG1 husband/ARG0 [Relational-defrel] –A set of tasks/ARG1 [Partitive] –An Oct. 1/ARG2 date for the attack/ARG1 [Attribute]

Semantic Annotation Meeting April 14, 2005 Special NP Phenomena Support –The judge/ARG0 made demands on his staff/ARG2 Transparent Nouns –His/ARG0 first batch of questions

Semantic Annotation Meeting April 14, 2005 Future? NomBank2 – Bridging Coreference –Apple/ARG1 is trying to acquire Disney. –Rivals/ARG0 Microsoft and IBM claim this is unfair. ETCBank (adjectives, idioms, comparatives, etc.) –He/ARG0 was answerable to the state department/ARG1 –He/ARG0 kept tabs on Mary/ARG1 –The WMD was too small/ARGQ for inspectors to see/ARGC __ FactBank – Is that a fact? Who says so? –Mary said/FACT that John did not find/NOT-FACT WMDs.

Semantic Annotation Meeting April 14, 2005 Goals for “Pie in the Sky” The Ultimate Annotation A complete semantic analysis Language independent Analysis anchored by text Merges all current annotation schemata Includes everything, even quantifier scope How much Pie in the Sky is Down to Earth?

Semantic Annotation Meeting April 14, 2005 Pie in the Sky: So Far We chose 2 consecutive sentences and have been iteratively merging annotation from: –PropBank I & II (including identity coreference) –NomBank I & II (including bridging coreference) –Discourse Treebank –EtcBank (NYU adjectives, determiners, etc.) –TimeML & Timex2 –Gazetteer and Word Class Info –FactBank (NYU – Attribution and FACT/NOT-FACT)

Semantic Annotation Meeting April 14, 2005 Pie in the Sky Combine Information from all Current Annotation Schemes into One Representation Don’t Record Everything –Resolve Conflicts –Remove Redundancies (Conservatively) Expand Annotation Where Appropriate –Extend Verb-oriented annotation to other parts of speech Fight Task Centrism – Extension of Annotation to All “Important” Information –Allocate information to appropriate place

Semantic Annotation Meeting April 14, Sentences from ACE File: NBC but Yemen's president says the FBI has told him the explosive material could only have come from the U.S., Israel or two Arab countries. and to a former federal bomb investigator, that description suggests a powerful military-style plastic explosive c-4 that can be cut or molded into different shapes.

Semantic Annotation Meeting April 14, 2005 A Former Federal Bomb Investigator

Semantic Annotation Meeting April 14, 2005 What’s Next? Frontiers in Corpus Annotation II: Pie in the Sky –Incorporate Everything From Workshop Possibilities After Frontiers Workshop –New Text Sample? –Larger Piece of Text: paragraph or whole file? –Other Phenomena? Idioms, Discourse Connectives, Temporal Relations –Choose Bitext and Find International Partners