Nicoletta Calzolari Istituto di Linguistica Computazionale - CNR - Pisa N. CalzolariNijmegen, August 20101

2 MultiLex GeneLex AcquiLex Xxx-Lex A. Zampolli: Let’s be coherent: Xxx-Lex After the “Grosseto Workshop” (1985): a turning point N. Calzolari 2 Nijmegen, August 2010

N. CalzolariNijmegen, August Reusability  Reusability as key concept  true also today To avoid duplication of efforts, costs, etc. To allow synergies, integration, exchange of data,... To provide a model for new data creation & acquisition “feasible”priorities  Decide on “feasible” areas & state priorities  this is changing over time strong sign of maturity The feasibility of formulation of consensual standards as a strong sign of maturity in the field  we can’t propose standards if there are not enough results on which to base them EAGLES was launched in ‘93 EAGLES was launched in ‘93 Key issues: Do conditions exist for standardisation effort?

Main Results in Lexicon & Corpus WGs First Phase ( N. Calzolari 4Nijmegen, August 2010 Standard for morphosyntactic encoding of lexical entries, in a multi-layered structure, with applications for all the EU languages Standard for subcategorisation in the lexicon: a set of standardised basic notions using a frame-based structure Proposal for a basic set of notions in lexical semantics: focus on requirements of Information Systems and MT Corpus Encoding Standard (CES) from TEI Standard for morphosyntactic annotation of corpora, to ensure compatibility/ interchangeability of concrete annotation schemata Standard for morphosyntactic annotation of corpora, to ensure compatibility/ interchangeability of concrete annotation schemata Preliminary recommendations for syntactic annotation of corpora Dialogue annotation, for integration of written and spoken annotation

N. CalzolariNijmegen, August Content vs. Format/Representation LMF : In LMF : on the abstract meta-model

N. CalzolariNijmegen, August Flexibility in the Recommendations e.g. Morphosyntax Recommendation Level Information Type Recommendation Obligatory  L-0 Part-of-Speech Obligatory Recommended  L-1 Morphosyntactic agreement Recommended features Optional  L-2 Language-specific (or refined) Optional features

N. CalzolariNijmegen, August MERITS  Strengths (from EAGLES-ISLE)

N. CalzolariNijmegen, August Why Standards for Language Resources? (from EAGLES-ISLE)  important for workflows  essential for a LR Infrastructure  for evaluation campaigns

N. CalzolariNijmegen, August Applications: requirements for systems & enabling technologies Machine Translation Information Extraction Information Retrieval Summarisation Natural Language Generation Word Clustering Multiword Recognition + Extraction Word Sense Disambiguation Proper Noun Recognition ParsingCoreference…

N. CalzolariNijmegen, August The Multilingual ISLE Lexical Entry (MILE)

N. CalzolariNijmegen, August MILE – Modularity The building-block model syntactic frame phrase slot Syn feature Lexical Objects Sem feature Lexical entry 1 Lexical entry 2 Lexical entry 3 Allow to express different dimensions of lexical entries Enable modular specification of lexical entries Create ready-to-use packages to be combined in different ways Lexical Classes as the main building blocks of the lexical architecture  Done in LMF

N. CalzolariNijmegen, August The MILE Data Categories User-adaptability and extensibility HUMAN ARTIFACT EVENT ANIMAL GROUP AGE MAMMAL instance_of Core UserDefined MLC:SemanticFeature  OK in ISOCat

N. CalzolariNijmegen, August MILE Lexical Data Category Registry A library of pre-instantiated objects  DC Selections  To be done … in ISOCat

N. CalzolariNijmegen, August ISO - LMF Lexical Markup Framework

N. CalzolariNijmegen, August ISO LMF Structural skeleton, with the basic hierarchy of information in a lexical entry + various extensions  Modular framework  LMF specs comply with modelling UML principles  an XML DTD allows implementation Builds on EAGLES/ISLE NEDOAsianLang. The field is mature NICT Language- Grid Service Ontology ICTKYOTO LIRICS New initiatives … LexInfo

Barcelona, IEC, 7-8 juliol de 2009 Monica Monachini Mettere entrata PAROLE in XML LMF compliant Nijmegen, August 2010

Barcelona, IEC, 7-8 juliol de 2009 Monica Monachini Nijmegen, August 2010 DCR

N. CalzolariNijmegen, August Mapping experiment Major best practices: OLIF PAROLE/SIMPLE LC-Star (Speech Lexicon) WordNet - EuroWordNet FrameNet BDef formal database of lexicographic definitions derived from Explanatory Dictionary of Contemporary French from Monica Monachini

BioLexicon SIMPLE model & ISO-LMF standard N. Calzolari 19Nijmegen, August 2010 BLBL A unique large-scale computational lexicon in the biomedical domain in terms of coverage & typology of information Populated with info from available biomedical resources Semi-automatically populated from corpora: Population toolkit available Including both domain- specific & general language words Rich linguistic information ranging over different linguistic descriptions levels Conformant to international lexical representation standards Designed to meet Bio- Text Mining requirements from Monica Monachini

The BioLexicon: why Nijmegen, August 2010N. Calzolari20

ICT Nijmegen, August 2010 KYOTO: the lexical resource perspective

KYOTO SYSTEM N. Calzolari 22Nijmegen, August 2010 Linear MAF/SYNAF Linear SEMAF Term extraction Tybot Generic TMF Semantic annotation Linear Generic FACTAF Fact extraction Kybot Domain editing Wikyoto Wordnet Domain Wordnet LMF API Ontology Domain ontology OWL API Concept User Fact User from Piek Vossen Source Documents

ICT Nijmegen, August 2010 A common representation format for WordNets Wn IT Wn EN Wn EU Wn NL Wn JP Wn CH Wn ES  endow WordNet with a representation format allowing easy access, integration & interoperability among resources Wn IT Wn EN Wn EU Wn NL Wn JP Wn CH Wn ES

ICT Nijmegen, August 2010 N. Calzolari24 GlobalInformation Lemma Monolingual ExternalRef Monolingual ExternalRefs Sense LexicalEntry Statement Definition SynsetRelation SynsetRelations Monolingual ExternalRef Monolingual ExternalRefs Synset Lexicon Interlingual ExternalRef Interlingual ExternalRefs SenseAxis SenseAxes LexicalResource * * * * Meta 0..1 Meta 0..1 Meta 0..1 Meta 0..* * 0..* * Data Categories from Monica Monachini

ICT Nijmegen, August 2010 A list of 85 sem.rels as a result of a mapping of the KYOTO WordNet grid Inter-WN Intra-WN

ICT Nijmegen, August 2010 N. Calzolari26 SWN n <!ATTLIST SenseAxis id ID #REQUIRED relType CDATA #REQUIRED> <!ATTLIST Target ID CDATA #REQUIRED> <!ATTLIST InterlingualExternalRef externalSystem CDATA #REQUIRED externalReference CDATA #REQUIRED relType (at|plus|equal) #IMPLIED> IWN n WordNet-LMF Multilingual level - Cross-lingual Relations WN n groups monolingual synsets corresponding to each other and sharing the same relations to English link to ontology/(ies) specifies the type of correspondence from Monica Monachini

ICT Kyoto Knowledge Base Nijmegen, August 2010 WnIT Domain WnEN Domain WnEU Domain WnNL Domain WnJP Domain WnCH Domain WnES Domain Ontology Domain Ontology

LMF and Named Entity Lexicon Nijmegen, August 2010 from Monica Monachini N. Calzolari28

Named Entity Lexicon Nijmegen, August 2010 Wikip LR Onto from Monica Monachini N. Calzolari 29

N. CalzolariNijmegen, August LexInfo & Previous Models From Paul Buitelaar

LMF: ILC infrastructure Nijmegen, August 2010 N. Calzolari 31

Desiderata for Semantic Roles 32Nijmegen, August 2010 Martha Palmer N. Calzolari

Nijmegen, August Some steps for a “new generation” of LRs From huge efforts in building static, large-scale, general-purpose LRs To dynamic LRs rapidly built on-demand, tailored to specific user needs From closed, locally developed and centralized resources To LRs residing over distributed places, accessible on the web, choreographed by agents acting over them  From Language Resources To Language Services BUT Need of tools to make this vision operational & concrete

N. CalzolariNijmegen, August Lexical WEB & Content Interoperability As a critical step for semantic mark-up in the SemWeb ComLex SIMPLE WordNets FrameNet Lex_x Lex_y LMF with intelligent agents NomLex Standards for Interoperability Enough?? Global WordNet GRID BioLexicon SIMPLE-WEB

N. CalzolariNijmegen, August A new paradigm of R&D in LRs & LT A new paradigm of R&D in LRs & LT Distributed Language Services

N. CalzolariNijmegen, August A few Issues for discussion: “content”, guidelines, tools, priorities,... Semantic Web “content” interoperability:‘mature’ enough to converge For Semantic Web & “content” interoperability: is the field ‘mature’ enough to converge also for the semantic/conceptual level (e.g. to automatically establish links among different languages)? usability requirements of industrial applications For the standards to have impact, ensure their usability & gain industry support focusing on requirements of industrial applications Guidelines “usable product” To have Guidelines which are a “usable product” (to assist in creation or adaptation of lexicons, …) open-source reference implementation platform & toolsweb services Facilitate acceptance of the standards providing an open-source reference implementation platform & tools, related web services and test suites Spoken language Relation with Spoken language community further stepspriorities Define further steps necessary to converge on common priorities

N. CalzolariNijmegen, August Limits observed & needs of further work

N. CalzolariNijmegen, August Strengths

N. CalzolariNijmegen, August Future requirements & planning

N. CalzolariNijmegen, August FLaReNet Mission: structure the area of LR & LT of the future

N. CalzolariNijmegen, August International Cooperation Some results from FLaReNet Vienna Forum: International Cooperation

N. CalzolariNijmegen, August