Cocosda 2001  ELRA/ELDA KC/1 Brief Overview of recent activities in Europe Khalid CHOUKRI ELRA/ELDA 55 Rue Brillat-Savarin, F Paris, France Tel Fax Web:

Cocosda 2001  ELRA/ELDA KC/2  ELRA …  European vs National activities  Speech resources collections  Other projects (Enabler, EuroMap, etc.)  Evaluation  LREC2002 Outline

Cocosda 2001  ELRA/ELDA KC/3 European Language Resource Association An Improved infrastructure for Data sharing Centralized Not-for-profit organization for the collection, distribution, and validation of speech, text, and terminology resources and tools. Extension to: Multimodal/Multimedia Resources Evaluation.

Cocosda 2001  ELRA/ELDA KC/4 European Language Resource Association An Improved infrastructure for Data sharing  A Repository Center:  Technical & Logistic issues  Commercial issues (prices, fees, royalties)  Legal issues (Licensing, IPR)  Information Dissemination An Association of users of Language Resources

Cocosda 2001  ELRA/ELDA KC/5 Brief Overview of recent activities in Europe European Union Level

Cocosda 2001  ELRA/ELDA KC/6 Brief Overview of recent activities in Europe National Level

Cocosda 2001  ELRA/ELDA KC/7 Brief Overview of recent activities in Europe European Union Level European R&D Framework Programmes (FP): back to early Eighties On-going Actions FP5 with a Thematic programme on Information Society technologies MLIS (Multi-Lingual Information Society) INCO (International Cooperation ) E-Content

Cocosda 2001  ELRA/ELDA KC/8 Brief Overview of recent activities in Europe European Union Level European R&D Framework Programmes (FP): back to early Eighties On-going Actions E-Content: Promoting European Digital Content on the Global Networks". action line 1: "Improving access to and expanding use of public sector information" action line 2: "Enhancing content production in a multilingual and multicultural environment

Cocosda 2001  ELRA/ELDA KC/9 Brief Overview of recent activities in Europe European Union Level Some Projects within FP5 and previous FPs …. Related to Cocosda concerns  Resources production: Speechdat Family  Specifications of new types of resources: Natural Interaction and MultiModality within ISLE (International Standards for Language Engineering) project  Dialog & Evaluation : Seneca  Evaluation: CLASS  Standards: Eagles and its extension … the EU/US collaborative project ISLE  Networks: ELSNET, ENABLER  Information gathering & Dissemination : Euromap and its follow-up Hope

Cocosda 2001  ELRA/ELDA KC/10 SpeechDat Family  SpeechDat(M) --- Fixed Telephone network -- 1K Speakers  SpeechDat-II Fixed, Mobile, 1-5Kspeakers  SpeechDat-II Speaker Verification  SpeechDat-E (CEE - Polish Czech Slovak Russian Hungarian)  SALA (Speech Across Latin America) and Now SALA-II  SpeechDat-Car (inc. cellular)  SpeeCon (Consumer products)  Orien’tel

Cocosda 2001  ELRA/ELDA KC/11 SpeeCon Project

Cocosda 2001  ELRA/ELDA KC/12 SpeeCon Project

Cocosda 2001  ELRA/ELDA KC/13 SpeechDat Family: OrienTel Multilingual access to interactive communication services for the Mediterranean and the Middle East 7 linguistic regions10 OrienTel countries 23 databases

Cocosda 2001  ELRA/ELDA KC/14 SpeechDat Family: OrienTel

Cocosda 2001  ELRA/ELDA KC/15 SpeechDat Family: SALA

Cocosda 2001  ELRA/ELDA KC/16 SpeechDat Family: SALA - II US English North West US English South West US English North East US English South East US Spanish East (Caribbean variant) US Spanish West (Mexican variant) Canadian British English Canadian American English Canadian French

Cocosda 2001  ELRA/ELDA KC/17 Other resources’ oriented projects  C-Oral-Rom : Conversational Speech Roman Languages: French, Italian, Spanish, Portuguese Roman Languages: French, Italian, Spanish, Portuguese “Comparable” data

Cocosda 2001  ELRA/ELDA KC/18 Brief Overview of recent activities in Europe European Union Level A major project within MLIS …. Related to Cocosda concerns NETWORK-DC: Network of international & regional Data Centers Partners: ELRA, SPEX & LDC Others (GSK,…) welcome to join

Cocosda 2001  ELRA/ELDA KC/19 Brief Overview of recent activities in Europe National Level

Cocosda 2001  ELRA/ELDA KC/20 Brief Overview of recent activities in Europe National Projects/programs Netherlands & Belgium: Dutch spoken Corpus (Coming presentation): Data Available via ELRA, Release of April2001 OVER Nine National projects: Germany: From Vermobile (Data Available via ELRA) to SmartKom France: Reseau National en Recherche en TéléCommunication (RNRT), Others RIAM, RNTL, Coming: Evaluation program……….. Italy, Greece, Czech, ….

Cocosda 2001  ELRA/ELDA KC/21 Brief Overview of recent activities in Europe National Projects/programs… Dutch & Flemish

Cocosda 2001  ELRA/ELDA KC/22 MARKET ANALYSIS First objective:  To get hard facts about the needs/requirements  To get reliable figures about the market Second objective:  To enforce /confirm our knowledge / assessments

Cocosda 2001  ELRA/ELDA KC/23 Million € MARKET ANALYSIS (Worldwide Market of LR - Commercial Use) Courtesy of Siemens

Cocosda 2001  ELRA/ELDA KC/24 Speech Recognition -- Market Segmentation Implications for the Language Resource Market  50 Languages  30K€ per LR Telephony: 2 databases/language (fixed and mobile network) Consumer: 2 databases/language (car and public environment) * all databases needed by all providers of speech recognition technology ** Estimated accumulated market from 1998 until 2003 ( in M€)

Cocosda 2001  ELRA/ELDA KC/25 * Number of new databases licensed from owners ** Costs in K€ *** offered in ELDA catalog Example of Investments needed

Cocosda 2001  ELRA/ELDA KC/26 * Number of new databases licensed from owners ** Costs in K€ *** offered in ELDA catalog Example of Investments needed

Cocosda 2001  ELRA/ELDA KC/27 Distribution Activities of Language Resources for Evaluation (via ELRA) EVALUATION ACTIVITIES

Cocosda 2001  ELRA/ELDA KC/28  AURORA (Speech distributed recognition)  AMARYLLIS (Multilingual/Parallel corpora)  CLEF (Cross-Language Evaluation Forum)  ARCADE/ROMANSEVAL Distribution Activities Language Resources for Evaluation

Cocosda 2001  ELRA/ELDA KC/29  AURORA (Speech distributed recognition) Set up to establish a worldwide standard for the feature extraction software in a DSR (Distributed Speech Recognition) system: (i) Evaluation of algorithms for front-end feature extraction algorithms in background noise (ii) Evaluation and comparison of the performance of noise robust speech recognition algorithms. Distribution Activities Language Resources for Evaluation

Cocosda 2001  ELRA/ELDA KC/30  AMARYLLIS (Multilingual/Parallel corpora) Promoting the creation of corpora and evaluation procedures for the French language (i) Evaluation of information retrieval systems in French text corpora (ii) Methodology of evaluation for similar search tools Distribution Activities Language Resources for Evaluation

Cocosda 2001  ELRA/ELDA KC/31  CLEF (Cross-Language Evaluation Forum) Promoting research and development in Cross-Language Information Retrieval (CLIR) (i) providing an infrastructure for the testing and evaluation of information retrieval systems - European languages - monolingual and cross-language contexts (ii) creating test packages of reusable data which can be employed by system developers for benchmarking purposes. Distribution Activities Language Resources for Evaluation

Cocosda 2001  ELRA/ELDA KC/32  ARCADE/ROMANSEVAL Promoting research in the field of multilingual alignment Evaluation of parallel text alignment systems In collaboration with SENSEVAL/ROMANSEVAL exercise on word sense disambiguation for Romance languages Distribution Activities Language Resources for Evaluation

Cocosda 2001  ELRA/ELDA KC/33  Language Resources for Evaluation (production/commissioning; Distribution)  Methodologies for Evaluation  Management of Evaluation Campaigns  Evaluation of Language Resources (Validation) European Language Resource Association & Evaluation

Cocosda 2001  ELRA/ELDA KC/34 ENABLER European National Activities for Basic Language Engineering & Resources  Survey of existing national activities  Fostering common research and compatibility of LR  Suggestion for and contribution to international cooperation -- A new Initiative  Identification of existing resources (Universal Catalogue)  The Basics (e.g. Standards, tools, evaluation procedures, …) Extension foreseen/ Planned

Cocosda 2001  ELRA/ELDA KC/35 EUROMAP - HOPE HLT CENTRAL

Cocosda 2001  ELRA/ELDA KC/36 EUROMAP - HOPE HOPE is a knowledge building and dissemination project whose main goal is to raise awareness about the market readiness and potential benefits of Human Language Technologies (HLT) among appropriate market players in the information society.

Cocosda 2001  ELRA/ELDA KC/37 EUROMAP - HOPE

Cocosda 2001  ELRA/ELDA KC/38 LREC-2002 LAS PALMAS DE GRAN CANARIA, CANARY ISLANDS SPAIN

Cocosda 2001  ELRA/ELDA KC/39 LREC-2002 Issues in the design, construction and use of Language Resources (LR) Issues in Human Language Technologies evaluation General issues (National and international activities and projects, Cooperations,…) Conference: MAY 2002 Pre Conference Workshops: MAY 2002 Post Conference Workshop: 1-2 JUNE 2002

Cocosda 2001  ELRA/ELDA KC/40 LREC-2002 …. IMPORTANT DATES Submission of proposals for oral and poster papers, referenced demos, panels and workshops: 20 NOVEMBER 2001 Notification of acceptance of workshop and panel proposals: 10 DECEMBER 2001 Notification of acceptance of papers, posters, referenced demos: 2 FEBRUARY 2002 Final versions: 2 APRIL 2002