Research Roadmap of Question Answering

Slides:



Advertisements
Similar presentations
Supporting further and higher education Understanding my Learning Helen Beetham Programme Consultant.
Advertisements

PROCESS FRAMEWORK Lecture - 3. Topics covered PROCESS FRAMEWORK PROCESS MODELS DIFFERENCE.
Use of a Registry for Chronic Disease Management in a Small County Behavioral Health Setting Karen Stockton, Ph.D., M.S.W., B.S.N. Health Services / Behavioral.
Empirical and Data-Driven Models of Multimodality Advanced Methods for Multimodal Communication Computational Models of Multimodality Adequate.
BASD SharePoint Introduction “Get your facts first, then you can distort them as you please.” A. Abraham Lincoln B. Rush Limbaugh C. Samuel Clemens D.
Service Oriented Architecture Concepts March 27, 2006 Chris Armstrong
IR Challenges and Language Modeling. IR Achievements Search engines  Meta-search  Cross-lingual search  Factoid question answering  Filtering Statistical.
Web Logs and Question Answering Richard Sutcliffe 1, Udo Kruschwitz 2, Thomas Mandl University of Limerick, Ireland 2 - University of Essex, UK 3.
CSE USC Fraunhofer USA Center for Experimental Software Engineering, Maryland February Empiricism in Software Engineering Empiricism:
World Wide Web As the World Wide Web increased in popularity, it was difficult to keep track of all web addresses. Search engines were created to minimize.
NAACL Workshop on MTE 3 rd in a Series of MTE adventures 3 June, 2001.
Use of Content Packaging to make Learning Management Systems Interact Nikhil Wason.
ParentChild SoC PlanRuleSubPlan/sRule SoC Name (Project Level Custom Field) Project Level custom field MUST contain SoC Name Task SoC.
Spanish Question Answering Evaluation Anselmo Peñas, Felisa Verdejo and Jesús Herrera UNED NLP Group Distance Learning University of Spain CICLing 2004,
AQUAINT Kickoff Meeting – December 2001 Integrating Robust Semantics, Event Detection, Information Fusion, and Summarization for Multimedia Question Answering.
CS598CXZ Course Summary ChengXiang Zhai Department of Computer Science University of Illinois, Urbana-Champaign.
JAVELIN Project Briefing 1 AQUAINT Year I Mid-Year Review Language Technologies Institute Carnegie Mellon University Status Update for Mid-Year Program.
Challenges in Information Retrieval and Language Modeling Michael Shepherd Dalhousie University Halifax, NS Canada.
Search Engines and Information Retrieval Chapter 1.
DFKI GmbH, , R. Karger Indo-German Workshop on Language Technologies Reinhard Karger, M.A. Deutsches Forschungszentrum für Künstliche Intelligenz.
Evaluation Experiments and Experience from the Perspective of Interactive Information Retrieval Ross Wilkinson Mingfang Wu ICT Centre CSIRO, Australia.
D L T French Question Answering in Technical and Open Domains Aoife O’Gorman Documents and Linguistic Technology Group Univeristy of Limerick.
AnswerBus Question Answering System Zhiping Zheng School of Information, University of Michigan HLT 2002.
AQUAINT Testbed Activity John Burger, Marc Light, Scott Mardis, Alex Morgan The MITRE Corporation © 2002, The MITRE Corporation.
Carnegie Mellon School of Computer Science Copyright © 2001, Carnegie Mellon. All Rights Reserved. JAVELIN Project Briefing 1 AQUAINT Phase I Kickoff December.
Noriko Kando National Institute of Informatics Presented at: Roadmap for Language Resources and Evaluation In a Multilingual Environment: Organised by.
Action Research for 21 st Century Schools Workshop 2.
Project Agenda Project BI in the New Project Project New “Excel-like” out of the box report templates Charts, tables, shapes and images to compose.
Northeast Regional Research Center (NRRC) Summer 2002 Workshops June 11, 2002 MITRE Mark Maybury
Requirements & Specification (Chapter 10) CPSC 356 Database Ellen Walker Hiram College (Includes figures from Database Systems by Connolly & Begg, © Addison.
Research Topics/Areas. Adapting search to Users Advertising and ad targeting Aggregation of Results Community and Context Aware Search Community-based.
Text REtrieval Conference (TREC) Implementing a Question-Answering Evaluation for AQUAINT Ellen M. Voorhees Donna Harman.
AQUAINT Testbed John Aberdeen, John Burger, Conrad Chang, John Henderson, Scott Mardis The MITRE Corporation © 2002, The MITRE Corporation.
Summary Knowledge Bases from Web are Real, Big & Useful: Entities, Classes & Relations Key Asset for Intelligent Applications: Semantic Search, Question.
Theme 2: Data & Models One of the central processes of science is the interplay between models and data Data informs model generation and selection Models.
Mining Dependency Relations for Query Expansion in Passage Retrieval Renxu Sun, Chai-Huat Ong, Tat-Seng Chua National University of Singapore SIGIR2006.
DFKI GmbH, , R. Karger Perspectives for the Indo German Scientific and Technological Cooperation in the Field of Language Technology Reinhard.
Finding the Right Facts in the Crowd: Factoid Question Answering over Social Media J. Bian, Y. Liu, E. Agichtein, and H. Zha ACM WWW, 2008.
Reduce, Reuse, Recycle. Housekeeping… Download EventBoard Mobile and remember to fill out session evaluations… Phasers set to stun, mobile devices set.
Relevance Models and Answer Granularity for Question Answering W. Bruce Croft and James Allan CIIR University of Massachusetts, Amherst.
AQUAINT AQUAINT Evaluation Overview Ellen M. Voorhees.
And the Watson Plugin for the NeOn Toolkit. IST NeOn-project.org The Semantic Web is growing… #SW Pages.
Copyright 2010, The World Bank Group. All Rights Reserved. QUALITY ASSURANCE AND EVALUATION Part 1: Quality Assurance 1.
AQUAINT R&D Program Phase I Kickoff Workshop WELCOME.
1 Question Answering and Logistics. 2 Class Logistics  Comments on proposals will be returned next week and may be available as early as Monday  Look.
1 Evaluation of Multi-Media Data QA Systems AQUAINT Breakout Session – June 2002 Howard Wactlar, Carnegie Mellon Yiming Yang, Carnegie Mellon Herb Gish,
Jon Juett April 21,  Selected very recent papers  Includes some student level event / conference papers  UM Health Counseling Program  Correctly.
1 Evaluation of Opinion Questions ä Session leaders: Ed Hovy, Kathy McKeown ä Topics ä Is evaluating opinion questions feasible at all? How can we construct.
AQUAINT Mid-Year PI Meeting – June 2002 Integrating Robust Semantics, Event Detection, Information Fusion, and Summarization for Multimedia Question Answering.
Using Open Data in Devon Mark Painter Pip Tucker.
Course Code : 15ECSC204 Object Oriented Progamming.
From CLEF to TrebleCLEF Promoting Technology Transfer
Research Roadblocks Related data sets are disjoint,
Information Storage and Retrieval Fall Lecture 1: Introduction and History.
Agile Product Management Craftsmanship
National Integrated Drought Information System: U.S. Drought Portal
Microsoft Ignite /22/2018 3:27 PM BRK2121
Introduction to Software Engineering: Second Edition
Uncontrolled copy when printed
Web IR: Recent Trends; Future of Web Search
Imran Hussain University of Management and Technology (UMT)
Soar Agents for Cyberspace 5/15/2018
CAMMS Webinar cammsideas – Thursday 7th June, 2018
Questioning techniques to challenge your students
Dr Kristin Stock Allworlds Geothinking
Web Mining Research: A Survey
Groups at Work- Copyright 2010 – MiraVia LLC – All rights reserved
ITPC-05XX Design standards
What Does it Mean to Get Gold in CII Badging?
Presentation transcript:

Research Roadmap of Question Answering 2003-2006 Planned Desired Shared data, problems, test suites, evaluation at milestones Speed Limit Inference Related Fields: HPKB, TDT, DB, Virtual Ref Desk, User Modeling Productive, Quality QA Speed Limit Robust NLP What If Questions Measurable Progress Composable Toolkit for QA Personalized QA Multimodal Answers 2006 Resource Selection Collaborative QA Requirements Determination Methodolgies for QA Analysis Resource & Evaluation Why Questions Constrained QA (Resource/Solution) Multimodal QA Answer Justification Script/Template Answers Answer Toplogy Crosslingual QA Stereotypical and Indivdualized QA Feasibility Testing Multilingual QA How Questions Question/Answer Typologies Temporal QA Multisessional QA (including change detection) User Typology Task Modeling Empirical Studies QA Reuse Fact Answers Evaluation QA as Planning Wizard of Oz QA Sets Interactive Dialog Factoid Questions Answer Fusion Collect QA Logs Create QA Sets Interoperability Quality Assurance Task Model Public Taxonomies (e.g., OpenDirectory in RDF) Semi-structured Data User Expectations Reuse across sessions 2003 TIMEBANK TIMEML Reusable Test Collection “Perspective BANK“ USC/ISIS Question Typology START, FaqFinder, Ionaut, QANDA Web Services (e.g., Google API) TREC QA trec.nist.gov/data/qa.html Systems (Performance & Eval) Resources (Development, Evaluation) Methods & Algorithms Copyright © 2002 Mark Maybury

Research Roadmap of Question Answering 2003-2006 Related Fields: Speed Limit Future QA Speed Limit Outcome Outcome Outcome 2006 RoadBlock item dependency 2003 item Lane Lane Lane