Team 8 Mowry, Srinivasan and Wong Ling 573, Spring University of Washington.

Slides:



Advertisements
Similar presentations
Elliot Holt Kelly Peterson. D4 – Smells Like D3 Primary Goal – improve D3 MAP with lessons learned After many experiments: TREC 2004 MAP = >
Advertisements

QA-LaSIE Components The question document and each candidate answer document pass through all nine components of the QA-LaSIE system in the order shown.
Group 3 Chad Mills Esad Suskic Wee Teck Tan. Outline  System and Data  Document Retrieval  Passage Retrieval  Results  Conclusion.
Group 3 Chad Mills Esad Suskic Wee Teck Tan 1. Outline  Pre-D4 Recap  General Improvements  Short-Passage Improvements  Results  Conclusion 2.
Vikas BhardwajColumbia University NLP for the Web – Spring 2010 Improving QA Accuracy by Question Inversion Prager et al. IBM T.J. Watson Res. Ctr. 02/18/2010.
Answer Extraction Ling573 NLP Systems and Applications May 19, 2011.
Answer Extraction Ling573 NLP Systems and Applications May 17, 2011.
Deliverable #3: Document and Passage Retrieval Ling 573 NLP Systems and Applications May 10, 2011.
Passage Retrieval & Re-ranking Ling573 NLP Systems and Applications May 5, 2011.
Passage Retrieval and Re-ranking Ling573 NLP Systems and Applications May 3, 2011.
A Basic Q/A System: Passage Retrieval. Outline  Query Expansion  Document Ranking  Passage Retrieval  Passage Re-ranking.
’ strict ’ strict ’ strict ’ lenient ‘ lenient ‘ lenient
Question-Answering: Overview Ling573 Systems & Applications March 31, 2011.
1 Block-based Web Search Deng Cai *1, Shipeng Yu *2, Ji-Rong Wen * and Wei-Ying Ma * * Microsoft Research Asia 1 Tsinghua University 2 University of Munich.
Rutgers’ HARD Track Experiences at TREC 2004 N.J. Belkin, I. Chaleva, M. Cole, Y.-L. Li, L. Liu, Y.-H. Liu, G. Muresan, C. L. Smith, Y. Sun, X.-J. Yuan,
SLIDE 1IS 240 – Spring 2010 Logistic Regression The logistic function: The logistic function is useful because it can take as an input any.
Technical Specification / Schedule Department of Computer Science and Engineering Michigan State University Spring 2007 Team : CSE 498, Collaborative Design.
Open Source IR Tools and Libraries
Re-ranking Documents Segments To Improve Access To Relevant Content in Information Retrieval Gary Madden Applied Computational Linguistics Dublin City.
LING 573: Deliverable 3 Group 7 Ryan Cross Justin Kauhl Megan Schneider.
WikiQuery.org -- An interactive collaboration interface for creating, storing and sharing effective CNF queries Le Zhao*, Xiaozhong Liu #, Jamie Callan*
CSC 9010 Spring Paula Matuszek A Brief Overview of Watson.
Query Processing: Query Formulation Ling573 NLP Systems and Applications April 14, 2011.
Leveraging Conceptual Lexicon : Query Disambiguation using Proximity Information for Patent Retrieval Date : 2013/10/30 Author : Parvaz Mahdabi, Shima.
“How much context do you need?” An experiment about context size in Interactive Cross-language Question Answering B. Navarro, L. Moreno-Monteagudo, E.
Lucene Performance Grant Ingersoll November 16, 2007 Atlanta, GA.
ConnectIO Overview and On-boarding IO.CONNECTSMART.COM.
Linking Wikipedia to the Web Antonio Flores Bernal Department of Computer Sciencies San Pablo Catholic University 2010.
Concept Recognition, Information Retrieval, and Machine Learning in Genomics Question Answering J. Gregory Caporaso Center for Computational Pharmacology.
A Data Driven Approach to Query Expansion in Question Answering Leon Derczynski, Robert Gaizauskas, Mark Greenwood and Jun Wang Natural Language Processing.
Question Answering From Zero to Hero Elena Eneva 11 Oct 2001 Advanced IR Seminar.
How to start (initial training) FLL July Customer to provide team list with -responsibility of team members (admin, tech etc.) -computer knowledge.
21/11/2002 The Integration of Lexical Knowledge and External Resources for QA Hui YANG, Tat-Seng Chua Pris, School of Computing.
Controlling Overlap in Content-Oriented XML Retrieval Charles L. A. Clarke School of Computer Science University of Waterloo Waterloo, Canada.
Archiving and Record Retention Service Cammy Webster Assistant Director - CSD DIS Jan 23, 2007.
 Examine two basic sources for implicit relevance feedback on the segment level for search personalization. Eye tracking Display time.
Multi-company Project Team Design Workshop Maximizes buy-in and fit to company culture and business climate Team Implementers, LLC Copyright © 2008.
Personalization with user’s local data Personalizing Search via Automated Analysis of Interests and Activities 1 Sungjick Lee Department of Electrical.
By: Namrata Lele Mentors: Dave Vieglais Bruce Wilson 1 VDC/TWG Meeting August 09.
Ling573 NLP Systems and Applications May 7, 2013.
LING 573 Deliverable 3 Jonggun Park Haotian He Maria Antoniak Ron Lockwood.
August 17, 2005Question Answering Passage Retrieval Using Dependency Parsing 1/28 Question Answering Passage Retrieval Using Dependency Parsing Hang Cui.
Enabling Medical Experts to navigate clinical text for cohort identification (meTAKES) Stephen Wu, Mayo Clinic SHARPn Summit 2012 June 12, 2012.
Mining Dependency Relations for Query Expansion in Passage Retrieval Renxu Sun, Chai-Huat Ong, Tat-Seng Chua National University of Singapore SIGIR2006.
1 Evaluating High Accuracy Retrieval Techniques Chirag Shah,W. Bruce Croft Center for Intelligent Information Retrieval Department of Computer Science.
Query Suggestions in the Absence of Query Logs Sumit Bhatia, Debapriyo Majumdar,Prasenjit Mitra SIGIR’11, July 24–28, 2011, Beijing, China.
Shallow & Deep QA Systems Ling 573 NLP Systems and Applications April 9, 2013.
Improving QA Accuracy by Question Inversion John Prager, Pablo Duboue, Jennifer Chu-Carroll Presentation by Sam Cunningham and Martin Wintz.
(Pseudo)-Relevance Feedback & Passage Retrieval Ling573 NLP Systems & Applications April 28, 2011.
IFS310: Module 2 1/18/2007 Systems Planning and SDLC.
ACCY 141 – Spring 2003 – Research teams Section 1Team Number 1 Last NameFirst Address
The Legal Discovery Track at Iowa: an overview Brian Almquist and Padmini Srinivasan TREC November 2007r 2007.
UIC at TREC 2006: Blog Track Wei Zhang Clement Yu Department of Computer Science University of Illinois at Chicago.
CIS 210 Systems Analysis and Development Week 9 Part I Maintaining Information Systems,
Question Answering Passage Retrieval Using Dependency Relations (SIGIR 2005) (National University of Singapore) Hang Cui, Renxu Sun, Keya Li, Min-Yen Kan,
Empowering Your Collections Team. The Collections Management Query Process Design, organize, Implement 1 The Collections Query 2 How Can We Use a Query.
Information Retrieval and Extraction 2009 Term Project – Modern Web Search Advisor: 陳信希 TA: 蔡銘峰&許名宏.
Queries and Interfaces
Report on the Lucene4IR Workshop
Ling573 NLP Systems and Applications May 16, 2013
Best Business Software Solutions in USA

Team 1: 32 responses Team 2: 55 responses Team 3: 29 responses
CS 5604 Information Storage and Retrieval
ABDULLAH ALOTAYQ, DONG WANG, ED PHAM PROJECT BY:
SWEN 5230 Your Project Title
March 8, 2000 IS 240: Principles of Information Retrieval
MATERIAL Resources for Cross-Lingual Information Retrieval
<Project Name> Milestone Summary Report
Question Answer System Deliverable #2
Presentation transcript:

Team 8 Mowry, Srinivasan and Wong Ling 573, Spring University of Washington

Deliverable 3: Passage Retrieval Overview System Issues Experiments and Results

Deliverable 3: Passage Retrieval System Software used: Indri/Lemur retrieval system

Deliverable 3: Passage Retrieval Issues Query formulation Query Expansion

Deliverable 3: Passage Retrieval Experiments and Results Baseline (w/o QE): Baseline (w/ QE): Stopword list (Lucene):0.0576~ Stopword list (custom): (2004) Stopword list (custom): (2005)

Deliverable 3: Passage Retrieval Experiments and Results 2004 TREC: MRR Strict: MRR Lenient: TREC: MRR Strict: MRR Lenient:

Deliverable 3: Passage Retrieval Future Work Refine Indri query Incorporate passage re-ranking

Deliverable 3: Passage Retrieval That's all for now.