Federated v. Aggregated A debate. Keith Ewing MnPALS User Groups Meeting 28 October 2008.

Slides:



Advertisements
Similar presentations
View from Elsevier NISO Metasearch Initiatives Meeting May 7, 2003 M. Krellenstein.
Advertisements

Metasearching: The Problem, Promise, Principles, Possibilities & Perils Roy Tennant California Digital Library.
Federated Search of Today and Tomorrow Shanyun Zhang Electronic Resources Librarian, John K. Mullen Library The Catholic University of America Potomac.
Federated Searching In a Nutshell 21 st Century Literacies 18 November 2005.
Features and Uses of a Multilingual Full-Text Electronic Theses and Dissertations (ETDs) System Yin Zhang Kent State University Kyiho Lee, Bumjong You.
© 2009 Deep Web Technologies, Inc. Federated Search: A Tool for Knowledge Discovery iGroup Online Education Conference Presented by Abe Lederman Founder.
Not All Federated Search Engines are Created Equal Abe Lederman, President and CTO Deep Web Technologies, Inc. Next Generation Library Technologies, May.
Lesson 1 Introduction: Federated Searching Defined.
Toppling the Monolith: Modularity in Next Generation Integrated Library Systems Karen Calhoun Professional Development Week Cornell University Library.
Optimized Data Migration within a System of Linked Medical Research Databases By Jared Christopherson U. of Connecticut.
River Campus Libraries Metadata That Supports Real User Needs David Lindahl Director of Digital Library Initiatives University of Rochester Libraries.
Rethinking the library catalogue: making search work for the library user Sally Chambers The European Library
Internet Resources Discovery (IRD) IBM DB2 Digital Library Thanks to Zvika Michnik and Avital Greenberg.
River Campus Libraries Metadata That Supports Real User Needs Jennifer Bowen Head of Cataloging University of Rochester Libraries David Lindahl Director.
River Campus Libraries Find Articles A Web Redesign for ENCompass David Lindahl Web Initiatives Manager River Campus Libraries University of Rochester.
Lesson 2 Technology: Federated Searching Explained.
River Campus Libraries Find Articles A Web Redesign for ENCompass David Lindahl Web Initiatives Manager River Campus Libraries University of Rochester.
Lund Online 07/10/2009 Ingolf Kaspar, Regional Sales Manager EBSCO Publishing.
River Campus Libraries Metadata That Supports Real User Needs Jennifer Bowen Head of Cataloging University of Rochester Libraries David Lindahl Director.
The Promise & Perils of Metasearching Roy Tennant California Digital Library Roy Tennant California Digital Library.
Lesson 4 The Debate Pros and Cons of Federated Searching.
Web-scale discovery services: searching the library in the era of Google Katie Dunn Technology & Metadata Librarian Rensselaer Polytechnic Institute Slides:
Metadata Standards & Applications 7. Approaches to Models of Metadata Creation, Storage, and Retrieval.
Federated Searching Pre-Conference Workshop - The federated searching cookbook Qin Zhu HP Labs Research Library February 18, 2007.
Databases & Data Warehouses Chapter 3 Database Processing.
Federated Search: True Enterprise Search Abe Lederman, President and CTO Deep Web Technologies Search Engine Meeting – April 28-29, 2008.
State of the Art: Federated Search Engines ICOLC April 13, 2005.
What we learned while building DLESE Katy Ginger Metadata Architect, Meteorologist, Instructional Designer.
UNDERSTANDING THE NEW DISCOVERY LANDSCAPE: Federated Search, Web-scale Discovery, Next- Generation Catalog and the rest Marshall Breeding Director for.
© 2011 Deep Web Technologies, Inc. By Abe Lederman President and CTO June 26, 2011 Understanding Differences Between Federated Search and Discovery Services.
LIBRARY RESOURCE DISCOVERY PRODUCTS: COMMERCIAL AND OPEN SOURCE OPTIONS Web Manager’s Academy Marshall Breeding Director for Innovative Technology and.
LIS 506 (Fall 2006) LIS 506 Information Technology Week 11: Digital Libraries & Institutional Repositories.
HELPING YOUR LIBRARY BE THE BEST PARTNER FOR RESEARCH.
LIBRARY RESOURCE DISCOVERY PRODUCTS AND SERVICES: OVERVIEW AND PERSPECTIVES Marshall Breeding Director for Innovative Technology and Research Vanderbilt.
Web Scale Discovery Service Vs Federated Search NIKESH NARAYANAN
OpenURL Link Resolvers 101
Not All Federated Searches are Created Equal Abe Lederman, President and CTO Deep Web Technologies Thomson Scientific Government Event, April 10, 2008.
7. Approaches to Models of Metadata Creation, Storage and Retrieval Metadata Standards and Applications.
University of North Texas Libraries Building Search Systems for Digital Library Collections Mark E. Phillips Texas Conference on Digital Libraries May.
CourseCrawler Matt Berntsen Don Frehulfer Evan Kaiser.
Making the Most of E-Journal Usage Data Electronic Resources & Libraries 2008 March 20, 2008 Gayle Baker, Eleanor Read & Maribeth Manoff.
ITIS 1210 Introduction to Web-Based Information Systems Chapter 27 How Internet Searching Works.
THE STATE OF LIBRARY SEARCH AND DISCOVERY Marshall Breeding Director for Innovative Technology and Research Vanderbilt University Library Founder and Publisher,
Instructor: Dema Alorini Database Fundamentals IS 422 Section: 7|1.
Copyright © 2004 MuseGlobal, Inc. All Rights Reserved MetaSearch Present & Future Dr Peter Noerr, ASEE Conference 2004 MuseGlobal, Inc.Salt Lake City.
DISCOVERY PRODUCTS AND SERVICES: Introduction and current trends Marshall Breeding Director for Innovative Technology and Research Vanderbilt University.
Homework Full-text article – entire textual contents of article in online format Abstract – brief summary of article Citation – basic information required.
CONTENT DISCOVERY, SERVICES, AND SUSTAINED ACCESS Timothy Cole, William Mischo, Beth Sandore, Sarah Shreeves ~ University of Illinois Library
Usability Issues in Metasearch Interface Design: persectives of an information provider LITA Human Machine Interface Interest Group June 25, 2004 Oliver.
GUIDED BY DR. A. J. AGRAWAL Search Engine By Chetan R. Rathod.
Once and Future Metasearching Roy Tennant California Digital Library Roy Tennant California Digital Library.
Mississippi State University Libraries’ EBSCO Discovery Service Experience.
Digitization – Basics and Beyond workshop Interoperability of cultural and academic resources New services for digitized collections Muriel Foulonneau.
Modern Information Retrieval Presented by Miss Prattana Chanpolto Faculty of Information Technology.
Federated Search: The Good and the Bad Abe Lederman, President and CTO Deep Web Technologies, Inc. APLA May 9, 2008.
© 2010 Deep Web Technologies, Inc. Taking the Library Back from Google Abe Lederman, President and CTO Deep Web Technologies May 12, 2010.
Information Retrieval CSE 8337 Spring 2007 Introduction/Overview Some Material for these slides obtained from: Modern Information Retrieval by Ricardo.
THE FUTURE OF THE LIBRARY CATALOG OPACS GIVE WAY TO DISCOVERY Marshall Breeding Director for Innovative Technology and Research Vanderbilt University Library.
GPO’s Future Digital System (FDsys) November 2, 2006 LS&CM CENDI Presentation.
1 CS 430: Information Discovery Lecture 26 Architecture of Information Retrieval Systems 1.
Taking the Library Back from Google Abe Lederman, President and CTO October 18-20, 2007.
University of North Texas Federated Search Mark E. Phillips August 24, 2006.
Federated searching Hundred of resources, one interface – is it possible? By Helle Lauridsen Technology Manager, CSA.
THE EVOLUTION OF LIBRARY COLLECTION DISCOVERY: Marshall Breeding Director for Innovative Technology and Research Vanderbilt University Library Founder.
Networked Information Resources Federated search, link server, e-books.
SEMINAR ON INTERNET SEARCHING PRESENTED BY:- AVIPSA PUROHIT REGD NO GUIDED BY:- Lect. ANANYA MISHRA.
Federated & Meta Search
WIRED Week 2 Syllabus Update Readings Overview.
Metasearching Librarians Like Searching, Users Like Finding
By Abe Lederman President and CTO June 26, 2011
Presentation transcript:

Federated v. Aggregated A debate. Keith Ewing MnPALS User Groups Meeting 28 October 2008

The Problem Information is scattered. Information is scattered. Internal Catalog of physical materials Local digital collections and assets Public and vended data providers Multiple content sources Frequently duplicated content External Requiring multiple search interfaces User confusion and frustration

What users want then sort, rank, and show me the first 10 scholarly, peer- reviewed, full-text, accessible, easy-to-read, results Search everything: GOOGLZONGOOGLZON

Federated Search (MetaSearch) User Search DB1 DB2 DB3 DB4 DB5 Broadcast Retrieve Collect Sort De-Dup

Aggregated Search (Google-ized) Search Harvest Crosswalk Index De-Dup DB1 DB2 DB4 DB5 User DB3 Display

Head-to-Head Sources: External/OAI/Web Sources: External/OAI/Web Aggregate: at search Aggregate: at search Minimal bandwidth, but searches can be slowed by Internet congestion Minimal bandwidth, but searches can be slowed by Internet congestion Content updates by vendor may be in real time Content updates by vendor may be in real time Authentication with query Authentication with query Screen-scraping  weak results Screen-scraping  weak results Relevance ranking uneven due to multiple vendors Relevance ranking uneven due to multiple vendors Uneven delays in retrieval Uneven delays in retrieval Sources: Internal/Negotiated external Sources: Internal/Negotiated external Aggregate: at index Aggregate: at index High bandwidth for harvest, lower for search, but high hardware storage costs High bandwidth for harvest, lower for search, but high hardware storage costs Content updates dependent on harvest timing Content updates dependent on harvest timing Authenticate to access Authenticate to access Metadata  stronger results Metadata  stronger results Consistent relevance ranking Consistent relevance ranking No delay in retrieval No delay in retrieval FederatedAggregated

A debate with no winner Depends on what you want/need Depends on what you want/need Each has its use Each has its use Analyze what you want/need Analyze what you want/need What works for one library may not work for a consortium What works for one library may not work for a consortium Neither will solve all problems alone Neither will solve all problems alone Probably need both Probably need bothBut…

As students change… Will they understand the difference? Will they understand the difference? Will teaching the difference be enough to change behaviors? Will teaching the difference be enough to change behaviors?