Ray Denenberg Ralph LeVan Interoperability Standards & Searching Multiple Repositories Workshop 20 March 25, 2006; Washington.

Slides:



Advertisements
Similar presentations
Terminology Services Ralph LeVan Senior Research Scientist OCLC.
Advertisements

Larry Lannom DOI Workshop Reston, VA 19 September 2000
Resolution issues and DOI doi>. POLICIES Any form of identifier NUMBERING DESCRIPTION framework: DOI can describe any form of intellectual property, at.
Searching Options and Result Sets Sara Randall Endeavor Information Systems October 30, 2003.
Z39.50 as a Web Service Ralph LeVan Research Scientist.
THE DONOR PROJECT Titia van der Werf-Davelaar. Project Financed by: Innovation of Scientific Information Provision (IWI) Duration: –phase 1: 1 may 1998.
Theo van Veen, Koninklijke Bibliotheek The European Library: opportunities for new services.
OCLC Research April 2008 Terminology Services Experimental Services for Controlled Vocabularies.
SRW/U for DSpace Ralph LeVan Research Scientist. What is SRW/U A Pair of HTTP-based Text Query Protocols – SRW: Search and Retrieve Web Service – SRU:
Deconstructing Cataloging A Web Services Approach to Bibliographic Control Thomas Hickey.
Z39.50 as a Web Service Ralph LeVan Research Scientist.
Search Web Services Ralph LeVan Senior Research Scientist.
Ralph LeVan Research Scientist
OCLC Online Computer Library Center SRW & DSpace Ralph LeVan OCLC Research.
Terminology Services Diane Vizine-Goetz Senior Research Scientist OCLC Research.
OCLC Online Computer Library Center SRW & OAI Ralph LeVan OCLC Research.
SRU and CQL Ralph LeVan Senior Research Scientist OCLC.
A centre of expertise in digital information management UKOLN is supported by: SRU: An overview of the SRU protocol and how it can be used.
Searching very large bodies of data using a transparent peer-to-peer proxy Mike Taylor and Marc Cromme, Index Data
CQL – a Common Query LanguageMike Taylor Implementing SRW/U and CQL: Tools 1. Implementing a simple SRU client 2. Implementing serious SRW and SRU clients.
Delivering MARC/XML records from the Library of Congress catalogue using the open protocols SRW/U and Z39.50 Mike Taylor, Index Data
ZeeRex – an Explain Mechanism for SRW/UMike Taylor ZeeRex – an Explain Mechanism for SRW/U 1. What ZeeRex is 2. How we got where we.
Distributed Service Registries Workshop, July 2005 Slide 1 NISO Metasearch Initiative Registries Robert Sanderson Dept. of Computer Science University.
WikiD (Wiki/Data) Jeffrey A. Young OCLC Office of Research Distributed Service Registry Workshop Warwick, UK 14 July 2005.
A REST-ful Web Services Approach to Library Federated Search using SRU Kevin Reiss Rutgers-Newark Law Library CALI 2005 – June 11th.
World Meteorological Organization Working together in weather, climate and water WMO Information System (WIS) Search (with SRU) Timo Pröscholdt (PO-WIS)
Idaho National Engineering and Environmental Laboratory What is a Framework? Web Service? Why do you need them? Wayne Simpson November.
Z39.50 and the Web ZIG July 2000 Poul Henrik Jørgensen, Danish Bibliographic Centre,
Extracting XML from Unicorn with OAI and SRU
Searching Digital Content via SRU Ryan Scherle Randall Floyd October 25, 2006.
ZML  ZNG  ZING “Z39.50 over XML”  “Z39.50 Next Generation”  “Z39.50-international: Next Generation”
Ray Denenberg Ralph LeVan Workshop 20 March 25, 2006; Washington Metasearch - the NISO Initiative.
ELAG 2005 / Workshop 1: ZING Geneva, June 2005 Ole Husby, BIBSYS.
Lesson 2 Technology: Federated Searching Explained.
Stanford University EH&S A Service Oriented Architecture For Rich Internet Applications Sheldon M. Heitz.
SQL Forms Engine Koifman Eran Egri Ozi Supervisor: Ilana David.
Federated Searching: The ABC’s of HSE, XML, & Z39.50 Harry Samuels Product Manager Linking & Searching August 27, 2004.
About Dynamic Sites (Front End / Back End Implementations) by Janssen & Associates Affordable Website Solutions for Individuals and Small Businesses.
Positioning Z39.50 in the Networked Library Standards for Building Sustainable Services William E. Moen School of Library and Information Sciences Texas.
Z39.50 for Finding It All William E. Moen School of Library and Information Sciences Texas Center for Digital Knowledge University of North Texas Denton,
Enabling Embedded Systems to access Internet Resources.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
ELAG 2004  Work Shop on ZING Bill Oldroyd, Animator British Library Janifer Gatenby, Scribe OCLC PICA, Leiden, Netherlands.
It’s Distributed searching, Jim But not as you know it! ZIG meeting, Leuven July 12th, 2000 Bert Degenhart Drenth ADLIB Information Systems BV
ISO ILL, NISO NCIP or OpenURL? ELAG 2005 workshop 2 report Ed. Poul Henrik Jørgensen.
A Web Services Approach for Search and Retrieve The Next Generation Z39.50 Access 2004, October 13-16, 2004, Halifax, Nova Scotia William E. Moen School.
Internet and WWW. Internet A way to send an array of bytes from any machine to any other machine Internet.
More than you want to know about standards Janifer Gatenby, Strategic Research, OCLCPICA.
What does WWW stand for? And following abbreviations? HTTP: Hyper Text Transfer Protocol HTML: Hyper Text Mark-up Language URL: Uniform Resource Locator.
Introduction to Web Services Eric Lease Morgan University Libraries of Notre Dame June 24, 2005.
1 CS 502: Computing Methods for Digital Libraries Lecture 19 Interoperability Z39.50.
Chris Kuruppu NWS Office of Science and Technology Systems Engineering Center (Skjei Telecom) 10/6/09.
OCLC Online Computer Library Center Interoperability Standards & Searching Multiple Repositories Ralph LeVan/OCLC Ray Denenberg/Library of Congress.
Ray Denenberg Rob Sanderson “ Key Standards Updates ” SRU Project Briefing April 4, 2006; Washington.
Server-side Programming The combination of –HTML –JavaScript –DOM is sometimes referred to as Dynamic HTML (DHTML) Web pages that include scripting are.
CNI, 4th April 2006 Slide 1 Key Standards Update: SRU (“Technical” Details) Dr. Robert Sanderson Dept. of Computer Science University of Liverpool
WSDL Specification WSDL = Web Service Description Language Similar to ASN.1 – describes the abstract on the wire data structures Multiple bindings to on.
SRW/U: Re-Introduction SRW is a Web Services based Information Retrieval Protocol Motivations: Create an easy to implement protocol with the power of Z39.50.
Windows 7 WampServer 2.1 MySQL PHP 5.3 Script Apache Server User Record or Select Media Upload to Internet Return URL Forward URL Create.
Next Generation Z39.50 A Web Services Approach for Search and Retrieve 6 th Annual State GILS Conference, March 31 – April 3, 2004, Raleigh, NC William.
Chair: Kevin Gamiel Abstract: How are Z39.50 URLs (Z39.50s and Z39.50r) being used? What purposes should a Z39.50 url serve? Are these existing definitions.
A/WWW Enterprises 15 July 1996 Implementing Queries with Z39.50 A. Warnock A/WWW Enterprises
How Web Database Architectures Work CPS181s April 8, 2003.
Z39.50 and the ZING Initiatives: MAVIS Users Conference, 2003 November 6, 2003 Larry E. Dixson Library of Congress.
OASIS ebXML Registry Standard Open Forum 2003 on Metadata Registries 10:30 – 11:15 January 20, 2003 Kathryn Breininger The Boeing Company Chair, OASIS.
The Language Archive – Max Planck Institute for Psycholinguistics Nijmegen, The Netherlands Implementing SRU/CQL on Trova Herman Stehouwer.
Networking Mehdi Einali Advanced Programming in Java 1.
Web Services Overview Thomas Hickey. 2 What are Web Services? Machine-to-machine communication Run over standard Web protocols –XML syntax, HTTP packaging.
Updated :02 Hong Kong University of Science & Technology Library Workshop on XML-Based Library Applications 4. XML Standards and Tools.
SRU & CQL Ralph LeVan Senior Research Scientist, OCLC
Presentation transcript:

Ray Denenberg Ralph LeVan Interoperability Standards & Searching Multiple Repositories Workshop 20 March 25, 2006; Washington

SRW (Brief) History

late 90’s ….. Initiatives to make Z39.50…. Simpler More comprehensible More easily implemented Web compatible …..while retaining the rich semantics developed over many years

Fast Forward......

SRW/U SRW Search and Retrieve Web Service SRU Search and Retrieve via URL SRW/U Search and Retrieve for the Web

Z39.50 TCP Classic Z39.50

SRW: over SOAP/HTTP Z39.50 TCP Classic Z39.50 SRW TCP “Search and Retrieve web Service” SOAP HTTP

SRU: over HTTP Z39.50 TCP Classic Z39.50 SRU TCP “Search and Retrieve via URL” HTTP

dinosaurs 1 10 mods/ SRW -in a SOAP Envelope

…..Same request via SRU: query= query= dinosaurs &maximumRecords=10 &startRecord=1 &recordSchema=mods

ZING

ZING “Z39.50 (international) Next Generation”

ZING

ZING srwsru

ZING srwsru cql

ZING srwsru cql “Common Query Language”

ZING srwsru cql “Common Query Language” --> “Contextual Query Language”

ZING srwsru cql ZOOM ez3950 zeeRex Record Update

ZING srwsruzeeRex Z39.50 Explain: explained and re-engineered in XML

ZING srwsruzeeRex Z39.50

ZING srwsruzeeRex

ZING srwsruZOOM Z39.50 Object Oriented Model

ZING srwsruZOOM Z39.50

ZING srwsruZOOM

ZING srwsru

SRW/U retains these Z39.50 concepts………. result sets abstract access points abstract record schemas application level diagnostics “Explain”

….. But differs from Z39.50 in these respects: Web-based Connectionless XML CQL

….. But differs from Z39.50 in these respects: Web-based Connectionless XML: Protocol (no ASN.1) + records (no “record syntax”) CQL user-friendly query

Z39.50 SRW/U Connections/Sessions/State Multiple services bound together in a single protocol Distinct Search and Present services Databases Record Syntaxes RPN ASN.1/BER Connectionless, stateless Different Z39.50 services are different web services Search/Present bound in a single web service Servers Just one: XML String query language XML

request via SRU: query= query= dinosaurs &maximumRecords=10 &startRecord=1 &recordSchema= mods

Record Schemas dc mods onix marcxml ead

request via SRU: query= query= dinosaurs &maximumRecords=10 &startRecord=1 &recordSchema=mods

request via SRU: & operation=searchRetrieve &query= &query= dinosaurs &maximumRecords=10 &startRecord=1 &recordSchema=mods

version=1.1& operation=explain version=1.1& operation=explain version=1.1& operation=searchRetrieve&query=dinosaur version=1.1& operation=searchRetrieve&query=dinosaurexplain: Search for “dinosaur”:

&operation=searchRetrieve&query=dinosaur &maximumRecords=1 &operation=searchRetrieve&query=dinosaur &maximumRecords=1&recordSchema=dc Search for “dinosaur”, return 1 record, marcxml: Search for “dinosaur”, return 1 record, dc:

&operation=searchRetrieve&query=dinosaur& startRecord=2&maximumRecords=1& recordSchema=dc return second record: &operation=searchRetrieve&query=dinosaur& startRecord=3&maximumRecords=2& recordSchema=dc Records three and four:

<zs:records> info:srw/schema/1/dc-v1.1 info:srw/schema/1/dc-v1.1 xml xml <srw_dc:dc xsi:schemaLocation=“... <srw_dc:dc xsi:schemaLocation=“... Abbott & Costello cartoons. Abbott & Costello cartoons. Copyright Collection (Library of Congress) DLC Copyright Collection (Library of Congress) DLC (etc.) (etc.) <zs:recordPosition>3</zs:recordPosition> info:srw/schema/1/dc-v1.1 info:srw/schema/1/dc-v <zs:recordPosition>4</zs:recordPosition></zs:record></zs:records>

&operation=searchRetrieve&query=dinosaur &maximumRecords=1&recordSchema=mods MODS record:

&operation=searchRetrieve&query=title=dinosaur &maximumRecords=10&recordSchema=mods Fielded Query: ‘title=dinosaur’

CQL

Sample CQL Queries Cat cat and dog title = cat dc.title = cat

Sample CQL Queries Cat (simple) cat and dog title = cat dc.title = cat

Sample CQL Queries Cat (simple) cat and dog (boolean) title = cat dc.title = cat

Sample CQL Queries Cat (simple) cat and dog (boolean) title = cat (index) dc.title = cat

Sample CQL Queries Cat (simple) cat and dog (boolean) title = cat (index) dc.title = cat (index qualified)

Boolean cat and dog cat or dog Cat not dog cat not dog and fish or frog

((cat not dog) and fish) or frog (cat not dog) and (fish or frog)

Fielded/index Search title = cat

Fielded/index Search title = cat dc.title = cat bib.title = cat Bath.keyTitle Bath.

title = cat Search Clause

Search Clause

title = cat indexrelation search term

title = cat subject = dog and search clauses linked by a boolean

Relations Title = "the complete dinosaur" title all "complete dinosaur“ title any "dinosaur bird reptile" title exact "the complete dinosaur"

Relations Title = "the complete dinosaur" title all "complete dinosaur“ title any "dinosaur bird reptile" title exact "the complete dinosaur"

= Title = "the complete dinosaur“

= Title = "the complete dinosaur“ matches “a day in the life of the complete dinosaur“ and “the complete dinosaur goes to Paris“

= Title = "the complete dinosaur“ matches “a day in the life of the complete dinosaur“ and “the complete dinosaur goes to Paris“ but not “the complete and unabridged dinosaur"

All Title all "complete dinosaur“ matches “the complete and unabridged dinosaur"

Title all "dinosaur bird reptile“ does not match “the complete dinosaur"

Any Title any "dinosaur bird reptile“ does match “the complete dinosaur"

Exact title exact "the complete dinosaur" matches "the complete dinosaur"

Exact title exact "the complete dinosaur" matches "the complete dinosaur" (but does not match: “ a day in the life of the complete dinosaur" )

The anchor character ^

Recall ……. Title = "the complete dinosaur“ matches “a day in the life of the complete dinosaur“

Anchoring title=" ^ the complete dinosaur“ would not match “a day in the life of the complete dinosaur” would match “the complete dinosaur goes to paris”

Right Anchoring title="the complete dinosaur ^ " would not match “the complete dinosaur goes to Paris”

&operation=searchRetrieve&query=title=dinosaur &maximumRecords=10&recordSchema=mods Fielded Query (title) Recall......

&operation=searchRetrieve&query=dc.title=dinosaur &maximumRecords=10&recordSchema=mods Same as: version=1.1& operation=explain version=1.1& operation=explain

&operation=searchRetrieve& query=bath.name=dinosaur &maximumRecords=10&recordSchema=mods Qualified Index: bath.name=dinosaur

&operation=searchRetrieve& query=bath.name all “dinosaur%20barney” query=bath.name all “dinosaur%20barney” &maximumRecords=10&recordSchema=mods bath.name all “dinosaur barney”

&operation=searchRetrieve& query=bath.name exact dinosaur query=bath.name exact dinosaur &maximumRecords=10&recordSchema=mods bath.name exact dinosaur

SRU CQL Explain Operation Scan Operation SRW

“SRW/U”  “SRU” SRW  “SRU over SOAP” and in addition “SRU via Post”