A Globally Interoperable Scottish Subject Landscape? HILT, SPEIR and a Scottish Terminologies Server CIGS Scottish Terminologies Day, September Dennis Nicholson: Centre for Digital Library Research

Overview n HILT: Scope and Participants n HILT I: Aims and Outcomes n HILT II: u Aims, Overview of the Problem, Outcomes u Server Design Summary  Function; Elements; Coverage; Use u Other Points of Note; Costs; Alternatives u Evaluation, M2M reports u HILT futures; Pilot server demo n SPEIR; A Scottish Pilot n A Way Forward in Scotland

SCOPE and Participants n JISC focus (funders); but problem tackled of global importance n Both HILT I and HILT II involved: u CDLR; mda; NCA; OCLC; UKOLN; RDN;JISC; FE Representative; NGfL Scotland; SLIC; SUfI; British Library, NLS, others world-wide via u Terminology experts, Alan Gilchrist and Leonard Will (external evaluator)

HILT 1: Aims n Look into the problem of cross-searching and browsing by subject across UK services in Libraries, Museums, Archives, HE, FE, Public Libraries, electronic services, clumps projects, JISC IE services (RDN etc.) n Were they using different subject schemes, or the same schemes differently, and did it matter? n If it did, could a consensus be reached on a solution that was affordable, sustainable, implementable, politically acceptable, useful, future proofed, and the rest…

HILT 1: Conclusions n Many different subject schemes, practices in use n That cross searching by subject was considered of value to users and staff. n That an online service that would map subject schemes to user terminologies and to each other was the preferred solution (Workshop outcomes) n But that things like level and nature of user need, design requirements, and costs against benefits needed to be examined before we committed to a possibly expensive solution n Finally, there was a strong consensus favouring the creation of a pilot service and an investigation of these issues

HILT Phase II: Aims n Build pilot terminologies service for JISC Information Environment, aiming to: u Provide a practical experimental focus within which to investigate and establish subject terminology service requirements for the JISC I.E u Make recommendations as regards a possible future service

HILT II: The Problem in Outline n JISC services (and other services JISC users need to cross-search) have: u Different schemes in use u Different versions of the same scheme u Varied approaches to amending, extending n Schemes, variations vary in ability to reflect terminologies used by users when searching n Resources in distributed services, so users need to: u Identify services appropriate to their search u Identify relevant items by using correct term for scheme used

HILT II: Outcomes n Recommended a follow-up development project to build a working terminologies server with specific features n Since consensus, collaboration seen as vital, recommended (1) A dialogue with key national and international players (2) A server design that assumed :  Mapping between schemes, rather than preference for a single scheme (HILT I)  The need for a facility to allow others to include their own (self-provisioned) mappings  The existence of other terminology servers

Server Functions n Improve accurate, informed searching by users n Improve accurate, consistent description by staff n Harmonise staff amendments and extensions to schemes (UK Terms Registry) n Map between schemes, variations via DDC spine n Map user terms to DDC, collections, other schemes n Serve up mappings via various m2m and h2m routes n Ultimately: improve retrieval from legacy metadata n Monitor, learn from user terminology sets

Server Elements n Wordmap; three elements: u Database (Oracle) of terminology mappings u User front end that interacts with database according to staff specifications and user input and feedback u Drag and drop, multi-user interface to support sophisticated staff interaction with database for creation and maintenance of maps, inter-service co-ordination and training

Server Schemes n Proposed Development Server: u DDC spine; captions; relative index; standard subdivisions u LCSH to DDC mapping u UNESCO to DDC mapping u UK terms registry (mapped to DDC) u Optional: MeSH, Regional registry, AAT n Pilot: u More limited – UNESCO, MeSH illustrative, no AAT, UK Terms

The Server in Action n User enters subject term n Term matched to terminology set and mapped to DDC n Options returned; user ‘disambiguates’ n DDC number truncated, mapped to collections database to identify appropriate collections n Info on scheme used; advice; sample retrieval n Demonstration available at: n Or

Other Points; Costs n More sophisticated user interface facilities needed n Further Research into user needs generally n Machine to Machine (M2M) Facilities and Interactivity Issues n No to ‘Limited granularity mapping’ n Information Environment Services Registry (IESR) Issues n Costs over 5 years

HILT II Evaluation n Evaluation report conclusions were that: u The general approach and proposals of the HILT project are reasonable and worth pursuing. u Some underlying problems in mapping of compound concepts need to be investigated further and solutions found before investing in major mapping or terminology service implementation work. u Finally, it must be recognised that any service of this kind will have to be sustainable in the long term, and that continuing work will be needed long into the future to maintain and develop it.

HILT II M2M n Special report on m2m; follow-up project should: u Provide m2m demonstrator services based on controlled vocabularies mapped within Wordmap (Develop SOAP based interfaces between JISC IE components and Wordmap). u Look into use of the Zthes protocol. u Track developments within the Semantic Web and activities within e-Science to ensure forward compatibility of syntax for structuring vocabularies, and data exchange protocols

HILT Futures n Known futures:  M2M Feasibility Study  M2M Demonstrator  Then what? n Possible futures:  JISC and others finance ongoing work in a ‘global’ terminology mapping service  Limited implementations in domain-based environments  Do Nothing?  Leave it to others (OCLC? Google?)  Global; Will deteriorate until tackled

Demonstration n The Server in Action (2) u User enters subject term u Term matched to terminology set and mapped to DDC u Options returned; user ‘disambiguates’ u DDC number truncated, mapped to collections database to identify appropriate collections u Info on scheme used; advice; sample retrieval u Demo:

HILT Offline Demo n The slides you are about to see are screen shots n But the pilot works – try it and see n But use Internet Explorer and remember it is illustrative – you won’t be able to ‘break it’ but you have to use known examples to see it at its best…

Examples n Aliment n Loch n Bairn n Population n Leisure n Child Development n Opinion polls n Tooth n But try what you like – just don’t expect miracles n An amusing thing to try is the contraction for General Practitioner - GP

SPEIR… n A Scottish Pilot u Adapted from HILT u Small selective mapping:  Aliment  Provost  Bairn etc u Ends with CAIRNS search u As with HILT, many issues

A Way Forward in Scotland n Tidy up our own backyard (and keep it tidy!) n Assume HILT or similar will solve the global problem and base our tidy up on that (e.g. map to LCSH or DDC) n Maybe it will… n Even if it doesn’t, we’ll still have made things better here and have a sound basis in international ‘standards’

A Way Forward in Scotland n Where possible, adopt international ‘standards’ – probably LCSH n Only adapt or extend if essential n Try to get extensions adopted via SACO n Standardise other essential additions via a Scottish authority file n Map Scots and Gaelic terms to LCSH n Work within COSMIC’s SCI, maybe with a physical interoperability group, maybe with a virtual one, maybe both

Coordination and Management: To guide strategy, policy, planning, infrastructure design & development, training, institutional representation etc | Implemented via COSMIC and existing or new groups. Research & Development: Technical and non-technical work to progress the infrastructure in line with an agreed joint R&D plan | Undertaken by participating groups or institutions | Backed by COSMIC Funding Processes: T o coordinate bids for existing funds and influence future funded R&D programmes Local User Environments User services, including Independent portals utilising mix of local and central services | Local control of some shared service functions via staff portal | User needs assessment Shared Central Services Cross-searchable catalogue | Collection and collection strength databases | Portal landscaper | Scottish Distributed Digital library| E-journals service |Terminolo gies server | ILL & DD | Authentication Interoperability Forum Advice and training on standards and their implementation | Inclusive seamless access to global information services | JISC & Resource IE compatibility| Scottish web presence Collaborative Activities On collecting and cataloguing, on purchase and storage, on digitisation and course development, on user & staff training,, on quality control, and so on Professional Support Current awareness and general support services for staff via online facilities for professionals, lists, journals and e-journals, conferences and meetings, professional groups, staff collaborative collecting portal Feedback from Research & Practice The Scottish Cooperative Infrastructure Management and R&D of Online and Offline:

Finally… n Don’t run before you can walk… n Don’t assume it’s easy… n Don’t duplicate effort… n Long term and slow is a possible alternative to expensive (if we’re careful) n Think globally before acting locally n Don’t forget the user!

Further Information n Websites: u u n u n Demonstrators: u u OR