Digital Library Service Integration Senior Projects Professors Bieber, Im and Wu Information Systems Department College of Computing Sciences New Jersey Institute of Technology For more senior project information:

DL = Distance Learning = Digital Library DLSI: DL Service Integration

Why Participate in DLSI? Real-world project –very helpful for students and teachers worldwide High visibility for you and NJIT Gain research experience and work with research teams Learning XML, XLS, and other skills Support: DLSI project leader and bi-weekly DLSI project meetings

Outline Motivation –supporting learning communities DLSI Architecture Senior Projects

Motivation: Community Knowledge Resides in... documents (published papers, reports, photos, videos, lesson plans, syllabi, etc.) discussions decisions conceptual models formal educational modules workflows/processes peoples expertise links/relationships among all these

Digital Library: Multimedia Document Services Integration linking related documents DLSI Architecture for manipulating and maintaining data for storing data

Digital Library: Multimedia Document Services Asynchronous Discussion Tools (Groupware) Integration Discussing a document DLSI Architecture for manipulating and maintaining data for storing data

Digital Library: Multimedia Document Services Asynchronous Discussion Tools/Groupware Hypermedia Services (tours, annotation, linking) Integration Annotating a discussion Tours of documents and discussion comments DLSI Architecture

Digital Library: Multimedia Document Services Asynchronous Discussion Tools Hypermedia Services (tours, annotations, links) Processes/Workflows Integration Annotating and discussing a community process DLSI Architecture

Digital Library: Multimedia Document Services Asynchronous Discussion Tools Hypermedia Services Processes/Workflows Decision Analysis Support Conceptual Knowledge Structures Others... DLSI Architecture

DLSI: Integration through Linking

DLSI is Based on the Dynamic Hypermedia Engine Automatically adds link anchors, links and other hypermedia services to applications: comments guided tours structural search (based on links and relationships instead of keywords) others... See separate presentation

Dynamic Hypermedia Engine Links generated based on application structure, not search or lexical analysis –You cannot do a search on the display text $127, to find related information… –But you can find relationships for the element Sales[1997] $85,101.99$127, Expenses1997 Sales

Link Mapping Rules... Relationship Manager Rule Base … Vendor - Vendor IS - Vendor Details - {commands} Vendor - Vendor IS - Vendor Reliability - {commands} Vendor - Vendor IS - Vendor Agreements - {commands} Vendor - Purchasing Data Warehouse - Who else uses vendor - {commands} Vendor - Purchasing IS - Your Purchasing History - {commands} Vendor - CASE Workbench - All screens with this vendor - {commands} …

DHE generates anchors and links from the Relationship Management Rule Base

DLSI: Integration through Linking

Prototype

Benefits of Integration for a system (collection/service) Users: direct access to related systems –enlarges a systems feature set DLSI leads users to a system –systems gain wider use Users become aware of other systems –systems gain wider awareness Direct access to a systems features –streamlined access (bypassing menus)

Finding Links Structural links (as with DHE) –when we know the object type Lexical analysis (Professor Wu) –NJIT Noun Phrase Extractor –NJIT Ontology Developer

Filtering & Rank Ordering Links Collaborative Filtering (Professor Im) –customize the link set for each user based on: –user-direct evaluations (ratings) –indirect evaluation (clickstream data) using a Collaborative Filtering Engine

How to Integrate (1) Develop a Wrapper –Parse all display screens to identify the elements of interest that DLSI will make into link anchors. Parse each kind of display screen Parse based on the standard template/layout or metadata provided –Also call the lexical analysis routines to identify key phrases for you

How to Integrate, cont. (2) Develop Linking Rules –specify the structural relationships for recognized object types within the system being integrated. e.g., author, address, concept, spacecraft, measurement –one rule per object type (class) per link –all linking rules are merged by DLSI, so rules for other systems apply automatically to your system (e.g., annotations, discussions, related documents)

How to Integrate, cont. (3) Initiate Communications: –Several possible ways, depending on the application.

Outline Motivation –supporting learning communities DLSI Architecture Senior Projects –Project 1: AVC and AskNSDL/VRD –Project 2: Metis Workflow and JESSE –Project 3: NASAs NSSDC –Project 4: Lexical Analysis and User Preferences –Project 5: myKnowledge

NSDL (National Science Digital Library) Sponsored by the National Science Foundation (NSF) Purpose: to provide educational resources in an integrated environment to students and teachers (kindergarten-graduate school) URL: Flash Presentation:

DLSI & NSDL DLSI is providing the integration for all of the NSDL system! Senior Projects will –be the first integration prototypes –provide necessary internal features

Project 1a Atmospheric Visualization Collection Provides visualization tools and images of weather data from Atmospheric Radiation Measurement (ARM) program ARM: the largest global change research program supported by the U.S. Dept. of Energy based at the Argonne National Laboratory URL:

Automated Links (AVC) From concepts found in the glossary and from instruments: –link to the glossary definition –link to lesson plans containing it –link to an instrument's page –link to ARM publications containing the keyword/instrument

Automated Links, cont. (AVC) From any relevant object to the appropriate data display page From any relevant object to the appropriate internal data file (for AVC internal developers)

Automated Links, cont. (AVC) and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Based at the University of Syracuse See separate presentation Project 1b Ask-NSDL & Virtual Reference Desk

Automated Links (Ask-NSDL & VRD) Lexical analysis to find key phrases recognized in glossaries Links to other questions/answers for a key phrase Direct links to all relevant functions for experts, administrators (e.g., show all answers this expert made)

Automated Links, cont. and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Same kind of links for the Virtual Reference Desk! ( Project 1b Ask-NSDL & Virtual Reference Desk

Project 2a Metis Workflow Engine based at the University of Colorado at Boulder Workflow: the process to get something done –involves triggering events from/in different systems –some steps are automated (e.g., send ), others require people to do something See separate presentation

Automated Linking (Metis) Linking workflow definition tools to internal Metis documentation Linking workflow specifications and Metis displays with the systems involved in the workflow

Automated Links, cont. (Metis) and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Project 2b JESSE/Picture of the Day Journal of Earth System Science Education Based at the Universities Space Research Association See external presentation URL: Also, Earth Science Picture of the Day URL:

Automated Links (JESSE/POTD) Links among related pictures and articles and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Project 3: NASAs National Space Science Data Center based at the Goddard Space Flight Center URL: preliminary starting demo connecting NSSDC with the University of Arizona Document Summarizer (see next page)

Prototype

Automated Linking (NSSDC) Links among related space missions, experiments, astronauts & scientists, and definitions/explanations of key phrase/concepts Links utilizing other NASA systems

Automated Links, cont. (NSSDC) and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Project 4a (internal) : Linking through Lexical Analysis See external presentation

Project 4b (internal) : User Preference Module UPM maintains database of user preferences for any module integrating with DLSI. –communicates with other modules through DLSIs existing message passing protocol UPM will communicate with users –to gather preferences –to get information from the user about his or her current task, so we can customize the links generated task and preferences We have a fairly complete set of requirements already prepared.

Project 5: myKnowledge Independent application; integrated with DLSI for all NSDL users Users maintain a knowledge base of ideas and references It has several fields where users can make notes, record references and mark characteristics (metadata) about a concept or DL resource (document, article or Web page)

myKnowledge myKnowledge information will be stored within a MySQL database. We have a fairly complete set of requirements already prepared. We need help determining the best way of presenting the information.

Automated Links (myKnowledge) Links to the actual resource on the Web and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Automated Links, cont. (myKnowledge) and, of course: Links to related objects, teaching notes and documents in other systems Links for additional services such as discussion, comments, guided tours, etc.

Why Participate in DLSI? Real-world project –very helpful for students and teachers worldwide High visibility for you and NJIT Gain research experience and work with research teams Learning XML, XLS, and other skills Support: DLSI project leader and bi-weekly DLSI project meetings

Digital Library Service Integration Senior Projects Professors Bieber, Im and Wu Information Systems Department College of Computing Sciences New Jersey Institute of Technology For more senior project information: