Jason W. Karl, Ph.D. Jeffrey K. Gillan Jason W. Karl, Ph.D. Jeffrey K. Gillan 23 October 2013 Ty Montgomery Richard Bliss Ty Montgomery Richard Bliss

Slides:



Advertisements
Similar presentations
Citavi – Adding References – Articles from EBSCOhost Databases
Advertisements

A Toolbox for Blackboard Tim Roberts
Metadata at ICPSR Sanda Ionescu, ICPSR.
Alternative FILE formats
The North American Carbon Program Google Earth Collection Peter C. Griffith, NACP Coordinator; Lisa E. Wilcox; Amy L. Morrell, NACP Web Group Organization:
CAPTURE SOFTWARE Please take a few moments to review the following slides. Please take a few moments to review the following slides. The filing of documents.
CAPTURE SOFTWARE Please take a few moments to review the following slides. Please take a few moments to review the following slides. The filing of documents.
1 The GeoParser. 2 Overview What is a geoparser? –Software for the automated extraction of place names from text Why would you want one? –Document characterisation.
Ingest and Loading DigiTool Version 3.0. Ingest and Loading 2 Ingest Agenda Ingest Overview and Introduction Ingest activity steps Transformers Task Chains.
Properties of Text CS336 Lecture 3:. 2 Information Retrieval Searching unstructured documents Typically text –Newspaper articles –Web pages Other documents.
Before class begins… Help us to assess this session and plan for future workshops Please complete the Advanced Refworks Pre-learning assessment at:
The Cornell Veterinarian A Metadata Perspective.
Simple Web SQLite Manager/Form/Report
Add a File with X, Y coordinates to MapWindow
Instructional Technology & Design Office or Zotero & Mendeley Workshop Presented by Aisha Conner-Gaten.
Databases & Data Warehouses Chapter 3 Database Processing.
PubMed/How to Search, Display, Download & (module 4.1)
Overview of Mini-Edit and other Tools Access DB Oracle DB You Need to Send Entries From Your Std To the Registry You Need to Get Back Updated Entries From.
Ideas for Incorporating the Research Tool Zotero into Your Course: CTLT’s How I did it series Lorena O’English WSU Libraries
Internet and Social Networking Research Tools for Academic Writing Copyright © 2014 Todd A. Whittaker
Proprietary & Confidential The Thread That Ties it All Together Voicethread and Discovery Education Jennifer Dorman denblogs.com/jendorman.
Classroom User Training June 29, 2005 Presented by:
Selecting and Combining Tools F. Duveau 02/03/12 F. Duveau 02/03/12 Chapter 14.
DE&T (QuickVic) Reporting Software Overview Term
Integrating and managing your Engaging Networks data Top ten data features.
Online Autonomous Citation Management for CiteSeer CSE598B Course Project By Huajing Li.
NOMENCLA: a server to manage, display and disseminate metadata by Emile Bruneau (INSEE – France) Joint UNECE/Eurostat/OECD work session on statistical.
GLOSSARY COMPILATION Alex Kotov (akotov2) Hanna Zhong (hzhong) Hoa Nguyen (hnguyen4) Zhenyu Yang (zyang2)
CROSSMARC Web Pages Collection: Crawling and Spidering Components Vangelis Karkaletsis Institute of Informatics & Telecommunications NCSR “Demokritos”
Linking electronic documents and standardisation of URL’s What can libraries do to enhance dynamic linking and bring related information within a distance.
GPO’s Federal Digital System August 17, 2010 U.S. Government Printing Office.
Advanced AutoEntry Using Resume Parsing with Version 9 of PcHunter/Tempus Fugit Advanced AutoEntry © 2008 Micro J Systems, Inc.
1 Reference Linking in Project Euclid …with some thoughts on the preservation of digital collections. A presentation at the Workshop on Linking and searching.
Get your hands dirty cleaning data European EMu Users Meeting, 3rd June. - Elizabeth Bruton, Museum of the History of Science, Oxford
Target schema and domain evolution Source metadata preparation Source data preparation Metadata matching Target data instantiation Transformation and analysis.
Hampshire Hub Data Platform Progress update 1 October Bill Roberts Swirrl.
By: Namrata Lele Mentors: Dave Vieglais Bruce Wilson 1 VDC/TWG Meeting August 09.
Searching CiteSeer Metadata Using Nutch Larry Reeve INFO624 – Information Retrieval Dr. Lin – Winter 2005.
Vers national spatial data infrastructure training program What is Metadata? Introduction to Metadata An overview of geospatial metadata, presentation.
SPRINGER ONLINE
1 EndNote X2 Your Bibliographic Management Tool 29 September 2009 Humanities and Social Sciences Resource Teams.
Using RSS to Promote Scholarly Publications Ken Varnum Associate Librarian Edwin Ginn Library The Fletcher School Tufts University Cool Tools and New Technologies.
AMERICAN CHEMICAL SOCIETY
1 Overview Finding and importing data sets –Searching for data –Importing data_.
Information Retrieval and Web Search Crawling in practice Instructor: Rada Mihalcea.
OSU | PSU | UO The Oregon Spatial Data Library: A Vision for Increased Data Sharing Myrica McCune Institute for Natural Resources Marc Rempel Oregon State.
JISC/NSF PI Meeting, June Archon - A Digital Library that Federates Physics Collections with Varying Degrees of Metadata Richness Department of Computer.
5 Copyright © 2010, Oracle and/or its affiliates. All rights reserved. Other Administrator Tasks.
Microsoft Access 2000 Creating Queries, Reports and Web Pages.
IRS Tax Map Electronic Research Tool David Brown Internal Revenue Service Media and Publications Division David Brown Internal Revenue Service Media and.
A System for Automatic Personalized Tracking of Scientific Literature on the Web Tzachi Perlstein Yael Nir.
Collections Management Museums What’s new in EMu ? Part II Bernard Marshall Chief Technology Officer KE Software.
AMERICAN INSTITUTE OF PHYSICS URL:
Jean-Yves Le Meur - CERN Geneva Switzerland - GL'99 Conference 1.
AMERICAN PHYSICAL SOCIETY
How to Create an Essential Metadata Record Using an Online Tool aka ‘ Now You Have No Excuse For Not Creating.
16BIT IITR Data Collection Module A web crawler (also known as a web spider or web robot) is a program or automated script which browses the World Wide.
Jason W. Karl, Ph.D. Jeffrey K. Gillan Jason W. Karl, Ph.D. Jeffrey K. Gillan 3 July 2013 Ty Montgomery Richard Bliss Ty Montgomery Richard Bliss.
Jason Karl, Ph.D. Director. “Siri … Find me a coffee shop in London by the Congress Centre.” “I found 7 coffee shops near you …”
6 Copyright © 2010, Oracle and/or its affiliates. All rights reserved. Site Hub User Role – Managing Sites.
Mapping for the interwebs
Flanders Marine Institute (VLIZ)
Summon discovers contents from one search box!
Submitted By: Usha MIT-876-2K11 M.Tech(3rd Sem) Information Technology
denblogs.com/jendorman
ESRM 250/CFR 520 Autumn 2009 Phil Hurvitz
Manage Sourcing - Supplier
Survey Results Respondents: 39 of 51 – 76%
WHERE TO FIND IT – Accessing the Inventory
Intro to Web Services Consuming the Web.
Presentation transcript:

Jason W. Karl, Ph.D. Jeffrey K. Gillan Jason W. Karl, Ph.D. Jeffrey K. Gillan 23 October 2013 Ty Montgomery Richard Bliss Ty Montgomery Richard Bliss Search filtering, data entry and coordinate parsing

Specific location Geo-semantic search Geographic-based literature searching Relevant to location Relevant by similar ecological context Relevant to theme Question: e.g., soil erosion in North American Southwest Ecologically similar areas Semantic search Theme Place name General context Results

Searching/Filtering Articles in JournalMap Categorical filters are additive (i.e., aridity index of arid OR semi-arid) Continuous variable filtering set by a slider. Filters for different environmental, location, and citation attributes are available for querying JournalMap in addition to key words/terms. Key word/term searching Basic citation information and a link to the article in the popup bubble.

JournalMap search result exporting Search results can be viewed as a list and exported from JournalMap in several formats. – Spatial download formats (e.g., shapefile, KML) coming soon.

Challenge: Extracting location information from published studies

Coordinates Reported (58%) Place Name Reported (32%) No Location (10%) Geographic Coordinate System (90%) Other Coordinate System (10%) Location Reporting in Studies

Parsing coordinates from text Need automated way to recognize and extract coordinates from text Convert coordinate information into common form Regular expressions – Python or Ruby Text “clips” or full text articles – JournalMap web form – HTML pages – XML document batching

Coordinate parser examples N W N / 12155W ° N ° W N W degrees, degrees N W 52 North 50 West N W 58147N/07720W N W (45º10'17"N 076º23'46"W) (45º10"17'N 076º23"46'W) (40º02.247'N 111º44.383'W) N52:57:40, E0:46:04 70 ° 57N 070 ° 05W (N W ) 52 degrees, 42 minutes north, 124 degrees, 50 minutes west 5115N8940W 4523N/07319W N W NORTH 5705 WEST (OSES, 39°02'N, 109°21'E) 16°30’ S, 145° 27’ E 19°09′ S–48°23′ W Lat 43º6'32.1"N, long 116º46'33.8"W 43º01N 081º46W N, W N/ W ( N / W) 6146 north 5328 west (30° 47' N, 34° 46' E) N 5930 W ˚ ˚ N W (106°20' E, 38°45' N) 44°50′05″ N, 15°33′43″ E N/ W N / W º 26' N, 101º 6' W N W N, E N W N / W 4745N/6440W 9°21’ N, 82°15’W 33°01′34″ S; 64°11′21″ W 49º41'34"N 093º37'54"W 43º55'N 078º18'W (16°03′ N, 16°29′ W) N / W lat 26º 26' N, lon 101º 6' W N W

Modes of content entry for JournalMap ModeAutomatedSemi-automatedManual Single article entry via submission form Citation (from DOI) Filtering attributes from location (e.g., elevation) Location via coordinate or simple place name Abstract/keywords * Location via complex/unusual place name Location quality metadata Batch upload of XML files Citation Abstract/keywords Locations via coordinates Some location quality metadata Location via simple place names Review/verification of automated locations Location via complex/unusual place name Remaining location quality metadata “Offline” creation (via spreadsheet) and CSV upload Depends on source of records – can be entirely automated or completely manual process. Structuring of CSV files generally semi- automated process.

Citation information is captured automatically from the DOI number via crossref.org Presently most abstracts/keywords need to be manually input (copy/paste). JournalMap can auto-populate these fields through Mendeley.com if articles are present, but we are looking for additional sources to do this automatically. URL can be used as primary key field if no DOI is available Study area description as reported in the article is copied into this field. JournalMap supports basic place-name recognition and mapping for this field (improvements in development). Coordinate values as reported in the study copied here. JournalMap parses this field to determine latitude/longitude values. Study location can also be manually mapped by placing a marker on the map. Location quality metadata fields. Additional locations for an article can be added. Query/filter field values are automatically determined for each article based on its mapped locations. JournalMap Single Article Submission Form

JournalMap batch data entry