Searching for Meaning: Radiology Image Retrieval with ARRS GoldMiner ® Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin, USA
goldminer.arrs.org ARRS American Roentgen Ray Society Publisher of AJR Annual meeting April 26 – May 1, 2009
Google® Images circa 2006
goldminer.arrs.org ARRS GoldMiner ® Image search engine Open access images and articles Built by and for radiologists Powered by a major radiology organization Available freely to all
goldminer.arrs.org Overview ARRS GoldMiner ® How it works Get the most for your search New features Advanced search Spell check GoldMiner Global What’s on the horizon
goldminer.arrs.org Search term
goldminer.arrs.org Click on the thumbnail to view the full-size original image Click on the title to link to the original article
goldminer.arrs.org Dynamically filter results by age, sex, and imaging modality
goldminer.arrs.org ARRS GoldMiner ® Image search engine Radiology images Peer-reviewed journals Combines search strategies Keywords (text strings) Medical concepts Filters search results Age, sex, and imaging modality
goldminer.arrs.org Concept-based Search Semantic knowledge Lexical variants “oesophagus” = “esophagus” = “esophageal” Abbreviations “HCC” = “hepatocellular carcinoma” Synonyms “renal calculi” = “kidney stones” Powered by UMLS® Unified Medical Language System
goldminer.arrs.org Concept-based Search GoldMiner understands relationships between concepts For example: “gallstones” is a type of “gallbladder disease” “osteosarcoma” is a “bone tumor”
goldminer.arrs.org
GoldMiner’s Software Harvester A Web "robot" intelligently crawls journal web sites to gather figures and their text captions Indexer Discovers medical concepts in free-text figure captions Indexes the figures to speed retrieval Search engine Retrieves images to answer your search query
goldminer.arrs.org Image Library 7 core journals including AJR, Radiology, and RadioGraphics 250+ peer-reviewed journals Image collection grows weekly
goldminer.arrs.org Outstanding Performance Fast retrieval Mean = sec Accurate search results High precision and recall (86%+) Image metadata (~85% accuracy) Age, sex, imaging modality
goldminer.arrs.org
A “How-To” Guide Keep it simple ! Use a search term that represents A disease An imaging finding, or An anatomic feature Filter your search results Limit images by age group, sex, and/or imaging modality
goldminer.arrs.org New Features GoldMiner Spelling corrector Advanced search Image Gallery GoldMiner Global 10 languages
goldminer.arrs.org Spelling Correction
goldminer.arrs.org Advanced Search Combine up to 3 search queries e.g., “Lung metastases” and “colon cancer” Limit to core journals Search by age Age group (“Child”) or specific range Sex Imaging modalities
goldminer.arrs.org Image Gallery Instantly add images to a web site All it takes is one line of HTML code! GoldMiner “inlines” relevant images into web pages based on their content
GoldMiner inserts up to four relevant images, based on the page’s title and subject The caption pops up when your mouse hovers over an image; click on the image to view it at full size GoldMiner ® Image Gallery at the CHORUS web site (chorus.rad.mcw.edu)
goldminer.arrs.org GoldMiner Global Multi-lingual search engine 10 other languages Uses MeSH Medical Subject Headings Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish
العربية 日本語 Deutsch Español Русский 中文 Português Italiano Français A customized NLM web interface translates the query term into an English-language MeSH term The ARRS GoldMiner ® server sends a translation request; it uses the English-language query term to retrieve images. Users can search for images using search terms in 10 languages other than English.
Searching in Chinese for “Liver Cancer” “ 肝癌 ”
goldminer.arrs.org Coming Soon Premium content ARRS Categorical Courses ARRS Case-based Review Content-based image retrieval Imaging modality Find similar images Point-of-care learning Category 1 CME
goldminer.arrs.org Premium Content
goldminer.arrs.org Image Modality Classifier Use visual info to detect modality 95% accuracy Combine with existing text data “CT”
goldminer.arrs.org “Visual Search” for Images
goldminer.arrs.org Point of care learning “Just-in-time” knowledge CME credits for clinically directed search ARRS member benefit
goldminer.arrs.org Point of Care Learning Learning LogSearch Results
goldminer.arrs.org The ARRS GoldMiner ® Team Michael Bruno (Penn State / Hershey) Susanna Lee (Harvard / MGH) Michael Richardson (U. Washington) Daniel Rubin (Stanford) thanks to... ARRS staff
goldminer.arrs.org 56+ CME credits Practical sonography Case-based review Subspecialty tracks Great value Members $299