1. Concept-based Image Retrieval: The ARRS GoldMiner ® Image Search Engine Charles E. Kahn Jr., MD, MS Medical College of Wisconsin Milwaukee, Wisconsin, USA

2. Disclosure No commercial interests American Roentgen Ray Society (ARRS) Executive Council member (Publications) Consulting stipend

3. Google® Images circa 2006

4. ARRS GoldMiner ® Image search engine “Open access” images Built by and for radiologists Powered by a major radiology organization Available freely to all

5. goldminer.arrs.org

6. Overview ARRS GoldMiner ® How it works Get the most for your search New features Advanced search Spell check GoldMiner Global What’s on the horizon

7. Search term

8. Click on the thumbnail to view the full-size original image Click on the title to link to the original article

9. Dynamically filter results by age, sex, and imaging modality

10. ARRS GoldMiner ® Image search engine Radiology images Peer-reviewed journals Combines search strategies Keywords (text strings) Medical concepts Filters search results Age, sex, and imaging modality

11. Concept-based Search Semantic knowledge Lexical variants “oesophagus” = “esophagus” = “esophageal” Abbreviations “HCC” = “hepatocellular carcinoma” Synonyms “renal calculi” = “kidney stones” Powered by UMLS® Unified Medical Language System

12. “Searching for Meaning” GoldMiner understands relationships between concepts Expands queries using UMLS Metathesaurus concept hierarchy

13. UMLS Metathesaurus SNOMED-CT Systematized Nomenclature of Medicine Foundational Model of Anatomy Medical Subject Headings MeSH vocabulary Indexes MEDLINE / PubMed

18. Software Harvester A Web "robot" intelligently crawls journal web sites to gather figures and their text captions Indexer Discovers medical concepts in free-text figure captions Indexes the figures to speed retrieval Search engine Retrieves images to answer your search query

19. Image Library 7 core journals including AJR, Radiology, and RadioGraphics 250+ peer-reviewed journals Image collection grows weekly

20. Outstanding Performance Fast retrieval Mean = 0.041 sec Accurate search results High precision and recall (86%+) Image metadata (~85% accuracy) Age, sex, imaging modality

22. A “How-To” Guide Keep it simple ! Use a search term that represents A disease An imaging finding, or An anatomic feature Filter your search results Limit images by age group, sex, and/or imaging modality

23. New Features GoldMiner Spelling corrector Advanced search Image Gallery GoldMiner Global 10 languages

24. Spelling Correction

25. Advanced Search Combine up to 3 search queries e.g., “Lung metastases” and “colon cancer” Limit to core journals Search by age Age group (“Child”) or specific range Sex Imaging modalities

28. Image Gallery Instantly add images to a web site All it takes is one line of HTML code! GoldMiner “inlines” relevant images into web pages based on their content

29. GoldMiner inserts up to four relevant images, based on the page’s title and subject The caption pops up when your mouse hovers over an image; click on the image to view it at full size GoldMiner ® Image Gallery at the CHORUS web site (chorus.rad.mcw.edu)

30. GoldMiner Global Multi-lingual search engine 10 other languages Uses MeSH Medical Subject Headings Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish Arabic Chinese French German Italian Japanese Korean Portuguese Russian Spanish

31. العربية 日本語 Deutsch Español Русский 中文 Português Italiano Français A customized NLM web interface translates the query term into an English-language MeSH term The ARRS GoldMiner ® server sends a translation request; it uses the English-language query term to retrieve images. Users can search for images using search terms in 10 languages other than English.

32. Searching in Chinese for “Liver Cancer” “ 肝癌 ”

34. In Development Content-based image retrieval Imaging modality classifier Find similar images Point-of-care learning Category 1 CME

35. Image Modality Classifier Use visual info to detect modality 95% accuracy Combine with existing text data “CT”

36. “Visual Search” for Images

37. Point of care learning “Just-in-time” knowledge CME credits for clinically directed search ARRS member benefit

38. Point of Care Learning Learning LogSearch Results

39. kahn@mcw.edu goldminer.arrs.org Any questions?