Supervised online matrix factorization for histopathological multimodal retrieval

Victor H. Contreras, Juan S. Lara, Oscar J. Perdomo, Fabio A. González

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Prostate cancer diagnosis is performed by pathologists through the analysis of tissue samples from the prostate gland using a microscope. The development of automatic acquisition and digitalization technologies has allowed the construction of large collections of digitalized histopathology slides, that are usually accompanied by clinical information and other types of metadata. This collection of cases, along with the metadata, has the potential to be an invaluable resource for the analysis of new challenging cases supporting diagnosis, prognosis, and theragnosis decision tasks. This paper presents a multimodal retrieval system based on a supervised multimodal kernel semantic embedding model that supports the search of relevant cases in a multimodal database, combining both images, i.e. histopathology slides, and text, i.e. pathologist's reports. The system was tested in a multimodal prostate adenocarcinoma dataset, composed of whole slide images of tissue samples, pathologist's reports and gradation information using the Gleason score. The system shows a high performance for multimodal information retrieval with a Mean Average Precision of 0.6263.

Original languageEnglish (US)
Title of host publication14th International Symposium on Medical Information Processing and Analysis
EditorsNatasha Lepore, Eduardo Romero, Jorge Brieva
PublisherSPIE
ISBN (Electronic)9781510626058
DOIs
StatePublished - 2018
Externally publishedYes
Event14th International Symposium on Medical Information Processing and Analysis, SIPAIM 2018 - Mazatlan, Mexico
Duration: Oct 24 2018Oct 26 2018

Publication series

NameProceedings of SPIE - The International Society for Optical Engineering
Volume10975
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

Conference14th International Symposium on Medical Information Processing and Analysis, SIPAIM 2018
Country/TerritoryMexico
CityMazatlan
Period10/24/1810/26/18

All Science Journal Classification (ASJC) codes

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Supervised online matrix factorization for histopathological multimodal retrieval'. Together they form a unique fingerprint.

Cite this