JCSE, vol. 6, no. 2, pp.168-177, 2012

DOI: http://dx.doi.org/10.5626/JCSE.2012.6.2.168

Design and Development of a Multimodal Biomedical Information Retrieval System

Dina Demner-Fushman, Sameer Antani, Matthew Simpson, George R. Thoma
National Library of Medicine, Bethesda, MD, USA

Abstract: The search for relevant and actionable information is a key to achieving clinical and research goals in biomedicine. Biomedical information exists in different forms: as text and illustrations in journal articles and other documents, in images stored in databases, and as patients??cases in electronic health records. This paper presents ways to move beyond conventional text-based searching of these resources, by combining text and visual features in search queries and document representation. A combination of techniques and tools from the fields of natural language processing, information retrieval, and content-based image retrieval allows the development of building blocks for advanced information services. Such services enable searching by textual as well as visual queries, and retrieving documents enriched by relevant images, charts, and other illustrations from the journal literature, pati

Keyword: Multimodal biomedical information retrieval; Natural language processing; Content-based information retrieval; Image processing; Advanced information servicesyda

Full Paper:   229 Downloads, 2442 View