Bag-of-features based medical image retrieval via multiple assignment and visual words weighting

Jingyan Wang, Yongping Li, Ying Zhang, Chao Wang, Honglan Xie, Guoling Chen, Xin Gao

Research output: Contribution to journalArticlepeer-review

56 Scopus citations

Abstract

Bag-of-features based approaches have become prominent for image retrieval and image classification tasks in the past decade. Such methods represent an image as a collection of local features, such as image patches and key points with scale invariant feature transform (SIFT) descriptors. To improve the bag-of-features methods, we first model the assignments of local descriptors as contribution functions, and then propose a novel multiple assignment strategy. Assuming the local features can be reconstructed by their neighboring visual words in a vocabulary, reconstruction weights can be solved by quadratic programming. The weights are then used to build contribution functions, resulting in a novel assignment method, called quadratic programming (QP) assignment. We further propose a novel visual word weighting method. The discriminative power of each visual word is analyzed by the sub-similarity function in the bin that corresponds to the visual word. Each sub-similarity function is then treated as a weak classifier. A strong classifier is learned by boosting methods that combine those weak classifiers. The weighting factors of the visual words are learned accordingly. We evaluate the proposed methods on medical image retrieval tasks. The methods are tested on three well-known data sets, i.e., the ImageCLEFmed data set, the 304 CT Set, and the basal-cell carcinoma image set. Experimental results demonstrate that the proposed QP assignment outperforms the traditional nearest neighbor assignment, the multiple assignment, and the soft assignment, whereas the proposed boosting based weighting strategy outperforms the state-of-the-art weighting methods, such as the term frequency weights and the term frequency-inverse document frequency weights. © 2011 IEEE.
Original languageEnglish (US)
Pages (from-to)1996-2011
Number of pages16
JournalIEEE Transactions on Medical Imaging
Volume30
Issue number11
DOIs
StatePublished - Nov 2011

ASJC Scopus subject areas

  • Radiological and Ultrasound Technology
  • Software
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Bag-of-features based medical image retrieval via multiple assignment and visual words weighting'. Together they form a unique fingerprint.

Cite this