Information Retrieval Systems

Topics: Information retrieval, Machine learning, Vector space model Pages: 11 (2993 words) Published: July 1, 2012
Research Proposal

Multimodal Information Spaces for Content-based Image Retrieval Abstract Currently, image retrieval by content is a research problem of great interest in academia and the industry, due to the large collections of images available in different contexts. One of the main challenges to develop effective image retrieval systems is the automatic identification of semantic image contents. This research proposal aims to design a model for image retrieval able to take advantage of different data sources, i.e. using multimodal information, to improve the response of an image retrieval system. In particular two data modalities associated to contents and context of images are considered in this proposal: visual features and unstructured text annotations. The proposed framework is based on kernel methods that provide two main important advantages over the traditional multimodal approaches: first, the structure of each modality is preserved in a high dimensional feature space, and second, they provide natural ways to fuse feature spaces in a unique information space. This document presents the research agenda to build a Multimodal Information Space for searching images by content.

Presented by
Juan Carlos Caicedo Rueda

Research Advisor
Prof. Fabio A. Gonz´lez O. Ph.D a

Computer Science

Research Fields
Information Retrieval and Machine Learning.






Content-Based Image Retrieval (CBIR) is an active research discipline focused on computational strategies to search for relevant images based on visual content analysis. In this proposal, multimodal analysis is considered to develop CBIR systems, specially for image collections in which there is some text associated to images. Multimodality in Information Retrieval is sometimes referred to the interaction mechanisms and devices used to query the system. However, since the Multimedia Information Retrieval perspective, multimodality is referred to those methods that take advantage of different data modalities to provide access to a digital library or a multimedia collection [1, 2]. Different data modalities in multimedia are used to better understand document contents, including textual annotations, audio, images and video. In this proposal, multimodal will refer to the ability to represent, process and analyze two data modalities simultaneously: unstructured texts and images. The study of multimodal information retrieval systems is proposed in this document. In particular, the design of computational strategies to take advantage of multimodal interactions between image contents and text descriptions is proposed to improve the response of an image retrieval system. In addition, the evaluation of different query paradigms is proposed, including query by example, a keyword based approach and multimodal queries to search for images. A unified framework is proposed in this document to manage data representation, search algorithms and query resolution. The study and evaluation of kernel methods to generate Multimodal Information Spaces is proposed. How can kernel methods be adapted to address the problems of a multimodal information retrieval system, is one of the main purposes of this research. This proposal aims to approach practical and theoretical aspects of a multimodal information representation for image retrieval systems. Kernel methods provide foundations to include structure in data representation and also to combine different heterogeneous data sources. Kernel methods for pattern analysis have been studied to design machine learning algorithms, and have been widely used for non-vectorial data, such as strings, trees and graphs among others [3]. Adapting such a framework for information retrieval, and specially for multimodal information retrieval may lead to more effective systems, and also may contribute to the understanding of the relationships between information retrieval and machine learning.

Continue Reading

Please join StudyMode to read the full document

You May Also Find These Documents Helpful

  • Information Retrieval Essay
  • An Introduction to Information Retrieval Essay
  • Information Retrieval Essay
  • Complementary relevance feedback-based content-based image retrieval Essay
  • Information Storage and Retrieval Essay
  • A Survey on: Content Based Image Retrieval Systems Essay
  • Essay on why are card catalog still hard to use
  • Essay on Why Choose Information Retrieval

Become a StudyMode Member

Sign Up - It's Free