Poster Title:

Image Annotation by Hierarchical Mapping of Features

Authors:

• Qiankun Zhao (PSU)
• Prasenjit Mitra (The Pennsylvania State University)
• C. Lee Giles (Pennsylvania State University)

Abstract:

In this paper, we propose a novel approach of image annotation by constructing a hierarchical mapping between low-level visual features and text features utilizing the relations within and across both visual features and text features. Moreover, we propose a novel annotation strategy that maximizes both the accuracy and the diversity of the generated annotation by generalizing or specifying the annotation in the corresponding annotation hierarchy. Experiments with 4500 scientific images from Royal Society of Chemistry journals show that the proposed annotation approach produces satisfactory results at different levels of annotations.