Harmonizing hierarchical manifolds for multimedia document semantics understanding and cross-media retrieval

Yang, Yi, Zhuang, Yue-Ting, Wu, Fei and Pan, Yun-He (2008) Harmonizing hierarchical manifolds for multimedia document semantics understanding and cross-media retrieval. IEEE Transactions on Multimedia, 10 3: 437-446. doi:10.1109/TMM.2008.917359

Attached Files (Some files may be inaccessible until you login with your UQ eSpace credentials)
Name Description MIMEType Size Downloads

Author Yang, Yi
Zhuang, Yue-Ting
Wu, Fei
Pan, Yun-He
Title Harmonizing hierarchical manifolds for multimedia document semantics understanding and cross-media retrieval
Journal name IEEE Transactions on Multimedia   Check publisher's open access policy
ISSN 1520-9210
1941-0077
Publication date 2008-04-01
Sub-type Article (original research)
DOI 10.1109/TMM.2008.917359
Volume 10
Issue 3
Start page 437
End page 446
Total pages 10
Place of publication Piscataway, NJ, United States
Publisher IEEE
Language eng
Abstract In this paper, we consider the problem of multimedia document (MMD) semantics understanding and content-based cross-media retrieval. An MMD is a set of media objects of different modalities but carrying the same semantics and the content-based cross-media retrieval is a new kind of retrieval method by which the query examples and search results can be of different modalities. Two levels of manifolds are learned to explore the relationships among all the data in the level of MMD and in the level of media object respectively. We first construct a Laplacian media object space for media object representation of each modality and an MMD semantic graph to learn the MMD semantic correlations. The characteristics of media objects propagate along the MMD semantic graph and an MMD semantic space is constructed to perform cross-media retrieval. Different methods are proposed to utilize relevance feedback and experiment shows that the proposed approaches are effective.
Keyword Cross-media retrieval
Hierarchical manifold learning
Multimedia document
Support vector machines
Q-Index Code C1
Q-Index Status Provisional Code
Institutional Status Non-UQ

Document type: Journal Article
Sub-type: Article (original research)
Collections: ERA 2012 Admin Only
School of Information Technology and Electrical Engineering Publications
 
Versions
Version Filter Type
Citation counts: TR Web of Science Citation Count  Cited 107 times in Thomson Reuters Web of Science Article | Citations
Scopus Citation Count Cited 149 times in Scopus Article | Citations
Google Scholar Search Google Scholar
Created: Tue, 06 Mar 2012, 22:19:58 EST by Mr Mathew Carter on behalf of School of Information Technol and Elec Engineering