Skip to main content

Nested dictionary learning for hierarchical organization of imagery and text

Publication ,  Journal Article
Li, L; Zhang, XX; Zhou, M; Carin, L
Published in: Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012
December 1, 2012

A tree-based dictionary learning model is developed for joint analysis of imagery and associated text. The dictionary learning may be applied directly to the imagery from patches, or to general feature vectors extracted from patches or superpixels (using any existing method for image feature extraction). Each image is associated with a path through the tree (from root to a leaf), and each of the multiple patches in a given image is associated with one node in that path. Nodes near the tree root are shared between multiple paths, representing image characteristics that are common among different types of images. Moving toward the leaves, nodes become specialized, representing details in image classes. If available, words (text) are also jointly modeled, with a path-dependent probability over words. The tree structure is inferred via a nested Dirichlet process, and a retrospective stick-breaking sampler is used to infer the tree depth and width.

Duke Scholars

Published In

Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012

Publication Date

December 1, 2012

Start / End Page

469 / 478
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Li, L., Zhang, X. X., Zhou, M., & Carin, L. (2012). Nested dictionary learning for hierarchical organization of imagery and text. Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012, 469–478.
Li, L., X. X. Zhang, M. Zhou, and L. Carin. “Nested dictionary learning for hierarchical organization of imagery and text.” Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012, December 1, 2012, 469–78.
Li L, Zhang XX, Zhou M, Carin L. Nested dictionary learning for hierarchical organization of imagery and text. Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012. 2012 Dec 1;469–78.
Li, L., et al. “Nested dictionary learning for hierarchical organization of imagery and text.” Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012, Dec. 2012, pp. 469–78.
Li L, Zhang XX, Zhou M, Carin L. Nested dictionary learning for hierarchical organization of imagery and text. Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012. 2012 Dec 1;469–478.

Published In

Uncertainty in Artificial Intelligence - Proceedings of the 28th Conference, UAI 2012

Publication Date

December 1, 2012

Start / End Page

469 / 478