Skip to main content

Generalized Bregman divergence and gradient of mutual information for vector Poisson channels

Publication ,  Journal Article
Wang, L; Rodrigues, M; Carin, L
Published in: IEEE International Symposium on Information Theory - Proceedings
December 19, 2013

We investigate connections between information-theoretic and estimation-theoretic quantities in vector Poisson channel models. In particular, we generalize the gradient of mutual information with respect to key system parameters from the scalar to the vector Poisson channel model. We also propose, as another contribution, a generalization of the classical Bregman divergence that offers a means to encapsulate under a unifying framework the gradient of mutual information results for scalar and vector Poisson and Gaussian channel models. The so-called generalized Bregman divergence is also shown to exhibit various properties akin to the properties of the classical version. The vector Poisson channel model is drawing considerable attention in view of its application in various domains: as an example, the availability of the gradient of mutual information can be used in conjunction with gradient descent methods to effect compressive-sensing projection designs in emerging X-ray and document classification applications. © 2013 IEEE.

Duke Scholars

Published In

IEEE International Symposium on Information Theory - Proceedings

DOI

ISSN

2157-8095

Publication Date

December 19, 2013

Start / End Page

454 / 458
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Wang, L., Rodrigues, M., & Carin, L. (2013). Generalized Bregman divergence and gradient of mutual information for vector Poisson channels. IEEE International Symposium on Information Theory - Proceedings, 454–458. https://doi.org/10.1109/ISIT.2013.6620267
Wang, L., M. Rodrigues, and L. Carin. “Generalized Bregman divergence and gradient of mutual information for vector Poisson channels.” IEEE International Symposium on Information Theory - Proceedings, December 19, 2013, 454–58. https://doi.org/10.1109/ISIT.2013.6620267.
Wang L, Rodrigues M, Carin L. Generalized Bregman divergence and gradient of mutual information for vector Poisson channels. IEEE International Symposium on Information Theory - Proceedings. 2013 Dec 19;454–8.
Wang, L., et al. “Generalized Bregman divergence and gradient of mutual information for vector Poisson channels.” IEEE International Symposium on Information Theory - Proceedings, Dec. 2013, pp. 454–58. Scopus, doi:10.1109/ISIT.2013.6620267.
Wang L, Rodrigues M, Carin L. Generalized Bregman divergence and gradient of mutual information for vector Poisson channels. IEEE International Symposium on Information Theory - Proceedings. 2013 Dec 19;454–458.

Published In

IEEE International Symposium on Information Theory - Proceedings

DOI

ISSN

2157-8095

Publication Date

December 19, 2013

Start / End Page

454 / 458