Gaussian Approximation of Quantization Error for Estimation from Compressed Data

Journal Article (Journal Article)

We consider the distributional connection between the lossy compressed representation of a high-dimensional signal $X$ using a random spherical code and the observation of $X$ under an additive white Gaussian noise (AWGN). We show that the Wasserstein distance between a bitrate-$R$ compressed version of $X$ and its observation under an AWGN-channel of signal-To-noise ratio $2^{2R}-1$ is bounded in the problem dimension. We utilize this fact to connect the risk of an estimator based on the compressed version of $X$ to the risk attained by the same estimator when fed the AWGN-corrupted version of $X$. We demonstrate the usefulness of this connection by deriving various novel results for inference problems under compression constraints, including minimax estimation, sparse regression, compressed sensing, and universality of linear estimation in remote source coding.

Full Text

Duke Authors

Cited Authors

  • Kipnis, A; Reeves, G

Published Date

  • August 1, 2021

Published In

Volume / Issue

  • 67 / 8

Start / End Page

  • 5562 - 5579

Electronic International Standard Serial Number (EISSN)

  • 1557-9654

International Standard Serial Number (ISSN)

  • 0018-9448

Digital Object Identifier (DOI)

  • 10.1109/TIT.2021.3083271

Citation Source

  • Scopus