Using relative-relevance of data pieces for efficient communication, with an application to Neural data acquisition

Conference Paper

In this paper, we consider the problem of communicating data from distributed sensors for the goal of inference. Two inference problems of linear regression and binary linear classification are investigated. Assuming perfect training of the classifier, an approximation of the problem of minimizing classification error-probability under Gaussianity assumptions leads us to recover Fisher score: a metric that is commonly used for feature selection in machine learning. Further, this allows us to soften the notion of feature selection by assigning a degree of relevance to each feature based on the number of bits assigned to it. This relative relevance is used to obtain numerical results on savings on number of bits acquired and communicated for classification of neural data obtained from Electrocorticography (ECoG) experiments. The results demonstrate that significant savings on costs of communication can be achieved by compressing Big Data at the source.

Full Text

Duke Authors

Cited Authors

  • Mahzoon, M; Albalawi, H; Li, X; Grover, P

Published Date

  • January 30, 2014

Published In

  • 2014 52nd Annual Allerton Conference on Communication, Control, and Computing, Allerton 2014

Start / End Page

  • 160 - 166

International Standard Book Number 13 (ISBN-13)

  • 9781479980093

Digital Object Identifier (DOI)

  • 10.1109/ALLERTON.2014.7028451

Citation Source

  • Scopus