Skip to main content

Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning

Publication ,  Conference
Naghizadeh, P; Gorlatova, M; Lan, AS; Chiang, M
Published in: Proceedings - IEEE INFOCOM
April 1, 2019

We study a multi-agent partially observable environment in which autonomous agents aim to coordinate their actions, while also learning the parameters of the unknown environment through repeated interactions. In particular, we focus on the role of communication in a multi-agent reinforcement learning problem. We consider a learning algorithm in which agents make decisions based on their own observations of the environment, as well as the observations of other agents, which are collected through communication between agents. We first identify two potential benefits of this type of information sharing when agents' observation quality is heterogeneous: (1) it can facilitate coordination among agents, and (2) it can enhance the learning of all participants, including the better informed agents. We show however that these benefits of communication depend in general on its timing, so that delayed information sharing may be preferred in certain scenarios.

Duke Scholars

Published In

Proceedings - IEEE INFOCOM

DOI

ISSN

0743-166X

Publication Date

April 1, 2019

Volume

2019-April

Start / End Page

622 / 630
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Naghizadeh, P., Gorlatova, M., Lan, A. S., & Chiang, M. (2019). Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning. In Proceedings - IEEE INFOCOM (Vol. 2019-April, pp. 622–630). https://doi.org/10.1109/INFOCOM.2019.8737652
Naghizadeh, P., M. Gorlatova, A. S. Lan, and M. Chiang. “Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning.” In Proceedings - IEEE INFOCOM, 2019-April:622–30, 2019. https://doi.org/10.1109/INFOCOM.2019.8737652.
Naghizadeh P, Gorlatova M, Lan AS, Chiang M. Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning. In: Proceedings - IEEE INFOCOM. 2019. p. 622–30.
Naghizadeh, P., et al. “Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning.” Proceedings - IEEE INFOCOM, vol. 2019-April, 2019, pp. 622–30. Scopus, doi:10.1109/INFOCOM.2019.8737652.
Naghizadeh P, Gorlatova M, Lan AS, Chiang M. Hurts to Be Too Early: Benefits and Drawbacks of Communication in Multi-Agent Learning. Proceedings - IEEE INFOCOM. 2019. p. 622–630.

Published In

Proceedings - IEEE INFOCOM

DOI

ISSN

0743-166X

Publication Date

April 1, 2019

Volume

2019-April

Start / End Page

622 / 630