Skip to main content

Temporal task planning in wirelessly connected environments with unknown channel quality

Publication ,  Conference
Guo, M; Zavlanos, MM
Published in: 2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017
June 28, 2017

We consider a mobile robot tasked with gathering data in an environment of interest and transmitting these data to a data center. The task is specified as a high-level Linear Temporal Logic (LTL) formula that captures the data to be gathered at various regions in the workspace. The robot has a limited buffer to store the data, which needs to be transmitted to the data center before the buffer overflows. Communication between the robot and the data center is through a dedicated wireless network to which the robot can upload data with rates that are uncertain and unknown. In this case, most existing methods based on dynamic programming can not be applied due to the lack of an accurate model. To address this challenge, we propose here an actor-critic reinforcement learning algorithm where the task execution, workspace exploration, and parameterized-policy learning are all performed online and simultaneously. The derived motion and communication control strategy satisfies the buffer constraints and is reactive to the uncertainty in the wireless transmission rate. The overall complexity and performance of our method is compared in simulation to static solutions that search for constrained shortest paths, and to existing learning algorithms that rely on the construction of the product automaton.

Duke Scholars

Published In

2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017

DOI

ISBN

9781509028733

Publication Date

June 28, 2017

Volume

2018-January

Start / End Page

4161 / 4168
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Guo, M., & Zavlanos, M. M. (2017). Temporal task planning in wirelessly connected environments with unknown channel quality. In 2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017 (Vol. 2018-January, pp. 4161–4168). https://doi.org/10.1109/CDC.2017.8264271
Guo, M., and M. M. Zavlanos. “Temporal task planning in wirelessly connected environments with unknown channel quality.” In 2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017, 2018-January:4161–68, 2017. https://doi.org/10.1109/CDC.2017.8264271.
Guo M, Zavlanos MM. Temporal task planning in wirelessly connected environments with unknown channel quality. In: 2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017. 2017. p. 4161–8.
Guo, M., and M. M. Zavlanos. “Temporal task planning in wirelessly connected environments with unknown channel quality.” 2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017, vol. 2018-January, 2017, pp. 4161–68. Scopus, doi:10.1109/CDC.2017.8264271.
Guo M, Zavlanos MM. Temporal task planning in wirelessly connected environments with unknown channel quality. 2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017. 2017. p. 4161–4168.

Published In

2017 IEEE 56th Annual Conference on Decision and Control, CDC 2017

DOI

ISBN

9781509028733

Publication Date

June 28, 2017

Volume

2018-January

Start / End Page

4161 / 4168