Skip to main content

Behavioral hierarchy: Exploration and representation

Publication ,  Journal Article
Barto, AG; Konidaris, G; Vigorito, C
January 1, 2014

Behavioral modules are units of behavior providing reusable building blocks that can be composed sequentially and hierarchically to generate extensive ranges of behavior. Hierarchies of behavioral modules facilitate learning complex skills and planning at multiple levels of abstraction and enable agents to incrementally improve their competence for facing new challenges that arise over extended periods of time. This chapter focuses on two features of behavioral hierarchy that appear to be less well recognized: its influence on exploratory behavior and the opportunity it affords to reduce the representational challenges of planning and learning in large, complex domains. Four computational examples are described that use methods of hierarchical reinforcement learning to illustrate the influence of behavioral hierarchy on exploration and representation. Beyond illustrating these features, the examples provide support for the central role of behavioral hierarchy in development and learning for both artificial and natural agents.

Duke Scholars

DOI

Publication Date

January 1, 2014

Volume

9783642398759

Start / End Page

13 / 46
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Barto, A. G., Konidaris, G., & Vigorito, C. (2014). Behavioral hierarchy: Exploration and representation, 9783642398759, 13–46. https://doi.org/10.1007/978-3-642-39875-9_2
Barto, A. G., G. Konidaris, and C. Vigorito. “Behavioral hierarchy: Exploration and representation” 9783642398759 (January 1, 2014): 13–46. https://doi.org/10.1007/978-3-642-39875-9_2.
Barto AG, Konidaris G, Vigorito C. Behavioral hierarchy: Exploration and representation. 2014 Jan 1;9783642398759:13–46.
Barto, A. G., et al. Behavioral hierarchy: Exploration and representation. Vol. 9783642398759, Jan. 2014, pp. 13–46. Scopus, doi:10.1007/978-3-642-39875-9_2.
Barto AG, Konidaris G, Vigorito C. Behavioral hierarchy: Exploration and representation. 2014 Jan 1;9783642398759:13–46.

DOI

Publication Date

January 1, 2014

Volume

9783642398759

Start / End Page

13 / 46