Skip to main content
Journal cover image

Reinforcement Learning for Active Damping of Harmonically Excited Pendulum with Highly Nonlinear Actuator

Publication ,  Conference
Turner, JD; Manring, LH; Mann, BP
Published in: Conference Proceedings of the Society for Experimental Mechanics Series
January 1, 2020

Active vibration dampers can reduce or eliminate unwanted vibrations, but determining a good control policy can be challenging for highly nonlinear systems. For these types of systems, reinforcement learning is one method to optimize a control policy with only limited prior knowledge of the system dynamics. An experimental system was constructed by attaching a permanent magnet to the end of a pendulum and positioning an electromagnetic actuator below the resting position of the pendulum. The pendulum was excited with a sinusoidal force applied horizontally at the pivot point, and the control input was the applied voltage across the electromagnet. Due to the geometric arrangement and the strong dependence of magnetic force on distance, the relationship between the position of the pendulum and the actuation torque for any control input was highly nonlinear. A generalized version of the PILCO reinforcement learning algorithm was used to optimize a control policy for the electromagnet with the objective of minimizing the distance between the end of the pendulum and the downward position. After 16 s of interaction with the experimental system, the resulting learned policy was able to substantially reduce the amplitude of oscillation. This experiment illustrates the applicability of reinforcement learning to highly nonlinear active vibration damping problems.

Duke Scholars

Published In

Conference Proceedings of the Society for Experimental Mechanics Series

DOI

EISSN

2191-5652

ISSN

2191-5644

ISBN

9783030123901

Publication Date

January 1, 2020

Start / End Page

119 / 123
 

Citation

APA
Chicago
ICMJE
MLA
NLM
Turner, J. D., Manring, L. H., & Mann, B. P. (2020). Reinforcement Learning for Active Damping of Harmonically Excited Pendulum with Highly Nonlinear Actuator. In Conference Proceedings of the Society for Experimental Mechanics Series (pp. 119–123). https://doi.org/10.1007/978-3-030-12391-8_15
Turner, J. D., L. H. Manring, and B. P. Mann. “Reinforcement Learning for Active Damping of Harmonically Excited Pendulum with Highly Nonlinear Actuator.” In Conference Proceedings of the Society for Experimental Mechanics Series, 119–23, 2020. https://doi.org/10.1007/978-3-030-12391-8_15.
Turner JD, Manring LH, Mann BP. Reinforcement Learning for Active Damping of Harmonically Excited Pendulum with Highly Nonlinear Actuator. In: Conference Proceedings of the Society for Experimental Mechanics Series. 2020. p. 119–23.
Turner, J. D., et al. “Reinforcement Learning for Active Damping of Harmonically Excited Pendulum with Highly Nonlinear Actuator.” Conference Proceedings of the Society for Experimental Mechanics Series, 2020, pp. 119–23. Scopus, doi:10.1007/978-3-030-12391-8_15.
Turner JD, Manring LH, Mann BP. Reinforcement Learning for Active Damping of Harmonically Excited Pendulum with Highly Nonlinear Actuator. Conference Proceedings of the Society for Experimental Mechanics Series. 2020. p. 119–123.
Journal cover image

Published In

Conference Proceedings of the Society for Experimental Mechanics Series

DOI

EISSN

2191-5652

ISSN

2191-5644

ISBN

9783030123901

Publication Date

January 1, 2020

Start / End Page

119 / 123