A Comparison Between a Two-Feedback Control Loop and a Reinforcement Learning Algorithm for Compliant Low-Cost Series Elastic Actuators

dc.contributor.authorSanfilippo, Filippo
dc.contributor.authorTuan Minh, Hua
dc.contributor.authorBos, Steven
dc.date.accessioned2020-01-04T07:19:23Z
dc.date.available2020-01-04T07:19:23Z
dc.date.issued2020-01-07
dc.description.abstractHighly-compliant elastic actuators have become progressively prominent over the last years for a variety of robotic applications. With remarkable shock tolerance, elastic actuators are appropriate for robots operating in unstructured environments. In accordance with this trend, a novel elastic actuator was recently designed by our research group for Serpens, a low-cost, open-source and highly-compliant multi-purpose modular snake robot. To control the newly designed elastic actuators of Serpens, a two-feedback loops position control algorithm was proposed. The inner controller loop is implemented as a model reference adaptive controller (MRAC), while the outer control loop adopts a fuzzy proportional-integral controller (FPIC). The performance of the presented control scheme was demonstrated through simulations. However, the efficiency of the proposed controller is dependent on the initial values of the parameters of the MRAC controller as well as on the effort required for a human to manually construct fuzzy rules. An alternative solution to the problem might consist of using methods that do not assume a priori knowledge: a solution that derives its properties from a machine learning procedure. In this way, the controller would be able to automatically learn the properties of the elastic actuator to be controlled. In this work, a novel controller for the proposed elastic actuator is presented based on the use of an artificial neural network (ANN) that is trained with reinforcement learning. The newly designed control algorithm is extensively compared with the former approach. Simulation results are presented for both methods. The authors seek to achieve a fair, non-biased, risk-aware and trustworthy comparison.
dc.format.extent10 pages
dc.identifier.doi10.24251/HICSS.2020.110
dc.identifier.isbn978-0-9981331-3-3
dc.identifier.urihttp://hdl.handle.net/10125/63849
dc.language.isoeng
dc.relation.ispartofProceedings of the 53rd Hawaii International Conference on System Sciences
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subjectAccountability and Evaluation of AI Algorithms
dc.subjectcontrol theory
dc.subjectmachine learning
dc.subjectreinforcement learning
dc.subjectrobotics
dc.subjectseries elastic actuator
dc.titleA Comparison Between a Two-Feedback Control Loop and a Reinforcement Learning Algorithm for Compliant Low-Cost Series Elastic Actuators
dc.typeConference Paper
dc.type.dcmiText

Files

Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
0088.pdf
Size:
2.97 MB
Format:
Adobe Portable Document Format