Decentralized Reinforcement Learning of Robot Behaviors
The result's identifiers
Result code in IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F68407700%3A21730%2F18%3A00316453" target="_blank" >RIV/68407700:21730/18:00316453 - isvavai.cz</a>
Result on the web
<a href="https://doi.org/10.1016/j.artint.2017.12.001" target="_blank" >https://doi.org/10.1016/j.artint.2017.12.001</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1016/j.artint.2017.12.001" target="_blank" >10.1016/j.artint.2017.12.001</a>
Alternative languages
Result language
angličtina
Original language name
Decentralized Reinforcement Learning of Robot Behaviors
Original language description
A multi-agent methodology is proposed for Decentralized Reinforcement Learning (DRL) of individual behaviors in problems where multi-dimensional action spaces are involved. When using this methodology, sub-tasks are learned in parallel by individual agents working toward a common goal. In addition to proposing this methodology, three specific multi agent DRL approaches are considered: DRL-Independent, DRL Cooperative-Adaptive (CA), and DRL-Lenient. These approaches are validated and analyzed with an extensive empirical study using four different problems: 3D Mountain Car, SCARA Real-Time Trajectory Generation, Ball-Dribbling in humanoid soccer robotics, and Ball-Pushing using differential drive robots. The experimental validation provides evidence that DRL implementations show better performances and faster learning times than their centralized counterparts, while using less computational resources. DRL-Lenient and DRL-CA algorithms achieve the best final performances for the four tested problems, outperforming their DRL-Independent counterparts. Furthermore, the benefits of the DRL-Lenient and DRL-CA are more noticeable when the problem complexity increases and the centralized scheme becomes intractable given the available computational resources and training time.
Czech name
—
Czech description
—
Classification
Type
J<sub>imp</sub> - Article in a specialist periodical, which is included in the Web of Science database
CEP classification
—
OECD FORD branch
20205 - Automation and control systems
Result continuities
Project
<a href="/en/project/EF15_003%2F0000470" target="_blank" >EF15_003/0000470: Robotics 4 Industry 4.0</a><br>
Continuities
P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)
Others
Publication year
2018
Confidentiality
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Data specific for result type
Name of the periodical
Artificial Intelligence
ISSN
0004-3702
e-ISSN
1872-7921
Volume of the periodical
256
Issue of the periodical within the volume
March
Country of publishing house
GB - UNITED KINGDOM
Number of pages
30
Pages from-to
130-159
UT code for WoS article
000424958700005
EID of the result in the Scopus database
2-s2.0-85038868982