Towards on-line tuning of adaptive-agent’s multivariate meta-parameter
Identifikátory výsledku
Kód výsledku v IS VaVaI
<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985556%3A_____%2F21%3A00543581" target="_blank" >RIV/67985556:_____/21:00543581 - isvavai.cz</a>
Výsledek na webu
<a href="https://link.springer.com/article/10.1007/s13042-021-01358-w" target="_blank" >https://link.springer.com/article/10.1007/s13042-021-01358-w</a>
DOI - Digital Object Identifier
<a href="http://dx.doi.org/10.1007/s13042-021-01358-w" target="_blank" >10.1007/s13042-021-01358-w</a>
Alternativní jazyky
Jazyk výsledku
angličtina
Název v původním jazyce
Towards on-line tuning of adaptive-agent’s multivariate meta-parameter
Popis výsledku v původním jazyce
A decision-making (DM) agent models its environment and quantifes its DM preferences. An adaptive agent models them locally nearby the realisation of the behaviour of the closed DM loop. Due to this, a simple tool set often sufces for solving complex dynamic DM tasks. The inspected Bayesian agent relies on a unifed learning and optimisation framework, which works well when tailored by making a range of case-specifc options. Many of them can be made of-line. These options concern the sets of involved variables, the knowledge and preference elicitation, structure estimation, etc. Still, some metaparameters need an on-line choice. This concerns, for instance, a weight balancing exploration with exploitation, a weight refecting agent’s willingness to cooperate, a discounting factor, etc. Such options infuence, often vitally, DM quality and their adaptive tuning is needed. Specifc ways exist, for instance, a data-dependent choice of a forgetting factor serving to tracking of parameter changes. A general methodology is, however, missing. The paper opens a pathway to it. The solution uses a hierarchical feedback exploiting a generic, DM-related, observable, mismodelling indicator. The paper presents and justifes the theoretical concept, outlines and illustrates its use.
Název v anglickém jazyce
Towards on-line tuning of adaptive-agent’s multivariate meta-parameter
Popis výsledku anglicky
A decision-making (DM) agent models its environment and quantifes its DM preferences. An adaptive agent models them locally nearby the realisation of the behaviour of the closed DM loop. Due to this, a simple tool set often sufces for solving complex dynamic DM tasks. The inspected Bayesian agent relies on a unifed learning and optimisation framework, which works well when tailored by making a range of case-specifc options. Many of them can be made of-line. These options concern the sets of involved variables, the knowledge and preference elicitation, structure estimation, etc. Still, some metaparameters need an on-line choice. This concerns, for instance, a weight balancing exploration with exploitation, a weight refecting agent’s willingness to cooperate, a discounting factor, etc. Such options infuence, often vitally, DM quality and their adaptive tuning is needed. Specifc ways exist, for instance, a data-dependent choice of a forgetting factor serving to tracking of parameter changes. A general methodology is, however, missing. The paper opens a pathway to it. The solution uses a hierarchical feedback exploiting a generic, DM-related, observable, mismodelling indicator. The paper presents and justifes the theoretical concept, outlines and illustrates its use.
Klasifikace
Druh
J<sub>imp</sub> - Článek v periodiku v databázi Web of Science
CEP obor
—
OECD FORD obor
20205 - Automation and control systems
Návaznosti výsledku
Projekt
<a href="/cs/project/LTC18075" target="_blank" >LTC18075: Distribuované racionální rozhodování: kooperační aspekty</a><br>
Návaznosti
I - Institucionalni podpora na dlouhodoby koncepcni rozvoj vyzkumne organizace
Ostatní
Rok uplatnění
2021
Kód důvěrnosti údajů
S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů
Údaje specifické pro druh výsledku
Název periodika
International Journal of Machine Learning and Cybernetics
ISSN
1868-8071
e-ISSN
1868-808X
Svazek periodika
12
Číslo periodika v rámci svazku
9
Stát vydavatele periodika
DE - Spolková republika Německo
Počet stran výsledku
15
Strana od-do
2717-2731
Kód UT WoS článku
000663694300001
EID výsledku v databázi Scopus
2-s2.0-85108291105