Transfer of Knowledge for Surrogate Model Selection in Cost-Aware Optimization

Result code in IS VaVaI

<a href="https://www.isvavai.cz/riv?ss=detail&h=RIV%2F67985807%3A_____%2F18%3A00493290" target="_blank" >RIV/67985807:_____/18:00493290 - isvavai.cz</a>

Result on the web

<a href="https://www.ies.uni-kassel.de/p/ial2018/ialatecml2018.pdf" target="_blank" >https://www.ies.uni-kassel.de/p/ial2018/ialatecml2018.pdf</a>

DOI - Digital Object Identifier

—

Result language

angličtina

Original language name

Transfer of Knowledge for Surrogate Model Selection in Cost-Aware Optimization

Original language description

PUBLISHED IN: ECML PKDD 2018: Workshop on Interactive Adaptive Learning. Proceedings. Dublin, 2018 - (Krempl, G., Lemaire, V., Kottke, D., Calma, A., Holzinger, A., Polikar, R., Sick, B.). s. 89-94. [ECML PKDD 2018: The European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases. 10.09.2018-14.09.2018, Dublin]. Grant CEP: GA ČR GA17-01251S. ABSTRACT: Surrogate model selection is an active-learning approach to cost-aware continuous black-box optimization in domains where the evaluation of the black-box objective function is expensive, e. g., obtained experimentally or resulting from comprehensive simulations. Active reusing of knowledge represented by landscape properties of the objective function accross different tasks can provide additional information for more reliable decisions in terms of a suitable surrogate model and a suitable setting of its hyperparameters. However, research into using metalearning and especially Exploratory Landscape Analysis (ELA) in this context is only starting. Our goal is to develop a learning system capable to recommend a surrogate model on the basis of the knowledge obtained in previous black-box optimization tasks. In this paper, we provide a first step necessary to construct a learning system applying knowledge from previous tasks to a new one: a study of the applicability of ELA to two important kinds of surrogate models – Gaussian processes (GP) and ensembles of regression trees (random forests, RF). Results using the noiseless benchmarks of the Comparing-Continuous-Optimisers (COCO) platform in the expensive scenario, where at most 50D evaluations are available, are analysed for statistical dependences between model performance and a broad variety of landscape features.n

Czech name

—

Czech description

—

Type

O - Miscellaneous

CEP classification

—

OECD FORD branch

10201 - Computer sciences, information science, bioinformathics (hardware development to be 2.2, social aspect to be 5.8)

Project

<a href="/en/project/GA17-01251S" target="_blank" >GA17-01251S: Metalearning for Extraction of Rules with Numerical Consequents</a><br>

Continuities

P - Projekt vyzkumu a vyvoje financovany z verejnych zdroju (s odkazem do CEP)

Publication year

2018

Confidentiality

S - Úplné a pravdivé údaje o projektu nepodléhají ochraně podle zvláštních právních předpisů