Adaptive Replication Strategies in Trust-Region-Based Bayesian Optimization of Stochastic Functions

Archive ouverte

Binois, Mickael | Larson, Jeffrey

Edité par CCSD -

We develop and analyze a method for stochastic simulation optimization relying on Gaussian process models within a trust-region framework. We are interested in the case when the variance of the objective function is large. We propose to rely on replication and local modeling to cope with this high-throughput regime, where the number of evaluations may become large to get accurate results while still keeping good performance. We propose several schemes to encourage replication, from the choice of the acquisition function to setup evaluation costs. Compared with existing methods, our results indicate good scaling, in terms of both accuracy (several orders of magnitude better than existing methods) and speed (taking into account evaluation costs).

Suggestions

Du même auteur

Heteroskedastic Gaussian processes for simulation experiments

Archive ouverte | Binois, Mickael | CCSD

International audience. An increasing number of time-consuming simulators exhibit a complex noise structure that depends on the inputs. To conduct studies with limited budgets of evaluations, new surrogate methods a...

A portfolio approach to massively parallel Bayesian optimization

Archive ouverte | Binois, Mickael | CCSD

International audience. One way to reduce the time of conducting optimization studies is to evaluate designs in parallel rather than just one-at-a-time. For expensive-to-evaluate black-boxes, batch versions of Bayes...

hetGP: Heteroskedastic Gaussian Process Modeling and Sequential Design in R

Archive ouverte | Binois, Mickael | CCSD

International audience. An increasing number of time-consuming simulators exhibit a complex noise structure that depends on the inputs. For conducting studies with limited budgets of evaluations, new surrogate metho...

Chargement des enrichissements...