Extrapolative Bayesian Optimization with Gaussian Process and Neural Network Ensemble Surrogate Models

Page view(s)
56
Checked on Jun 11, 2024
Extrapolative Bayesian Optimization with Gaussian Process and Neural Network Ensemble Surrogate Models
Title:
Extrapolative Bayesian Optimization with Gaussian Process and Neural Network Ensemble Surrogate Models
Journal Title:
Advanced Intelligent Systems
Publication Date:
16 September 2021
Citation:
Lim, Y.-F., Ng, C. K., Vaitesswar, U. S., & Hippalgaonkar, K. (2021). Extrapolative Bayesian Optimization with Gaussian Process and Neural Network Ensemble Surrogate Models. Advanced Intelligent Systems, 3(11), 2100101. Portico. https://doi.org/10.1002/aisy.202100101
Abstract:
Bayesian optimization (BO) has emerged as the algorithm of choice for guiding the selection of experimental parameters in automated active learning driven high throughput experiments in materials science and chemistry. Previous studies suggest that optimization performance of the typical surrogate model in the BO algorithm, Gaussian processes (GPs), may be limited due to its inability to handle complex datasets. Herein, various surrogate models for BO, including GPs and neural network ensembles (NNEs), are investigated. Two materials datasets of different complexity with different properties are used, to compare the performance of GP and NNE—the first is the compressive strength of concrete(8 inputs and 1 target), and the second is a simulated high-dimensional dataset of thermoelectric properties of inorganic materials (22 inputs and 1 target). While NNEs can converge faster toward optimum values, GPs with optimized kernels are able to ultimately achieve the best evaluated values after 100 iterations, even for the most complex dataset. This surprising result is contrary to expectations. It is believed that these findings shed new light on the understanding of surrogate models for BO, and can help accelerate the inverse design of new materials with better structural and functional performance.
License type:
Attribution 4.0 International (CC BY 4.0)
Funding Info:
This research / project is supported by the A*STAR - Accelerated Materials Discovery for Manufacturing
Grant Reference no. : A1898b0043

This research / project is supported by the A*STAR - Accelerated Catalyst Discovery Platform
Grant Reference no. : A19E9a0103
Description:
ISSN:
2640-4567