Automated Kernel Discovery Towards Understanding High-dimensional Bayesian Optimization
Researchers have developed new methods to improve Bayesian optimization, a technique used for optimizing complex functions. One approach, Dynamic Shared Embedding Bayesian Optimization (DSEBO), automatically adjusts the dimensionality of the search space to handle high-dimensional problems more effectively. Another method, Kernel Discovery, uses LLMs to automatically generate and select optimal kernel functions for these optimization tasks, outperforming existing baselines. A third framework, BOOST, automates the joint selection of kernel and acquisition functions, demonstrating robustness across various optimization landscapes. AI
IMPACT These advancements in Bayesian optimization could lead to more efficient and effective tuning of complex models and systems in various AI applications.