Gaussian Processes suffer boundary bias from kernel geometry

A new paper identifies boundary variance inflation as a cause of acquisition bias in Gaussian processes. This phenomenon, where posterior variance is inflated near the boundary of a bounded domain, can lead to over-exploration in Bayesian optimization. The researchers trace this bias to a geometric mechanism where the kernel's correlation neighborhood is truncated at the domain boundary, distorting observations independently of the objective function. They propose a selection-profile diagnostic to quantify this bias across different acquisition functions and geometries. AI

IMPACT Identifies a bias in Gaussian processes that can affect Bayesian optimization, potentially leading to more efficient exploration strategies.

RANK_REASON The cluster contains an academic paper detailing a new finding in Gaussian processes. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv stat.ML →

• Bayesian optimization
• Gaussian processes

• paper
• other

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →