RANDOPT: Optimisation par algorithmes stochastiques

Bayesian optimization efficiently finds strong experts in LLMs

Researchers have developed a new method using Bayesian optimization to efficiently identify strong single experts within large language models, a process known as gradient-free post-training. This approach, which applie…