English(EN)Nearly Minimax-Optimal Regret for Linear Contextual Bandits with Arbitrary Adaptive Action Sets
新的arXiv论文推进了多臂老虎机算法和遗憾最小化
作者PulseAugur 编辑部·[14 个来源]·
arXiv上发表的多篇研究论文探讨了多臂老虎机算法的进展。其中一篇论文解决了具有遗忘对手的老虎机的最优切换遗憾问题，提出了一种无论切换次数如何都能实现最优遗憾的单一算法。另一项研究侧重于在随机半老虎机环境中选择具有最小最长路径长度的k条路径，这与并行数据传输相关。进一步的研究调查了具有任意自适应动作集的线性上下文老虎机，实现了近乎最小最大最优的遗憾界限。此外，论文还深入研究了具有探测和获胜反馈的老虎机设置、满意遗憾最小化以及非单调凸脊老虎机的Thompson采样，所有这些都有助于更深入地理解各种老虎机问题形式中的遗憾最小化和最优策略。
AI
arXiv:2609.17595v1 Announce Type: new Abstract: In the improving multi-armed bandits problem, each of $k$ arms has an unknown nondecreasing, discretely concave reward curve $f_i$, and pulling arm $i$ for the $t$-th time yields $f_i(t)$. For sufficiently long horizons, Blum and Ra…
arXiv:2609.16824v1 Announce Type: new Abstract: Decentralized bandit systems often contain heterogeneous agents: rewards can change at individual agents even when the best action for the network stays the same. These local changes may cancel when rewards are averaged across agent…
Decentralized bandit systems often contain heterogeneous agents: rewards can change at individual agents even when the best action for the network stays the same. These local changes may cancel when rewards are averaged across agents, so the number of local changes $\Stloc$ can b…
arXiv:2609.13547v1 Announce Type: new Abstract: We study switching regret in adversarial multi-armed bandits, where the learner competes with an arm sequence that changes at most $S$ times. When $S$ is known, an optimal expected regret of $\widetilde{\mathcal{O}}(\sqrt{(S+1)KT})$…
arXiv:2609.14557v1 Announce Type: new Abstract: When performing parallel data transmission through a network using multiple paths, it is practically important to minimize the maximum transmission time among the selected paths. This study addresses an online problem in which $k$ p…
arXiv:2609.15170v1 Announce Type: new Abstract: We study stochastic linear contextual bandits with arbitrary action menus that may depend on the fixed parameter and the interaction history. We establish matching upper and lower bounds, up to logarithmic factors. Let $d$ be the di…
arXiv:2609.15248v1 Announce Type: new Abstract: A learner probes at most $k$ of $n$ arms each round, receives the maximum of their rewards in $[0,1]$, and competes with the best fixed arm. When does the probing advantage pay for learning? We determine two minimax laws. Under inde…
arXiv:2406.06802v4 Announce Type: replace-cross Abstract: Motivated by the concept of satisficing in decision-making, we consider the problem of satisficing regret minimization in bandit optimization. In this setting, the learner aims at selecting satisficing arms (arms with mean…
arXiv:2602.04761v2 Announce Type: replace Abstract: Gradient-variation online learning has drawn increasing attention due to its deep connections to game theory and optimization. It has been studied extensively in the full-information setting, but is underexplored with bandit fee…
arXiv:2311.01327v3 Announce Type: replace Abstract: We investigate the contextual bandits with knapsack (CBwK) problem in a high-dimensional linear setting, where the feature dimension can be very large. Our goal is to harness sparsity to obtain sharper regret guarantees. To this…
arXiv cs.LG
TIER_1English(EN)·Nathan Boyer, Dorian Baudry, Patrick Rebeschini·
arXiv:2510.07424v3 Announce Type: replace Abstract: We study linear contextual bandits with paid observations, where at each round the learner observes a context, selects an action, and may pay a fixed cost to observe feedback from a subset of arms. We propose two Follow-the-Regu…
arXiv cs.LG
TIER_1English(EN)·Kaan Buyukkalayci, Osama Hanna, Christina Fragouli·
arXiv:2603.12530v3 Announce Type: replace Abstract: Recent work shows that when contexts are drawn i.i.d., linear contextual bandits can be reduced to single-context linear bandits. This ``contexts are cheap'' perspective is highly advantageous, as it allows for sharper finite-ti…
Bakhtiari, Lattimore and Szepesvári (COLT 2025) proved that Thompson sampling (TS) has Bayesian regret $\tilde O(d^{5/2}\sqrt n)$ for bandit convex optimisation with convex \emph{monotone} ridge losses $f(x)=\ell(\ip{x}θ)$, and asked whether monotonicity of the link is necessary.…
