PulseAugur
EN
LIVE 07:49:52

arXiv papers refine contextual bandit algorithms with memory and batch learning

Two arXiv papers delve into the complexities of contextual bandit algorithms. The first paper, "Generalized Linear Bandits with Memory," refines regret bounds for linear and generalized linear models, achieving a $\tilde{O}(\sqrt{T})$ rate despite non-linear rewards and memory effects. The second paper, "Sequential Batch Learning in Finite-Action Linear Contextual Bandits," addresses the challenge of making decisions in batches, establishing regret bounds and algorithms for scenarios with fixed batch constraints, applicable to areas like personalized treatment and recommendation systems. AI

IMPACT These papers advance theoretical understanding and algorithmic approaches for sequential decision-making under uncertainty, potentially improving personalized systems.

RANK_REASON Two academic papers published on arXiv detailing advancements in contextual bandit algorithms.

Read on arXiv stat.ML →

AI-generated summary · Google Gemini · from 4 sources. How we write summaries →

arXiv papers refine contextual bandit algorithms with memory and batch learning

COVERAGE [4]

  1. arXiv cs.LG TIER_1 English(EN) · Yuhao Liu, Yu Chen, Longbo Huang ·

    Lipschitz Bandits with Arbitrary Feedback Delays

    arXiv:2608.15036v1 Announce Type: new Abstract: The Lipschitz bandit problem extends the traditional multi-armed bandit framework to continuous action spaces by assuming that the reward functions satisfy a Lipschitz condition. This work investigates Lipschitz bandits under arbitr…

  2. arXiv cs.LG TIER_1 English(EN) · Anling Xiang, Yuwen Yang, Yang Shen ·

    Beyond Peak Backlog: Conditional Energy and Temporal Geometry in Capacity-Constrained Delayed Bandit Optimization

    arXiv:2608.16216v1 Announce Type: new Abstract: What is the right delay complexity when a learner can track only $C$ pending feedback items and discarded feedback is permanently lost? Existing one-point bandit convex optimization guarantees in this model pay $\sqrt{T\sigma_{\max}…

  3. arXiv stat.ML TIER_1 English(EN) · Heesang Ann, Hyunjun Choi, Taehyun Hwang, Younghoon Shin, Haeju Cheong, Min-hwan Oh ·

    Generalized Linear Bandits with Memory

    arXiv:2608.15848v1 Announce Type: new Abstract: We study generalized linear bandits with memory, an endogenous non-stationary setting in which rewards depend on past actions through a finite memory matrix. Building on prior work for linear models (Clerici et al., 2024), we show t…

  4. arXiv stat.ML TIER_1 English(EN) · Yanjun Han, Zhengqing Zhou, Zihao Hu, Jose Blanchet, Peter W. Glynn, Yinyu Ye, Zhengyuan Zhou ·

    Sequential Batch Learning in Finite-Action Linear Contextual Bandits

    arXiv:2004.06321v2 Announce Type: replace-cross Abstract: We study the sequential batch learning problem in linear contextual bandits with finite action sets, where the decision maker is constrained to split incoming individuals into (at most) a fixed number of batches and can on…