A/B testing
PulseAugur coverage of A/B testing — every cluster mentioning A/B testing across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
LLM search evaluation improved with historical user data · arXiv
Researchers have developed a new method for evaluating search engine results using Large Language Models (LLMs) that incorporates historical user interaction data. This "behavior-grounded" approach uses Query-Relevance-…
-
New framework validates LLM surrogacy for A/B testing
A new statistical framework has been developed to address the use of large language models (LLMs) in place of human participants for A/B testing. The framework adapts surrogate endpoint theory to assess when LLM outcome…
-
Causal ML offers solution for B2B revenue optimization
Traditional A/B testing is often ineffective for B2B revenue optimization due to small sample sizes and long sales cycles. This article proposes using Causal Machine Learning, specifically Propensity Score Matching, to …
-
Vercel Edge Config powers Shopify A/B tests with 18% CTR lift
A developer shares five A/B testing strategies for Shopify storefronts using Vercel Edge Config. These tests, implemented with minimal code changes, focus on elements like hero copy, geo-targeted free shipping, sticky c…
-
New framework enhances A/B testing robustness under model misspecification
Researchers have developed a new framework for robust sequential experimental design in A/B testing, specifically addressing challenges posed by model misspecification. This approach aims to improve sample efficiency by…
-
Gaming news covers ARC Raiders quest and James Bond actor casting
This article discusses common mistakes made during A/B testing and how leading companies ensure successful experiments in production. It highlights the importance of understanding why seemingly successful tests might fa…