Researchers have developed a Bid-Aware Filter Family (BAFF) to address training data interference in real-time bidding (RTB) A/B tests. This interference occurs when control and treatment models are trained on shared logs, leading to biased outcomes due to disagreements in ad selection and bidding prices. BAFF offers a structured approach to manage this bias by controlling tolerance to each interference channel independently, providing a spectrum between complete log-splitting and log-sharing. An online measurement protocol was proposed to evaluate data-sharing strategies against an interference-free reference model, showing that filter-based variants in live RTB deployments more closely preserve business metrics like CPC and CTR compared to traditional methods. AI
IMPACT This research could improve the accuracy and reliability of A/B testing for AI models in real-time bidding systems.
RANK_REASON The cluster contains a research paper detailing a new technical method. [lever_c_demoted from research: ic=1 ai=1.0]
- A/B testing
- BAFF
- Bid-Aware Filter Family
- click-through rate
- Communist Party of Canada
- digital signal processing
- real-time bidding
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →