LLM Retrieval for Stable and Predictable Ad Recommendations
Researchers have developed a new framework to evaluate the stability and predictability of ad recommendation systems, addressing challenges posed by the rapid growth of ad inventory due to generative AI. This framework utilizes fine-tuned Large Language Models (LLMs) to generate semantic candidate ads. By extracting hierarchical semantic attributes from ad creatives, the LLM representations enable graph-based expansion, ensuring that variations in ad creatives lead to consistent and explainable delivery results. Large-scale industrial testing demonstrated significant improvements in both predictability and traditional performance metrics, with potential applications beyond advertising. AI
IMPACT Introduces a novel LLM-based approach to improve the stability and predictability of ad recommendation systems, potentially applicable to other large-scale retrieval systems.