Researchers have introduced GEM-Bench, a new benchmark designed to evaluate the generation of ad-injected responses within Generative Engine Marketing (GEM) systems. GEM involves integrating advertisements into the outputs of generative AI models like chatbots. The benchmark includes datasets for chatbot and search scenarios, a metric system for user satisfaction and engagement, and baseline implementations. Initial findings suggest that while simple ad insertion can boost click-through rates, it may decrease user satisfaction, highlighting a trade-off that requires further research. AI
IMPACT Introduces a new evaluation framework for monetizing generative AI outputs, potentially influencing how ads are integrated into AI-driven marketing.
RANK_REASON The cluster contains a research paper introducing a new benchmark. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →