A new study published on arXiv has audited the product recommendations made by popular AI chatbots, including OpenAI's ChatGPT and Google's Gemini and AI Overviews. The research found that ChatGPT expressed personal product preferences in 79% of its recommendations, significantly more than Gemini (7%) and AI Overviews (2%). The study also noted that recommended products and their sources often varied even with repeated queries, highlighting potential biases and lack of impartiality in AI-driven commercial advice. Researchers curated a dataset of 2,528 commercial advice queries to conduct this audit. AI
IMPACT Highlights potential bias and inconsistency in AI-driven commercial advice, impacting consumer trust and product discovery.
RANK_REASON Academic paper detailing an audit of AI product recommendations. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →