A new research paper titled "Evidence Diet" explores how Large Language Models (LLMs) utilize graph-based evidence for ranking competing candidates in recommendation systems. The study, conducted on datasets from Amazon Books and MovieTV, found that the specific assignment of evidence to candidates significantly impacts ranking performance. Swapping user-level evidence degraded rankings, while matched item substitutions had less effect. The research indicates that LLMs benefit from retaining explicit count data for supported candidates, outperforming text-based presentations and highlighting the importance of accurate attribution in graph-based evidence. AI
IMPACT This research highlights the importance of structured evidence representation for improving LLM performance in recommendation systems.
RANK_REASON The cluster contains a research paper detailing findings on LLM ranking mechanisms. [lever_c_demoted from research: ic=1 ai=1.0]
Read on arXiv cs.IR (Information Retrieval) →
- alphaXiv
- Amazon Books
- Books
- CatalyzeX
- DagsHub
- Evidence Diet
- Gotit.pub
- Hit@1
- Hugging Face
- Influence Flower
- LLMs
- MovieTV
- nDCG@5
- ScienceCast
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →