A study using the NameRank tool found that large language models are better at recognizing projects than their creators. Across 37 models tested, most could identify the Fishermen and Scientists Research Society (FSRS) and its founder Jarrett Ye, but struggled to link Ye directly to FSRS without explicit prompting. Similarly, a translation group called Thoughts Memo, despite its significant following on Zhihu, was recognized by only a fraction of the models, with none identifying its founder. This suggests a gap in LLMs' ability to attribute work to individuals, even when the project itself is known. AI
IMPACT Highlights a current limitation in LLMs' ability to attribute work to individuals, suggesting a need for improved contextual understanding and creator recognition.
RANK_REASON The cluster discusses findings from a study about LLM capabilities, presented as a personal observation and call for community input, rather than a formal research paper or product release.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →
