PulseAugur
EN
LIVE 16:40:46

LLM Features Can Harm GNN Performance on Homophilous Graphs

By PulseAugur Editorial · [2 sources] ·

Research published on arXiv indicates that incorporating features generated by large language models (LLMs) into graph neural networks (GNNs) can, counterintuitively, decrease performance on certain homophilous graph benchmarks. This degradation occurs specifically when LLM features are added through simple input concatenation rather than more integrated training methods. The study proposes a metric called Delta_sig to predict when this concatenation interference is likely to occur, finding it correlates more strongly with performance drops than graph homophily. AI

IMPACT This research suggests that simply concatenating LLM-generated features may not always improve GNN performance, highlighting the need for careful integration strategies.

RANK_REASON The cluster contains a research paper published on arXiv detailing experimental findings about the interaction between LLM features and GNNs. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.CL →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

COVERAGE [2]

  1. arXiv cs.AI TIER_1 English(EN) · Zhongyuan Wang, Pratyusha Vemuri ·

    LLM Features Can Hurt GNNs: Concatenation Interference on Homophilous Graph Benchmarks

    arXiv:2606.17579v1 Announce Type: cross Abstract: Adding LLM-generated node features to graph neural networks (GNNs) is widely reported to improve accuracy on standard benchmarks. We document a contrasting observation: when LLM features are introduced through pure input concatena…

  2. arXiv cs.CL TIER_1 English(EN) · Pratyusha Vemuri ·

    LLM Features Can Hurt GNNs: Concatenation Interference on Homophilous Graph Benchmarks

    Adding LLM-generated node features to graph neural networks (GNNs) is widely reported to improve accuracy on standard benchmarks. We document a contrasting observation: when LLM features are introduced through pure input concatenation (rather than joint training, distillation, or…

RELATED ENTITIES

RELATED TOPICS