New GNN architecture mHC-GNN tackles over-smoothing and expressiveness limits

Researchers have developed a new Graph Neural Network (GNN) architecture called mHC-GNN, which addresses the common issues of over-smoothing and limited expressiveness in deep GNNs. By adapting manifold-constrained hyper-connections from Transformers, mHC-GNN expands node representations across multiple streams and uses doubly stochastic matrices to constrain stream-mixing. This approach theoretically mitigates over-smoothing by ensuring node-pair differences decay much slower than in standard GNNs. Experiments show that mHC-GNN maintains high accuracy even at extreme depths (128 layers), significantly outperforming traditional GNNs which degrade beyond 16 layers. AI

IMPACT This research could enable deeper and more expressive graph neural networks, potentially improving performance in areas like social network analysis and molecular modeling.

RANK_REASON The cluster contains a research paper detailing a new model architecture for Graph Neural Networks. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• Birkhoff polytope
• Graph Neural Networks
• mHC-GNN
• Sinkhorn-Knopp normalization
• Subhankar Mishra
• Transformers

• paper
• model release

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →