Billion-Scale Graph Foundation Models
Researchers have developed Graph Billion-Foundation-Fusion (GraphBFF), a framework for creating billion-parameter Graph Foundation Models (GFMs) designed for large-scale, heterogeneous graphs. The GraphBFF Transformer architecture enables practical GFMs, and the framework includes methodologies for data batching, pretraining, and fine-tuning. Evaluations on a billion-scale real-world graph demonstrated that GraphBFF consistently outperforms existing methods across ten diverse downstream tasks, even in few-shot scenarios. AI
IMPACT Introduces a scalable framework for building large-scale graph foundation models, potentially advancing AI applications in graph-structured data.