DiagramRAG: A Lightweight Framework to Retrieve Scientific Diagram for Figure Generation
Researchers have developed DiagramRAG, a new framework designed to assist in the generation of scientific diagrams from user sketches. This system leverages retrieval-augmented generation, using knowledge graphs to represent diagrams and an embedding model to find reference diagrams that are both semantically relevant and topologically compatible with the input sketch. The retrieved references then inform the completion and rendering of publication-quality diagrams, achieving strong performance on benchmarks like DiagramBank and FigureBench. AI
IMPACT This framework could streamline the creation of scientific figures, potentially accelerating research communication and publication.