The developer of AsterVec has created a new disk-based vector database designed to operate within a configurable memory budget, addressing the RAM competition between local LLMs and embedded vector stores. Unlike traditional in-memory or RAM-dependent vector databases, AsterVec separates its index into two disk-optimized structures: an LSM-tree for graph edges and a page-based array for vectors, with only the upper navigation layers and caches residing in RAM. Benchmarks on the SIFT dataset show AsterVec significantly outperforming Chroma and LanceDB in query and insert speeds while using substantially less memory, making it suitable for local AI applications with memory constraints. AI
IMPACT Enables running larger local LLMs and RAG systems by reducing the memory footprint of vector databases.
RANK_REASON New software tool release for AI infrastructure.
- AsterVec
- Chroma
- Elasticsearch
- Hierarchical Navigable Small World graphs
- lancedb
- pgvector
- SIFT dataset
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →