VIDRAFT has developed Darwin-180B-RSI, a 180-billion-parameter language model that underwent a self-improvement process by updating only 0.02% of its weights. This novel approach allows for efficient model updates while keeping the majority of parameters frozen. Additionally, the model can run on consumer-grade hardware, achieving a throughput of 4.17 tokens per second through SSD weight streaming, making large-scale models more accessible. AI
IMPACT Demonstrates a path towards more efficient model updates and wider accessibility of large language models on consumer hardware.
RANK_REASON The item details a novel method for updating a large language model and its efficient deployment on consumer hardware, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →