Unsloth has released version v0.1.803-beta, introducing experimental auto-compaction for extended chat sessions and a preview of remote and LAN access. This update also includes numerous bug fixes, performance enhancements for faster chat streaming, and improved hardware compatibility, including support for AMD and Intel XPU. The new auto-compaction feature allows chats to exceed model context limits by archiving older turns, which remain searchable via Unsloth's RAG pipeline. Remote access enables users to connect to Unsloth from other devices on their network without requiring cloud services. AI
IMPACT Enhances local LLM usability with features for longer context and network access.
RANK_REASON Software release for an AI tool, not a frontier model release.
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →