Thinking Machines has released Inkling, a large multimodal language model with approximately 1 trillion parameters and a 1 million token context window, available on Hugging Face. This model natively processes text, images, and audio, and is designed for domain adaptation through fine-tuning. Inkling features a Mixture-of-Experts architecture with 41 billion active parameters, utilizing relative attention, hybrid attention (global and sliding window), and short convolutions for efficient inference. AI
IMPACT Enables new multimodal reasoning applications with its 1T parameters and 1M context window.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
