Tencent has released its new AI model, Hy4 Preview, boasting 770 billion total parameters and 49 billion active parameters. This open-weight model features a 1 million token context window and utilizes a Mixture-of-Experts architecture, activating only a portion of its parameters per token. The release highlights the rapid advancements in the open-weight AI landscape. AI
IMPACT Accelerates the open-weight AI race with a large parameter count and context window.
RANK_REASON Frontier-lab model release with system card [lever_c_demoted from frontier_release: ic=2 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →