Tencent has released Hy4 Preview, an open-weight AI model with 770 billion total parameters and 49 billion active parameters. This model features a 1 million token context window and utilizes a Mixture-of-Experts architecture, meaning only a fraction of its parameters are engaged per token. The release highlights the rapid advancement in the open-weight AI landscape. AI
IMPACT This release signifies a significant step in the open-weight AI model race, offering a large parameter count and context window that could influence future research and development.
RANK_REASON Frontier-lab model release with system card. [lever_c_demoted from frontier_release: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →