H Company has introduced NeoMME, a new family of multimodal encoders designed for efficiency. These models, available in 260M and 800M parameter sizes, eliminate the need for separate vision towers and causal decoders, processing both text and image data through a single transformer architecture. This streamlined approach aims to reduce computational overhead while maintaining strong performance, with the 260M NeoMME-Retriever achieving competitive results on document retrieval benchmarks. AI
IMPACT This new architecture could lead to more efficient multimodal AI systems by reducing computational overhead.
RANK_REASON Release of a new family of multimodal encoders with novel architecture.
Read on Mastodon — sigmoid.social →
- ALBERT
- BEIR-15
- ColPali
- ColQwen2.5-v0.2
- FLORES-200+
- H Company
- Hugging Face Transformers
- ModernBERT
- NeoMME
- NeoMME-Retriever
- NVIDIA H100
- NVIDIA L40S
- SigLIP2
- ViDoRe V3
- Vultron Retriever Flash
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →