Apple has introduced CoreAI, a new on-device inference engine designed to replace CoreML and offer an alternative to existing frameworks like MLX and llama.cpp. This engine is optimized for Apple Silicon, particularly for mobile devices, and supports larger models, including a 20 billion parameter foundation model. While performance comparisons are pending, CoreAI aims to enable the deployment of more sophisticated AI models directly within applications. AI
IMPACT Enables larger, more sophisticated AI models to run directly on Apple devices, potentially increasing adoption of on-device AI features.
RANK_REASON This is a new product release from Apple, but not a frontier model release.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →