An open-source port of NVIDIA's Audio2Face-3D model is now available for Apple Silicon, enabling local execution of speech-to-3D facial animation. The `speech-swift` package, released under the Apache 2.0 license, uses MLX for its forward pass and outputs timestamped facial animation coefficients, with options for emotion conditioning. While the current release provides the animation data, a renderer is planned for future integration, potentially as a ComfyUI node or Blender add-on. AI
IMPACT Enables local, offline generation of 3D facial animations from speech on Apple devices.
RANK_REASON Port of an existing model to new hardware/framework, with plans for further integration.
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →
