Wuwenxiong, in collaboration with Tsinghua University and Shanghai Jiao Tong University, has open-sourced APXInf, an inference engine designed for embodied AI on edge devices. This engine aims to optimize the performance of embodied models on robotic platforms, significantly reducing end-to-end latency from approximately 278ms to under 26ms for the PI 0.5 FP8 model on Jetson Thor. APXInf supports various hardware platforms including NVIDIA Jetson Orin, Jetson Thor, and RTX 4090, with plans to expand support to domestic chips and other hardware. AI
IMPACT This open-source engine could accelerate the deployment of embodied AI on robots by optimizing inference for edge devices, reducing latency and improving real-time control capabilities.
RANK_REASON Open-source release of a specialized inference engine for embodied AI, developed in collaboration with academic institutions.
- APXInf
- $\ ext{PI}_{0.5}$
- Jetson Thor
- NVIDIA Jetson Orin
- Python
- RTX 4090
- Rust
- Shanghai Jiao Tong University
- Tsinghua University
- Wuwenxiong
- Infinigence AI
- PI 0.5
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →