Edge AI Deployment Beyond Models: A BSP-Aware Systems Framework for Industrial Embedded Platforms
This paper introduces a new systems framework designed to improve the deployment of Edge AI applications on industrial embedded platforms. It argues that treating AI deployment as a systems problem, rather than just a model packaging exercise, is crucial for success. The proposed framework is structured into five layers, from hardware to operations, and integrates with existing technologies like Android, NVIDIA Jetson, ONNX Runtime, and TensorRT to enhance reproducibility, diagnosability, and reliability in real-world industrial settings. AI
IMPACT Provides a structured approach to overcome challenges in deploying AI models on industrial embedded systems, aiming for greater reliability and manageability.