On-Device Generative AI for GDPR-Compliant Visual Monitoring: Natural Language Alerts from Local Object Detection
Researchers have developed a privacy-focused visual monitoring system that keeps all AI processing on the edge device, adhering to GDPR principles. This system uses a YOLOv5n-seg model on a Raspberry Pi 5 with a Hailo-8L accelerator for real-time object detection, discarding raw images immediately after inference. A Phi-3 Mini LLM then generates concise natural-language alerts from minimal JSON data, which are transmitted over the network, ensuring no image data leaves the local environment. AI
IMPACT Demonstrates feasibility of on-device LLMs for real-time, privacy-preserving AI applications.