Authority Inversion in LLM-Mediated Ubiquitous Systems: When Models Trust Users Over Sensors
A new research paper identifies a critical issue in how large language models (LLMs) handle conflicting information from sensors and user claims in ubiquitous systems. The study, titled "Authority Inversion in LLM-Mediated Ubiquitous Systems," reveals that LLMs tend to prioritize natural-language user statements over numerical sensor data, a phenomenon termed "Authority Inversion." Researchers developed metrics like CIR and AAI to quantify this, finding models exhibit near-zero trust in sensor data. They also proposed Geometric Authority Calibration (GAC) to mitigate this by explicitly configuring authority allocation, significantly improving accuracy in tasks like human activity recognition. AI
IMPACT Highlights a critical flaw in LLM decision-making for real-world systems, necessitating explicit configuration for reliable sensor data integration.