The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models
PulseAugur coverage of The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models — every cluster mentioning The Mask Is Not the Model: Auditing Prefix Invariance in Attention, State-Space, and Hybrid Sequence Models across labs, papers, and developer communities, ranked by signal.
2 day(s) with sentiment data
-
AI startup VIDRAFT unveils AX-RAY to detect hidden causal leakage in models
VIDRAFT, an AI safety startup, has developed a new auditing framework called AX-RAY to detect causal leakage in hybrid sequence models. This leakage occurs when future token information improperly influences earlier pos…
-
New audit method detects causality leaks missed by attention masks
Researchers have developed a new audit method to detect causality violations in sequence models, which goes beyond traditional attention-mask inspections. This lightweight audit, involving two forward passes without tra…