WinoBias

New ROBIN method targets bias in Transformer attention heads

Researchers have developed ROBIN, a novel method for debugging and repairing bias in transformer language models at the attention head level. Unlike existing methods that focus on input-output or retraining, ROBIN targe…