indirect object identification (IOI) circuit

Weight pruning can damage AI model circuits without affecting accuracy

A new study published on arXiv investigates the failure modes of weight pruning in Transformer language models, specifically using GPT-2 as a test subject. Researchers found that standard metrics like accuracy and perpl…