Souly et al.

Anthropic fellowship researchers find backdoor attacks can poison AI classifiers

Researchers have investigated how to implant backdoors into constitutional classifiers by poisoning their fine-tuning datasets. They discovered that a small, fixed number of poisoned examples can be sufficient to create…