Josh Engels

Data filtering shows limited effect on LLM behavior, study finds

A study on the OLMo model found that filtering training data to remove undesirable traits often has minimal impact on the model's behavior. Researchers attempted to remove data points associated with specific behaviors …