New method filters safety-degrading data for LLM fine-tuning

Researchers have developed DataShield, a new method to identify and filter safety-degrading data within benign datasets used for fine-tuning large language models. The approach quantifies each data sample's contribution to the model's compliance behavior, allowing for the isolation of high-risk subsets. Experiments on models like Llama3 and Qwen2.5 demonstrated DataShield's effectiveness in pinpointing data that could inadvertently reduce LLM safety, particularly in open-ended question answering tasks. AI

IMPACT Provides a data-centric approach to mitigate safety degradation during LLM fine-tuning, potentially improving model robustness.

RANK_REASON The cluster contains an academic paper detailing a new method for LLM safety. [lever_c_demoted from research: ic=1 ai=1.0]

Read on arXiv cs.AI →

• Alpaca
• DataShield
• Dolly
• Llama3.1-8B
• Llama3-8B
• LLM
• Qwen2.5-7B

• paper
• safety

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →