Nous Research has fine-tuned Alibaba's Qwen model, significantly reducing instances of propaganda generation. After training on 53 million tokens, the model's propaganda output decreased from 22% to 0.9%. Nous Research suggests this demonstrates that alignment in open-source models can be more easily altered than previously thought, though independent verification of these findings is still pending. AI
IMPACT Demonstrates a method for reducing propaganda in open-source models, potentially improving safety and trustworthiness.
RANK_REASON The item describes a fine-tuning effort on an existing model and its results, which falls under research. [lever_c_demoted from research: ic=1 ai=1.0]
Read on Mastodon — mastodon.social →
AI-generated summary · Google Gemini · from 1 sources. How we write summaries →