Truthful Online Preference Aggregation for LLM Fine-Tuning in Mobile Crowdsourcing
Researchers have developed a new online mechanism to improve the accuracy of human feedback used for fine-tuning large language models in mobile crowdsourcing applications. This mechanism addresses the issue of workers strategically misreporting their preferences by dynamically adjusting their influence based on feedback accuracy. The proposed method guarantees truthful feedback and achieves a sublinear regret of O(sqrt(T)) over T time slots, outperforming existing benchmark schemes in experiments. AI
IMPACT Enhances the reliability of human feedback for LLM fine-tuning, potentially leading to more accurate and user-aligned AI applications in mobile settings.