新英格兰RLHF黑客（NERH）组织，主要由EleutherAI的合作者组成，举办了他们第三届专注于人类反馈强化学习（RLHF）的黑客马拉松。项目探索了使用Q学习逆向学习训练模型，将大型语言模型与理想化的奖励模型对齐而非人类偏好，并使用QDAIF等技术可视化奖励模型行为。另一项目研究了使用稀疏自编码器识别奖励模型中影响其评分的特征，揭示了对政治或怀孕等某些话题的潜在偏见。该组织还讨论了在不进行完整RLHF训练过程的情况下直接评估奖励模型的方法。 AI
排序理由 该集群描述了多个研究项目和来自专注于RLHF技术的黑客马拉松的实验结果。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
Introduction At the third New England RLHF Hackathon, several interesting projects were showcased, each focusing on different aspects of machine learning and reinforcement learning. Participants and those interested in future events are encouraged to join the Discord community fo…
Introduction Rekindling the spirit of collaboration, the New England RLHF Hackers (NERH) hosted their second hackathon at Brown University on October 8th, 2023. Stepping up from the success of our inaugural hackathon, this event was fueled by the same enthusiasm but with a fresh …
Introduction Author list is alphabetical by last name. We would like to extend acknowledgements to Delta Christine Hessler and Hailey Schoelkopf. On September 10, 2023, New England RLHF Hackers (NERH) held a hackathon at Brown University. For this hackathon we came in with one si…