Author-in-the-Loop Response Generation and Evaluation: Integrating Author Expertise and Intent in Responses to Peer Review
Researchers have developed a new framework called REspGen to assist authors in generating responses to peer reviews, integrating author expertise and intent. This framework is accompanied by Re3Align, a large dataset of review-response-revision triplets, and REspEval, a comprehensive suite of over 20 metrics for evaluating response quality. Experiments using state-of-the-art large language models demonstrate the effectiveness of author input and evaluation-guided refinement in improving response generation. AI
IMPACT Introduces new tools and datasets for improving AI-assisted scientific communication and peer review processes.