Researchers have developed a new multimodal framework using Reinforcement Learning from Human Feedback (RLHF) to translate degraded Han-Nom manuscripts into modern Vietnamese. The system integrates visual features from CLIP ViT-L/14@336, Han-Nom representations from bert-base-chinese, and Vietnamese representations from vinai/phobert-base, alongside T5-small encoder states. Experiments comparing Proximal Policy Optimization (PPO), Direct Preference Optimization (DPO), and KTO showed that DPO achieved the best results across several metrics, significantly improving lexical and semantic quality for this low-resource historical translation task. AI
IMPACT This research advances multimodal translation techniques, potentially improving the accessibility of historical texts.
RANK_REASON The cluster contains an academic paper detailing a new research methodology and experimental results.
- bert-base-chinese
- CLIP ViT-L/14@336
- Direct Preference Optimization
- Kim Trang Vo Thi
- KTO
- Proximal Policy Optimization
- T5-Small
- vinai/phobert-base
AI-generated summary · Google Gemini · from 2 sources. How we write summaries →