AdaNAGED

New parameter-free optimization method enhances LLM fine-tuning efficiency

Researchers have introduced AdaNAGED, a novel parameter-free optimization method designed for efficient fine-tuning of large language models (LLMs). This approach unifies gradient-free training, adaptive parameter tunin…