Yoshihiko Fujisawa

New LoRDBA method enables efficient on-device LLM fine-tuning

Researchers have developed a new method called LoRDBA for fine-tuning large language models on devices. This technique replaces standard low-rank factors with binary sign carriers, significantly reducing the adapter's s…