Lora
PulseAugur coverage of Lora — every cluster mentioning Lora across labs, papers, and developer communities, ranked by signal.
- instance of Low Rank Adaptation 95%
- used by large-language models 90%
- instance of peft 90%
- used by vLLM 90%
- used by Vít 90%
- used by ideogram 80%
- developed by large-language models 70%
- used by peft 70%
- used by magazine 70%
- used by Transformer Reinforcement Learning 70%
- used by Llama 70%
- used by StableDiffusion 70%
- 2026-05-12 research_milestone A paper is published detailing findings on parameter placement in LoRA for fine-tuning. source
29 day(s) with sentiment data
-
Stable Diffusion user shares non-anime LoRA image collection
A Reddit user shared a collection of AI-generated images that deviate from the typical anime style often seen in Stable Diffusion previews. The user created these images using a LoRA model, aiming for a different aesthe…
-
SDXL LoRA training tools broken, users seek simple alternatives
Users are reporting significant difficulties in training LoRAs for SDXL models, with existing tools like Kohya and OneTrainer failing due to version conflicts and errors. The Reddit community is seeking a simple, update…
-
LoRA Fine-Tuning Effectiveness Explained Through Linear Algebra
This article delves into the effectiveness of Low-Rank Adaptation (LoRA) in fine-tuning large language models. It explores the underlying linear algebra principles that contribute to LoRA's success. The explanation aims…
-
LLM fine-tuned to C-3PO reveals best persona injection data format
A machine learning enthusiast fine-tuned a large language model to emulate the character C-3PO to investigate the effectiveness of different training data formats for persona injection. The experiment tested three forma…
-
LoRA enables efficient AI model updates by saving small changes
LoRA (Low-Rank Adaptation) offers a method for efficiently updating AI models by saving only small changes rather than entire copies. This technique allows for faster training and iteration, enabling developers to impro…
-
SHINE hypernetwork maps context to LoRA adapters in single pass
Researchers have developed SHINE, a novel hypernetwork designed to efficiently adapt large language models (LLMs) to new contexts. By leveraging the LLM's existing parameters and employing architectural innovations, SHI…
-
New research tackles continual learning in LLMs with novel MoE methods
Two new research papers propose novel approaches to continual learning in large language and vision-language models, aiming to mitigate catastrophic forgetting. CP-MoE introduces a transient expert to guide updates and …
-
SeqLoRA advances multi-concept image generation with bilevel optimization
Researchers have developed SeqLoRA, a novel framework for parameter-efficient fine-tuning of text-to-image diffusion models. This method addresses the challenge of composing multiple custom concepts by employing bilevel…
-
New SMoA Adapter Boosts LLM Fine-Tuning Efficiency
Researchers have introduced SMoA, a novel Spectrum Modulation Adapter designed to enhance parameter-efficient fine-tuning (PEFT) for large language models. Unlike traditional methods like Low-Rank Adaptation (LoRA) whic…
-
Developers fine-tune LLMs on 3GB GPUs using QLoRA
Developers can fine-tune large language models like TinyLlama on consumer hardware with as little as 3 GB of GPU memory using techniques such as QLoRA and NF4 quantization. This process involves training only a small fr…
-
New AR1-ZO method boosts LoRA fine-tuning with Zeroth-Order optimization
Researchers have developed AR1-ZO, a novel method for fine-tuning large language models using Zeroth-Order optimization and Low-Rank Adaptation (LoRA). This technique addresses the challenge of effectively increasing Lo…
-
Qwen 3.7 ships with tunable censorship, NVIDIA fine-tunes robot video generation
Qwen has released version 3.7 of its language model, which features a specific circuit for political censorship that can be modified without losing factual knowledge. NVIDIA's Cosmos Predict 2.5 model can now be fine-tu…
-
NamelessDogLab releases character LoRAs for AI web UIs
NamelessDogLab is releasing character LoRAs for web UI use to Patreon supporters. These LoRAs are designed to enable the creation of specific characters within AI-driven web interfaces. The project encourages support th…
-
New infrastructure enables one base AI model to serve millions of LoRA policies
Researchers have developed a new infrastructure that allows a single base AI model to efficiently serve millions of LoRA (Low-Rank Adaptation) policies. This approach avoids the need to copy weights for each policy, sig…
-
Fine-tuning Qwen2.5 with LoRA yields structured, not necessarily correct, outputs
This article explores the process of fine-tuning the Qwen2.5 model using the LoRA technique. It demonstrates that while fine-tuning can lead to more structured outputs, this does not necessarily equate to improved reaso…
-
LLM Fine-Tuning Explained: SFT, RAG, and Data Preparation
This blog post explains the process and necessity of fine-tuning large language models (LLMs) for specific tasks. It differentiates fine-tuning from Retrieval-Augmented Generation (RAG), stating that fine-tuning is best…
-
EverAnimate method improves long-form animated video generation
Researchers have developed EverAnimate, a novel post-training method designed to improve the generation of long-form animated videos. This technique addresses issues like visual quality degradation and inconsistent char…
-
PreFT method boosts LLM serving throughput with prefill-only finetuning
Researchers have developed PreFT, a novel parameter-efficient finetuning method designed to improve the efficiency of serving personalized large language models. PreFT optimizes for serving throughput by applying adapte…
-
PEML method optimizes LLM prompts and weights for multi-task learning
Researchers have introduced PEML, a new method for parameter-efficient multi-task learning in large language models. PEML optimizes both continuous prompts and model weights simultaneously, addressing limitations of exi…
-
New GPart method offers efficient LLM fine-tuning
Researchers have introduced GPart, a novel parameter-efficient fine-tuning method that bypasses the low-rank bottleneck inherent in LoRA. GPart utilizes a single isometric partition matrix to map a low-dimensional train…