LLaMA-Factory
PulseAugur coverage of LLaMA-Factory — every cluster mentioning LLaMA-Factory across labs, papers, and developer communities, ranked by signal.
1 day(s) with sentiment data
-
SparkLLM releases open-source on-device models with 1M token context
SparkLLM has released two open-source, on-device language models, Spark X2.5-4B and Spark X2.5-1.7B, both featuring a native 1 million token context window. This extended context capability allows the models to process …
-
New tool converts agent failures into fine-tuning data
A new open-source tool called trace2train has been released to convert failed agent traces into supervised fine-tuning (SFT) or Direct Preference Optimization (DPO) training data. Developed as a local CLI tool, it aims …
-
Fine-tuning VRAM bottleneck identified: Loss tensor consumes majority of memory
A technical analysis reveals that a significant portion of VRAM during LoRA fine-tuning is consumed by a temporary cross-entropy loss tensor, rather than the model itself. This tensor, which exists only briefly to produ…
-
LLM Fine-Tuning Frameworks: Unsloth, Axolotl, TRL, and LLaMA-Factory Compared
A comparison of four popular LLM fine-tuning frameworks—Unsloth, Axolotl, TRL, and LLaMA-Factory—highlights their differing approaches to optimizing speed, VRAM usage, and multi-GPU scaling. Unsloth focuses on kernel-le…
-
BISHENG platform offers unified LLM DevOps for enterprises
BISHENG is an open-source enterprise LLM application DevOps platform designed to streamline the integration of large language models into business processes. Developed by DataElem, the platform offers a unified solution…
-
AI fine-tuning data quality requires a 'judge' model, not just generation
Generating high-quality synthetic data for fine-tuning language models is challenging, as many automated methods produce samples that are irrelevant, factually inconsistent, poorly formatted, or unhelpful. A common pitf…
-
Anyscale launches skill to automate LLM post-training runs
Anyscale has introduced a new Anyscale Agent Skill designed to simplify and automate the process of generating LLM post-training runs. This skill assists users in selecting the most appropriate post-training method, suc…