Langfuse
PulseAugur coverage of Langfuse — every cluster mentioning Langfuse across labs, papers, and developer communities, ranked by signal.
- acquired by Helicone 90%
- acquired by ClickHouse 90%
- acquired ClickHouse 90%
- acquired Mintlify 90%
- acquired by Mintlify 90%
- competes with Helicone 70%
- competes with Braintrust Ai 70%
- competes with Future AGI 60%
- competes with Ragas 60%
- used by Ragas 55%
- used by Braintrust Ai 50%
- affiliated with Braintrust Ai 50%
15 day(s) with sentiment data
-
Langfuse introduces prompt regression gating for TypeScript projects
Langfuse has introduced a new GitHub Actions workflow designed to gate prompt regressions in TypeScript projects. This system allows developers to define accuracy thresholds for their language models, automatically fail…
-
LLM evaluation tools offer metrics, but critical challenges remain
A review of five popular LLM evaluation tools—Arize Phoenix, DeepEval, Future AGI, Langfuse, and Ragas—reveals that while they offer a wide array of pre-built metrics, these metrics represent only the easier 20% of the …
-
LLM observability tools consolidate as ClickHouse buys Langfuse, Mintlify acquires Helicone
The LLM observability market experienced a significant shake-up in early 2026, with major players undergoing acquisitions or strategic shifts. ClickHouse acquired Langfuse for $400 million, while Mintlify bought Helicon…
-
LLM observability platforms diverge on advanced features as market booms
The LLM observability and evaluation platform market is rapidly expanding, with projections reaching $9.26 billion by 2030. Platforms are diversifying into AI-native tools, open-source evaluation libraries, AI gateways,…
-
LLM observability tools capture traces but limit assertion granularity
Observability tools for LLM agents, such as Langfuse, LangSmith, and Phoenix, offer ways to capture production traces, but their default configurations for defining inputs and assertions can be limiting. The author argu…
-
OpenAI to retire Prompt Objects feature, prompting migration to alternative tools
OpenAI is discontinuing its Prompt Objects feature on November 30, 2026, which allowed users to store, edit, and reference prompts via an API. This shutdown will remove the ability to make quick edits and roll back to p…
-
Software updates: Langfuse, Firefly III, lightdash, Agenta, and Baïkal release new features
This cluster details several software updates across various projects. Langfuse has released version v3.225.0 with enhanced header validation and a new disable option. Firefly III has seen bug fixes, translation updates…
-
New tool converts agent failures into fine-tuning data
A new open-source tool called trace2train has been released to convert failed agent traces into supervised fine-tuning (SFT) or Direct Preference Optimization (DPO) training data. Developed as a local CLI tool, it aims …
-
LangChain Ecosystem Explained: Building Blocks vs. Operational Tools
The LLM development ecosystem is experiencing "Lang-fatigue" due to a proliferation of tools with similar naming conventions. This guide clarifies the distinctions between open-source building blocks like LangChain, Lan…
-
LLM prompt edits bypass testing, causing significant accuracy drops
A significant drop in LLM extraction accuracy, from 0.87 to 0.78, occurred after a minor one-word edit to the system prompt. This highlights a critical gap in current LLM application development, where prompt changes of…
-
Langfuse and LangChain4j to be showcased at dev2next conference
Sebastian Rabiej will present Langfuse at the dev2next conference, demonstrating how it aids teams in observing and understanding applications powered by large language models. The session will also cover building featu…
-
Author self-hosts Langfuse to cut costs amid rising LLM trace volume
The author decided to self-host Langfuse, an open-source LLM engineering platform, after their monthly trace count exceeded 100,000, making the cloud service's Pro tier a significant cost. This move was prompted by the …
-
OpenSmith releases major update for local LLM tracing
OpenSmith, a local-first alternative to LangSmith for tracing LLM pipelines, has released a significant update. The new version features a redesigned dashboard with real-time updates, enhanced search and filtering capab…
-
Developer shares 20-minute LLM agent model swap testing method
A developer has shared a 20-minute process for testing LLM agent model swaps to prevent subtle behavioral regressions. The method involves recording baseline agent behavior with specific scenarios using the `whatbroke-c…
-
AI explores 'graph engineering' while balancing structured outputs and accuracy
This week's AI discourse highlights the concept of 'graph engineering,' which involves connecting multiple agent loops into an orchestrated system. While Anthropic previously covered these ideas, the current focus empha…
-
LLM judges introduce systematic biases, skewing evaluations
Using Large Language Models (LLMs) as judges for evaluating other LLM outputs introduces systematic biases, such as position, verbosity, and self-preference, which cannot be averaged out like random noise. These biases …
-
TealTiger seeks open-source contributors for AI agent governance
TealTiger, an open-source project focused on AI agent governance, is actively seeking contributors. The project aims to provide deterministic policy enforcement for AI agents, ensuring safety and correctness without rel…
-
AI response quality measurement for startups discussed on Mastodon
A user on Mastodon shared their approach to measuring AI response quality for small startups. They detailed using Markdown files and a custom pipeline, contrasting it with larger tools like Langfuse. The user also solic…
-
Build an agentic event venue operator with MongoDB Atlas, Voyage AI, and LangGraph
This tutorial demonstrates how to build an agentic event venue operator using MongoDB Atlas, Voyage AI, and LangGraph. The system is designed to provide agents with persistent memory, operational context, and the abilit…
-
Langfuse offers open-source LLMOps for tracing and debugging LLMs
Langfuse is an open-source LLMOps platform designed to address the challenges of debugging non-deterministic LLM applications. It offers features for tracing, prompt management, and evaluation, allowing developers to tr…