Changelog

Headless Initialization of Self-Hosted Deployments

Automatically initialize Langfuse resources on startup using environment variables, streamlining self-hosted deployments and infrastructure-as-code integrations.

Enhanced Zero-Latency Prompt Management

Langfuse prompt management now guarantees instant access to prompts after first use while refreshing the cached version in the background.

Support for Multi-Modal Traces in Langfuse UI

Add multiple modalities to a single trace, including text and images.

Comments on Langfuse objects

Add comments to traces, observations, sessions and prompts via the Langfuse UI.

Advanced Score Analytics Charts

Explore customizable charts for aggregate and time series analytics, grouped by score type, source and name.

UI Customization

You can now replace the documentation, support and feedback links in the UI with references to your internal resources. This helps roll out Langfuse in your organization and ensures that users can find the information they need.

Deployment via Porter

Porter now allows you to deploy a production-grade Langfuse cluster via their Add-On marketplace. If you use Porter, this is the easiest way to get started with self-hosted Langfuse.

Organizations

Introducing organizations to manage projects and permissions across larger teams working in Langfuse.

Tracing of OpenAI Structured Outputs

Langfuse now supports tracing OpenAI Structured Outputs.

Vercel AI SDK Integration

The AI SDK now supports OpenTelemetry-based instrumentation. With the new LangfuseExporter, you can easily collect these traces in Langfuse.

Resizable Columns Across All Tables

Tables are at the core of Langfuse and we finally made them resizable.

Token/cost tracking for GPT-4o mini

Day 1 support for OpenAI GPT-4o mini including tracking token counts and USD spend.

Render Markdown in Langfuse UI

Display trace or observation inputs and outputs in Markdown format. Enhance the readability of Markdown elements such as headers, lists, blocks of code, tables, and links.

Create Non-Numeric Scores via SDKs

The Langfuse API, Python and JS SDKs now support creating categorical, boolean and numeric scores.

Query Traces via SDKs

The Langfuse Python and JS SDKs now support fetching traces and observations from the Langfuse API. Use them for custom analysis, few-shotting or fine-tuning workflows.

Models API

The Langfuse API now supports direct access to model definitions used for tokenization and model price calculation across the Langfuse platform. You can use the API to synchronize model prices from your model registry or add custom models programmatically.

Datasets API v2

Introduction of the new Datasets API v2 with improved performance for large datasets. Also, now all datasets-related objects are directly accessible via the API.

Dify Integration

Build complex LLM applications with Dify's workflow builder and natively trace and monitor them in Langfuse using the new integration.

Trace Timeline View

Visualize agent flow using our trace timeline chart. This new view helps to identify latency bottlenecks, visualize parallelism, and understand multi-step reasoning in deeply nested chains.

Update Indicator

For self-hosted instances, we have added a little update indicator that helps to keep track of the latest changes to Langfuse. On Langfuse Cloud, you always run on the latest version.

New Docs and Cookbook: Monitoring LLM Security

LLM security requires effective run-time checks and ex-post monitoring and evaluation. We have added new documentation and a cookbook on how to effectively leverage popular LLM security tools while evaluating them in Langfuse.

Annotation Drawer

Annotate traces and LLM responses via the new annotation drawer. You can define a standardized set of scores and criteria for your project.

New Cookbook: Tracing OpenAI Assistants API

The OpenAI Assistants API is a powerful tool for building conversational AI applications while relying on OpenAI to manage state, RAG, code execution and more. The new cookbook provides a step-by-step guide to trace applications built with the API.

Dark Mode

Introducing dark mode for the Langfuse UI.

Haystack Integration

Easily monitor and trace your Haystack pipelines with this new Langfuse integration.

Mirascope integration

Mirascope is a Python toolkit for building LLM applications and it natively integrates with Langfuse.

Prompt Version Insights

Compare metrics across different prompt versions in Langfuse Prompt Management.

Sticky headings on tables

Sticky headings to better keep track of your data.

Playground and evaluations with GPT-4o

Experiment with OpenAI GPT-4o in the playground and use it to power evaluations

Token/cost tracking for GPT-4o models

Day 1 support for OpenAI GPT-4o including tracking token counts and USD spend.

Prompt management REST API and deployment labels

Manage prompts via the REST API and add labels to deploy prompts to different environments.

SOC 2 Type II certification

Langfuse's Information Security program has been certified to the SOC 2 Type II standard.

Launch Week 1 🚀

Model-based evaluations

Run model-based evaluations on traces in Langfuse to scale your evaluation workflows. Start with one of our battletested templates or use your own custom templates.

Launch Week 1 🚀

Datasets v2

New editor, metadata on all objects, tables that render i/o, dataset runs on traces, push traces to datasets, and more.

Launch Week 1 🚀

Decorator-based integration for Python

The decorator now supports all Langfuse features and is the recommended way to use Langfuse in Python.

Launch Week 1 🚀

LLM playground

Test and iterate on your prompts with the new LLM playground directly in Langfuse.

Launch Week 1 🚀

PostHog integration

We teamed up with PostHog to integrate LLM-related product metrics into your existing PostHog dashboards.

Launch Week 1 🚀

OpenAI SDK integration for JS/TS SDK

Langfuse now provides a simple to adopt wrapper for the OpenAI JS/TS SDK for you to seemlessly trace your OpenAI calls.

Docker images on Docker Hub

From now on, we will publish Docker images on Docker Hub and the GitHub Container Registry.

ISO 27001 certification

Langfuse's Information Security program has been certified to the ISO 27001:2022 standard.

OpenAI Integration tracks used Langfuse Prompts

The OpenAI SDK integration for Langfuse Tracing now supports capturing the used prompt (version) from Prompt Management.

ChatML in Prompt Management

Introducing the "chat" prompt type in Langfuse Prompt Management to version control and release ChatML (role/message) prompts.

Support for LangChain async, batch and streaming interfaces

With this release, Langfuse Tracing integrates natively with all LangChain interfaces on Python and JS.

Decorator-based tracing for Python

Use @observe() decorator to trace Python functions, fully compatible with the native integrations with LangChain, LlamaIndex, and the OpenAI SDK.

Improved ChatML message rendering

Extending the "Pretty ✨" mode to additional json content included in ChatML messages such as functions and tools. Previously, Langfuse rendered these messages in plain json.

Token/cost tracking for Claude 3 models

Langfuse automatically tracks token counts and USD spend for Anthropic Claude 3 models

Uptrain.ai integration (cookbook)

Langfuse adds >20 open source evaluators through cookbook integration with open source project and fellow Y Combinator startup UpTrain.ai

Upto 50x faster loading time of UI tables

Previously, the tables loaded very slowly depending on the project size and the kind of ingested data. I used the leap day to tweak queries and indexes to fix this.

LlamaIndex integration (Python)

Automatically capture detailed traces and metrics for every request of your LlamaIndex application with the new Langfuse Integration.

Store additional structured data in Langfuse Prompt Management

Version control model names, model parameters, and additional json data in Langfuse Prompt Management.