Langfuse
Langfuse is an open-source platform for monitoring, tracing and evaluating LLM-based applications. It captures prompts, outputs, costs and latencies so teams can debug and improve over time.
What data you can use with it
What you can put into Langfuse depends on your data's classification and how the tool is set up. Check Using data with AI before you use it.
Why we are exploring it
The AI Capability and Enablement team is evaluating Langfuse. It is not yet a recommendation either way.
Observability is one of the team's workstreams, and Langfuse is being assessed alongside other tools to understand which best supports running AI services in Defra.
Talk to the team before using it in delivery.
More information
For how Defra handles AI security and data, see Security and Keeping data safe.
Get help with Langfuse
The AI Capability and Enablement team is evaluating Langfuse. Talk to us before using it in delivery.