LLMOps & evals
·7 min read
Opik review: open-source tracing and evals, with a US-hosted cloud
Opik: traces, LLM-as-a-judge metrics, prompt versions and an optimiser on one Apache 2.0 platform. Free to self-host, Pro cloud $19/month, US-hosted.
Blog/Tag
Articles about LLM observability
5 articles tagged LLM observability, newest first. Each one is sourced and written for people who ship.
LLMOps & evals
·10 min read
Langfuse review: tracing, prompts and evals you can host yourself
Langfuse: LLM traces, prompt versions and experiments on one MIT-licensed platform. What self-hosting costs, how unit pricing adds up, and where it loses.
LLMOps & evals
·12 min read
Observability for LLM agents with OpenTelemetry: traces, tokens, PII and evals
How to trace LLM agents with OpenTelemetry: GenAI semantic conventions and their status, span tree, token metrics, sampling, PII, evals and tool options.
LLMOps & evals
·10 min read
Arize Phoenix review: LLM tracing and evals you host yourself
Arize Phoenix: an ELv2-licensed tracing and eval server on your own database. Strengths, operating cost, and where Langfuse, Braintrust or LangSmith win.
LLMOps & evals
·10 min read
Helicone: observability that sits in the request path
Helicone: an Apache-2.0 LLM gateway and observability platform. What its proxy architecture buys, what it costs you, and how self-hosting really looks.
- LLM observability
- OpenTelemetry
- Cost tracking