Blog/Tag

Articles about Evaluation

7 articles tagged Evaluation, newest first. Each one is sourced and written for people who ship.

Retrieval & search
October 17, 2026·10 min read
Generating synthetic test data for RAG evaluations
Question generation from chunks, hard negatives, answerability labels, German and Hungarian coverage, contamination and human spot checks.
- RAG
- Evaluation
- Synthetic data
LLMOps & evals
October 5, 2026·7 min read
Opik review: open-source tracing and evals, with a US-hosted cloud
Opik: traces, LLM-as-a-judge metrics, prompt versions and an optimiser on one Apache 2.0 platform. Free to self-host, Pro cloud $19/month, US-hosted.
Retrieval & search
September 30, 2026·8 min read
Cross-encoder rerankers compared: Cohere, bge, Voyage, Jina and late interaction (2026)
Rerankers in October 2026: pointwise, listwise and late interaction, Cohere, Voyage, bge, Qwen3, Jina and mxbai, prices, self-hosting and choosing k.
- Reranking
- RAG
- Search
Retrieval & search
September 29, 2026·8 min read
Table extraction for RAG: extraction layers, serialization and queries that hold
Tables in RAG: why chunking breaks them, pdfplumber, Camelot, Docling and cloud extractors, what TEDS misses, serialization, and routing questions to SQL.
- RAG
- Tables
- Document parsing
Retrieval & search
September 28, 2026·8 min read
Fine-tuning embedding models for your domain: hard negatives, losses and evals
Fine-tuning embedding models for your domain: when it beats a reranker, hard negatives, sentence-transformers v6 losses, Matryoshka, evals and cost.
- Embeddings
- Fine-tuning
- RAG
LLMOps & evals
August 13, 2026·10 min read
Langfuse review: tracing, prompts and evals you can host yourself
Langfuse: LLM traces, prompt versions and experiments on one MIT-licensed platform. What self-hosting costs, how unit pricing adds up, and where it loses.
LLMOps & evals
July 3, 2026·10 min read
Arize Phoenix review: LLM tracing and evals you host yourself
Arize Phoenix: an ELv2-licensed tracing and eval server on your own database. Strengths, operating cost, and where Langfuse, Braintrust or LangSmith win.