Reference build
RAG evaluation workbench
A reference environment for comparing retrieval strategies, prompts, evidence coverage, latency, and answer quality.
TypeScriptPostgreSQLOpenTelemetry
The problem
Useful experiments need a falsifiable question. This project begins by defining the behavior it is trying to understand, the constraints it holds constant, and the evidence that would change the approach.
The design
The implementation separates domain decisions from provider-specific infrastructure. Instrumentation is part of the first working path so latency, quality, cost, and failure are visible rather than reconstructed later.
InputExperimentEvaluationDecision
What I learned
The valuable output is not only the code. It is the narrower understanding of when the approach works, where it breaks, and which complexity is justified in a production system.
Related architecture notes