Qdrant can rank a shutdown chunk first and still miss the passage about cancellation. Check whether retrieval found the required evidence before passing results to a model.

We'll evaluate actual Qdrant results using labeled questions and a custom IEvaluator . The evaluator calculates the metrics in C# without calling a judge model. The reporting library saves the results, and the aieval console tool produces the HTML report.

The querying article built the read path. Payload modeling and metadata filters restricted results to published runbooks, while context assembly selected the text for generation. Here, we evaluate the ranked results before assembly.

A complete, standalone version of this example is available in the sample repository .

The excerpts below explain the evaluation implementation. To run the complete experiment, use sample 07.…