Every article tagged Evaluation, in one place.
Showing 2 articles
Without evaluation, every change to chunking, embeddings or prompts is a guess. A small labelled dataset turns RAG tuning into engineering. 1. Build an evaluation set Collect 50-200 real questions from logs, support tickets or users. For each, record the ID(s)...
Agents are non-deterministic, so traditional "input X gives exactly output Y" tests only go so far. A solid testing strategy combines normal tests for your code with task-level evaluations of the agent's behaviour. 1. Unit-test the tools Tools are ordinary fun...
