F11 Context ignored (the answer was there, the model missed it)
RAG: the answer was in the retrieved passages, but the model contradicted it, left it out, or said it was not there.
How counterfix finds it
Judge: finds the passage that holds the answer, then checks whether the model answer agrees with it (answer_ignores_context). The passage number is passed to the fix search, which moves that passage first.
Fixes it tries
In this order (a model profile can reorder them). Each one is kept only if it passes 2 of 3 re-runs.
| Intervention | Change |
|---|---|
key_passage_first |
Put the passage that holds the answer first (rerank) |
fewer_passages |
Send fewer passages (the top 3, the one with the answer first) |
quote_then_answer |
Ask the model to quote the passage that answers the question, then answer from it |
When no fix verifies
- Use a larger model
- Shorten or clean the passages