A RAG study tests viewpoint coverage under a fixed evidence budget

A preprint scores the extra viewpoint a passage adds to selected evidence. Coverage gains do not establish answer accuracy.

Sonar removes repeated evidence cards to make room for a distinct viewpoint inside a small frame.

A new RAG preprint asks whether a retrieval system can cover more viewpoints without increasing its evidence budget. Its focus is the next passage selected: does that passage add a perspective the current context lacks, or repeat material already present?

Yiyang Duan and colleagues submitted Learning Marginal Viewpoint Utility for Budgeted Evidence Selection in RAG on October 21. The study evaluates evidence selection. It does not establish that the method produces better final answers or improves a publisher’s search visibility.

Repeated relevance can consume the whole budget

Imagine a fictional question about a proposed transit change. The first three retrieved passages all explain the operator’s cost savings. A fourth discusses accessibility. If the context can hold only three passages, selecting solely for similar relevance can leave the accessibility perspective outside the answer’s evidence.

That example illustrates a selection problem, not a finding from the paper. A coverage audit would preserve the full candidate set, the selected passages, and the perspective each selection adds. A diverse set can still contain inaccurate claims, so viewpoint coverage needs a separate factual review.

Score what a passage adds to the current set

The authors’ Learned Marginal Viewpoint Utility method scores a candidate against the already selected context. Training uses viewpoint annotations; inference does not require access to those annotations. This distinction matters when judging whether the selection procedure can operate on an unlabelled collection.

The experiments use WVS, Perspectrum, ArgKP and ESS10, with token budgets of 512, 1,024 and 2,048. The main comparison uses 1,024 tokens. Query counts vary substantially across the four benchmarks: 6, 97, 6, and 34, respectively. The experiments use one fixed embedding encoder.

Two coverage objectives in the study
ObjectiveWhat receives creditWhat it cannot establish
Breadth, RVC1A viewpoint supported by at least one selected evidence unitThat the viewpoint is true or adequately explained.
Repeated support, RVC2Partial credit for one unit and full credit for at least twoThat two units are independent or factually correct.

Read the result at the evidence-selection layer

The full-pool extension is exploratory because it followed inspection of earlier held-out results. Downstream answer generation remains future work. Those boundaries limit what we can conclude about deployment beyond the reported evidence-selection tasks.

For a proposed local audit, compare a relevance-only selection with one that records each passage’s additional viewpoint. Hold the candidate pool and token budget fixed. Then review factual support and the final answer separately, rather than treating a coverage score as a truth score. SearchEngineAnswer has not replicated the study.

The qualifier-sensitive answer study assesses whether a candidate satisfies the question, while the citation failure map separates retrieval, attribution, and validation. Viewpoint selection adds another inspection point before generation; it cannot replace those later checks.

Keep learning

Continue this topic

Community discussion

Discuss: A RAG study tests viewpoint coverage under a fixed evidence budget

Have a question, a useful example, or a different perspective? Join the discussion, share evidence, and help other readers reach a better answer.

0 replies Moderated
No replies yet.

Be the first to ask a focused question, share a practical example, or add useful evidence.

Ask a question or join the discussion

Share evidence, a useful example, or a clear question. Be specific, stay on topic, and challenge ideas without attacking people. First-time replies may be held for moderation.