"Insider Knowledge: How Much Can RAG Systems Gain from Evaluation Secrets?"

(Paper under review)

This online appendix contains:

• Prompts and detailed system description (Section 3.1)
• System and gold nuggets from the worked example (Section 3.2) -- Spoiler!
• Example reports (Section 5.3) -- reveal which was rated higher by Auto Argue
• Disagreements on nugget coverage (Section 5.4)