Lab 1: Why Gut Feel Fails

You can't evaluate RAG by reading answers. Pick which answer is better — then see what the scores say.

🧪
The Challenge: Which Answer Is Better?
For each question, you see two answers — A and B. Pick the one that seems better. After all 3 picks, the truth is revealed. The confident answer is often the wrong one.
NovaCorp Policy Context (what the RAG system retrieved)
SECTION 2: WELLNESS DAYS
Every NovaCorp employee receives 7.5 Wellness Days per quarter (non-transferable, non-encashable).
Wellness Days cannot be combined with annual leave.
Wellness Days expire at the end of each quarter — they do not roll over.

SECTION 3: PATERNITY LEAVE
To apply, employees must submit Form W-77B to the Culture Team at hr-culture@novacorp.internal.
Form W-77B must be submitted at least 2 weeks before the expected date of birth.

SECTION 5: REMOTE WORK POLICY
Work-from-Mars Fridays are a special perk approved only for Level 6+ engineers — full remote with no check-ins required.
All employees at Level 3 and above may work remotely up to 3 days per week.
Level 1 and Level 2 employees may work remotely 1 day per week after completing 6 months of service.
Pair 1
Q: “How many wellness days per quarter?”
Click an answer to pick it
Pair 2
Q: “What form do I need for paternity leave?”
Click an answer to pick it
Pair 3
Q: “What is the remote work policy?”
Click an answer to pick it