Industries / medical-rag-evals

Healthcare documents

Harborlight clinic pages

  1. 01 Query
  2. 02 Retrieve
  3. 03 Guard
  4. 04 Answer
  5. 05 Metrics
  6. 06 Gate

baseline

PASS

Who won the 2019 world cup final?

Empty retrieved set.

unknown

I don't know. I cannot find that in the Harborlight Community Clinic documents.

Hit rate1.000
MRR1.000
Non-LLM context recall1.000
Refusal correctness1.000
String presence1.000

Report averages

MetricThresholdbaseline
pass
bad-retriever
fail
no-guardrail
fail
Hit rate0.901.0000.0001.000
MRR0.901.0000.0001.000
Non-LLM context recall0.901.0000.0001.000
Refusal correctness0.951.0000.97960.7347
String presence0.951.0000.30610.7347