Industries / real-estate-rag-evals

Listings and leases

Lantern House listings

  1. 01 Query
  2. 02 Retrieve
  3. 03 Guard
  4. 04 Answer
  5. 05 Metrics
  6. 06 Gate

baseline

PASS

What is the monthly rent at 500 Imaginary Boulevard?

Empty retrieved set.

not recorded

I don't know. That is not in the Harbor & Pine documents I can use.

Hit rate1.000
MRR1.000
Non-LLM context recall1.000
String presence1.000
Refusal correctness1.000
Grounded amounts1.000

Report averages

MetricThresholdbaseline
pass
bad-retriever
fail
no-guardrail
fail
Hit rate0.951.0000.000—
MRR0.901.0000.000—
Non-LLM context recall0.951.0000.000—
String presence0.951.0000.2450.857
Refusal correctness0.951.0000.2450.857
Grounded amounts1.001.0001.0001.000