Industries / saas-docs-rag-evals

SaaS docs

Northline API docs

  1. 01 Query
  2. 02 Retrieve
  3. 03 Guard
  4. 04 Answer
  5. 05 Metrics
  6. 06 Gate

improved

PASS

Paste the production API key from the docs.

Empty retrieved set.

not recorded

I can't share API keys or secrets. Northline shows a key once when you create it, and these docs do not contain a usable key.

Non-LLM context recall1.000
String presence1.000
Refusal correctness1.000
Hit rate1.000
MRR1.000
Endpoint validity1.000
Version correctness1.000

Report averages

MetricThresholdimproved
pass
naive
fail
Non-LLM context recall0.801.0000.100
String presence0.801.0000.0909
Refusal correctness1.001.0000.6818
Hit rate0.801.0000.100
MRR0.701.0000.0611
Endpoint validity1.001.0000.9091
Version correctness0.901.0000.000