What the ClearRun score means
How to read the honesty score, and what ClearRun does not claim.
Last updated
Start here
What does the honesty score mean?
The honesty score is a number from 0 to 100. It describes confidence-justification alignment: how well the confidence an answer projects matches the reasoning and evidence it gives.
Is ClearRun a fact-checker?
No. ClearRun does not check whether an answer is true. It scores confidence-justification alignment and is not a hallucination detector.
What do I get back from a ClearRun score?
A hosted score returns a verdict (score, grade, risk, summary, verdict id and component signals), ClearRun's signature, and a receipt you can look up later.
How to tell if an AI answer is overconfident
An AI answer is overconfident when it sounds more sure than its reasoning supports. This site's guide walks through the warning signs and how to check the text.
All What the score means articles
What does the honesty score mean?
The honesty score is a number from 0 to 100. It describes confidence-justification alignment: how well the confidence an answer projects matches the reasoning and evidence it gives.
Is ClearRun a fact-checker?
No. ClearRun does not check whether an answer is true. It scores confidence-justification alignment and is not a hallucination detector.
Will ClearRun block my output?
No. ClearRun scores and flags the answer. It does not block or rewrite your output. You decide whether to pass it on, try again, or send it to a person.
What do I get back from a ClearRun score?
A hosted score returns a verdict (score, grade, risk, summary, verdict id and component signals), ClearRun's signature, and a receipt you can look up later.
Which languages does ClearRun support?
English only, today. ClearRun is built for English text. You can send another language, but do not rely on those scores. ClearRun does not translate text.
How to tell if an AI answer is overconfident
An AI answer is overconfident when it sounds more sure than its reasoning supports. This site's guide walks through the warning signs and how to check the text.
Is ClearRun a hallucination detector?
No. ClearRun does not detect hallucinations or check whether an answer is true. It scores whether an answer's confidence is backed by its own reasoning.
Does a high ClearRun score mean the answer is true?
No. A high score means the answer's confidence looks backed by its reasoning. It does not mean the answer is true. A well-argued answer can still be wrong.
What do the risk levels low, moderate, elevated and high mean?
risk is a coarse label that comes with every verdict. It is one of low, moderate, elevated or high. Lower risk goes with a higher honesty score. ClearRun help.
What is the confidence interval on a ClearRun score?
confidenceInterval is the uncertainty band around the score, given as { "min": ..., "max": ... }. It is null when the score is null. ClearRun help center.
Why does my ClearRun score say 'not determined' or null?
ClearRun could not give that text a score, so score is null. The CLI prints this as ClearRun Score: not determined. The rest of the verdict still comes back.
What is a ClearRun verdict id?
A verdict id is the id ClearRun gives each score, found at verdict.verdictId. Hosted ids are UUIDs, like 6e07586d-e028-43d6-bec3-0f4821b22ca0. ClearRun help.
What is a mock verdict, and why does it say 'not a real evaluation'?
A mock verdict comes from the SDK's mock mode. It has the same shape as a real verdict, but the score is a local test value. Read more in the ClearRun help center.
How is the ClearRun score calculated?
ClearRun does not publish its scoring method. Scores are made by the hosted service, and the open npm packages only call it. What is public and what to check.
What are scoringVersion and schemaVersion?
schemaVersion is the shape of a ClearRun verdict: 1.1.0 on new receipts, 1.0.0 on older ones. scoringVersion tags the scorer and goes to paid accounts only.