BigHugger
sk Skill · ContextJet-ai

check-answer-consistency

Use this to get a cheap, reference-free signal that an LLM answer might be made up, by sampling the same prompt a few times and measuring agreement. Trigger on "is this answer reliable", "flag low-confidence answers", "cheap hallucination check", "confidence score without a ground truth", "self-consistency check". Ships a runnable, tested scorer you can put inline or on sampled traffic.

installs 8w
0
30-day movement
starts with the next reading
Related entries
1
Connections
0
pythonPython
Host repository
ContextJet-ai/awesome-llm-observability
Licence
CC0-1.0
Host stars
34
Host language
Python