sk Skill · ContextJet-ai
check-answer-consistency
Use this to get a cheap, reference-free signal that an LLM answer might be made up, by sampling the same prompt a few times and measuring agreement. Trigger on "is this answer reliable", "flag low-confidence answers", "cheap hallucination check", "confidence score without a ground truth", "self-consistency check". Ships a runnable, tested scorer you can put inline or on sampled traffic.
Open on skills.sh ↗read 2026-09-15
- installs 8w
- 0
- 30-day movement
- starts with the next reading
- Related entries
- 1
- Connections
- 0
pythonPython
- Host repository
- ContextJet-ai/awesome-llm-observability
- Licence
- CC0-1.0
- Host stars
- 34
- Host language
- Python