sk Skill · seed-forge
devlab-eval-driven-agent
eval 自评测体系驱动的 AI Agent 生产体系方法论。以评测集为核心资产,建立"评测集组织 + Mock 隔离 + 标准化比对 + 自动评测脚本 + 回归门禁"闭环;L0-L4 分层评测(确定性单测/轨迹评测/输出评测/生产回归/安全成本护栏),L1 golden session 轨迹断言,L2/L3 数据后端接 Langfuse(dataset/scores/LLM-as-judge),配套 evalctl CLI(0.3.x)。Triggers on "评测集", "eval", "回归测试", "准确率怎么保证", "测试数据集", "AI 质量护栏", "eval-driven", "LLM-as-judge", "langfuse 评测", "scores", "质量评分", "轨迹评测", "golden session", "agent 测试", "工具调用序列".
Open on skills.sh ↗read 2026-09-17
- installs 8w
- 0
- 30-day movement
- starts with the next reading
- Related entries
- 1
- Connections
- 0
yamlbashPython
- Host repository
- seed-forge/harness-ai-kit
- Host stars
- 24
- Host language
- Python