SKILL

bmad-eval

通过用户所用的智能体执行框架运行 BMad 技能的评估,并报告评估结果:与裸模型对比的基线、与精简版或先前版本对比的变体、对照评分标准的质量,以及描述触发准确率(可选优化循环)。当用户要求评估、基准测试、测试触发条件、评分或比较技能版本时使用,或当 bmad-toolsmith 技能要求对其构建的技能进行评估时使用。

机器翻译
查看英文原文

Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a stripped or prior version, quality against a rubric, and trigger accuracy of the description with an optional optimization loop. Use when the user asks to evaluate, benchmark, test the triggers of, grade, or compare versions of a skill, or when the bmad-toolsmith skill asks for an eval of a skill it built.

适用对象:对象待分类。自动收录 · 待核查。

原作者说明节选

从固定版本的 SKILL.md 提取,保留原文语言。以下内容属于作者说明,本站尚未验证安装、兼容或运行结果。

查看英文原文

原文涵盖的主题

  • Skill Eval Runner
  • The four modes
  • Case format
  • On activation
  • Run execution
  • Artifacts
  • Outcomes

You run a skill's evals and report what they say. Cite specific findings, flag evals that pass for trivial reasons, and never widen a tolerance to make a run look like it succeeded. No model or harness is named in this skill: the harness a project's evals run through is recorded in this skill's customization at the first run. | Mode | Question it answers | Script / reference | |---|---|---| | baseline | Does the skill beat the bare model on the same input? | references/eval-format.md, scripts/runevals.py | | variant | Does a section earn its place, or does a stripped version do as well? | references/eval-format.md, scripts/runevals.py | | quality | Does the output meet the named rubric? | references/grader.md, references/eval-format.md | | trigger | Does the description fire on the right queries and stay quiet on the rest? | references/harness.md, scripts/runtriggers.py | Baseline runs every case with the skill staged and with nothing staged. Variant runs the skill against the one at --variant-path. Quality grades one config against its rubric. Trigger measures real firing; references/description-optimization.md improves the description across rounds. A case is input + rubric + opt

这里只展示节选,请以完整原文和当前要求为准。

来源仓库
alvin-reyes/better-agentic-ide
源文件
.claude/skills/bmad-eval/SKILL.md
固定版本
33a10c792564a4278aad183fd890a4e1567f28bc
阅读完整原作者说明 ↗

准备条件

  • 本条仅收录原作者的技能元数据;请阅读完整说明,确认依赖、许可与使用条件。

第一件可以尝试的小事

先阅读原作者说明,再决定是否在自己的 AI 工具中使用。

对应 AI 工具说明

作者有说明不等于本站实机验证。没有证据时,不自动标为兼容、安全或免费。

来源与内容状态

本条为自动发现的元数据,尚未完成人工文档核查;适用性与运行结果待核查。

原作者:alvin-reyes/better-agentic-ide · 原作者仓库元数据。文档核查:未核查。最近来源检查:2026-11-10T01:01:40.460Z。

分类由名称、说明与路径规则生成,分类不代表已核实适配。

许可与权利归属

MIT。第三方内容及版权归原作者,使用条件以原文为准。

许可原文 ↗

本站没有因同步、复制或用户自报成功而将资源标为运行验证通过。

限制与注意事项

  • 元数据收录不代表本站已经安装、适配、实测或进行安全审查。