bmad-eval
Runs the evals of a BMad skill through the agent harness the user works in and reports what they show: baseline against the bare model, variant against a stripped or prior version, quality against a rubric, and trigger accuracy of the description with an optional optimization loop. Use when the user asks to evaluate, benchmark, test the triggers of, grade, or compare versions of a skill, or when the bmad-toolsmith skill asks for an eval of a skill it built.
Target: Target not categorized. Automatically collected · unverified.
Excerpt from the author’s documentation
Extracted from a fixed version of SKILL.md in its original language. This is the author’s documentation; installation, compatibility and runtime results have not been verified by this site.
Read the original English text
Topics in the source
- Skill Eval Runner
- The four modes
- Case format
- On activation
- Run execution
- Artifacts
- Outcomes
You run a skill's evals and report what they say. Cite specific findings, flag evals that pass for trivial reasons, and never widen a tolerance to make a run look like it succeeded. No model or harness is named in this skill: the harness a project's evals run through is recorded in this skill's customization at the first run. | Mode | Question it answers | Script / reference | |---|---|---| | baseline | Does the skill beat the bare model on the same input? | references/eval-format.md, scripts/runevals.py | | variant | Does a section earn its place, or does a stripped version do as well? | references/eval-format.md, scripts/runevals.py | | quality | Does the output meet the named rubric? | references/grader.md, references/eval-format.md | | trigger | Does the description fire on the right queries and stay quiet on the rest? | references/harness.md, scripts/runtriggers.py | Baseline runs every case with the skill staged and with nothing staged. Variant runs the skill against the one at --variant-path. Quality grades one config against its rubric. Trigger measures real firing; references/description-optimization.md improves the description across rounds. A case is input + rubric + opt
This is an excerpt. Refer to the complete source and its current requirements.
- Source repository
- alvin-reyes/better-agentic-ide
- Source file
- .claude/skills/bmad-eval/SKILL.md
- Fixed revision
- 33a10c792564a4278aad183fd890a4e1567f28bc
Sources and evidence
This record was collected automatically. Its documentation, suitability and runtime behavior have not been manually verified.
Author: alvin-reyes/better-agentic-ide · original repository metadata. Documentation review: Not reviewed. Last source check: 2026-11-10T01:01:40.460Z.
Categories are inferred from names, descriptions and paths. They do not establish compatibility.
License and attribution
MIT. Third-party content and copyright remain with their authors. Refer to the original license and terms.
Original license ↗Synchronization, copying and user-reported success do not mark a resource as runtime-tested.
Limitations and notes
- Collecting metadata does not mean this site has installed, adapted, runtime-tested or security-reviewed the resource.