eval-harness
Formal evaluation framework for Claude Code sessions implementing eval-driven development (EDD) principles
Target: Software development & testing. Automatically collected · unverified.
Excerpt from the author’s documentation
Extracted from a fixed version of SKILL.md in its original language. This is the author’s documentation; installation, compatibility and runtime results have not been verified by this site.
Read the original Chinese text
Topics in the source
- Eval Harness 技能
- 理念
- Eval 類型
- 能力 Evals
- 回歸 Evals
- 評分器類型
- 1. 基於程式碼的評分器
- 2. 基於模型的評分器
Claude Code 工作階段的正式評估框架，實作 eval 驅動開發（EDD）原則。 Eval 驅動開發將 evals 視為「AI 開發的單元測試」： 在實作前定義預期行為 開發期間持續執行 evals 每次變更追蹤回歸 使用 pass@k 指標進行可靠性測量 測試 Claude 是否能做到以前做不到的事： 確保變更不會破壞現有功能： 使用程式碼的確定性檢查： 使用 Claude 評估開放式輸出： 標記為手動審查： 「k 次嘗試中至少一次成功」 pass@1：第一次嘗試成功率 pass@3：3 次嘗試內成功 典型目標：pass@3 > 90% 「所有 k 次試驗都成功」 更高的可靠性標準 pass^3：連續 3 次成功 用於關鍵路徑 撰寫程式碼以通過定義的 evals。 在 .claude/evals/feature-name.md 建立 eval 定義檔案 執行當前 evals 並報告狀態 產生完整 eval 報告 在專案中儲存 evals： 1. 編碼前定義 evals - 強制清楚思考成功標準 2. 頻繁執行 evals - 及早捕捉回歸 3. 隨時間追蹤 pass@k - 監控可靠性趨勢 4. 可能時使用程式碼評分器 - 確定性 > 機率性 5. 安全性需人工審查 - 永遠不要完全自動化安全檢查 6. 保持 evals 快速 - 慢 evals 不會被執行 7. 與程式碼一起版本化 evals - Evals 是一等工件
- Source repository
- affaan-m/ECC
- Source file
- docs/zh-TW/skills/eval-harness/SKILL.md
- Fixed revision
- d2ef2680594f9a17526a6e1a2e18b3d242c5d17b
Requirements
- Only the author’s Skill metadata is included. Read the full instructions to check dependencies, licensing and conditions of use.
A small first task
先阅读原作者说明，再决定是否在自己的 AI 工具中使用。
Instructions for your AI tool
- Claude Desktop: resource-specific guide not available yet
- Claude Code: resource-specific guide not available yet
- Cursor: resource-specific guide not available yet
- Codex: resource-specific guide not available yet
Author documentation is not live verification by this site. Without evidence, we do not mark a resource as compatible, safe or free.
Sources and evidence
This record was collected automatically. Its documentation, suitability and runtime behavior have not been manually verified.
Author: affaan-m/ECC · original repository metadata. Documentation review: Not reviewed. Last source check: 2026-11-09T15:01:42.735Z.
Categories are inferred from names, descriptions and paths. They do not establish compatibility.
License and attribution
MIT. Third-party content and copyright remain with their authors. Refer to the original license and terms.
Original license ↗Synchronization, copying and user-reported success do not mark a resource as runtime-tested.
Limitations and notes
- Collecting metadata does not mean this site has installed, adapted, runtime-tested or security-reviewed the resource.