SKILL

evaluation-bigcode-evaluation-harness

Evaluates code generation models across HumanEval, MBPP, MultiPL-E, and 15+ benchmarks with pass@k metrics. Use when benchmarking code models, comparing coding abilities, testing multi-language support, or measuring code generation quality. Industry standard from BigCode Project used by HuggingFace leaderboards.

Target: Learning & research. Automatically collected · unverified.

Use with Codex

A guide for this combination is not available yet, and compatibility has not been verified.

Requirements

Only the author’s Skill metadata is included. Read the full instructions to check dependencies, licensing and conditions of use.

Choose an AI tool with documented instructions, or save the resource and request a guide after the page loads.

Read the author’s documentation ↗