Tutorials
Step-by-step, task-oriented walkthroughs. Start here if you’re new; for the complete command/config reference see the User Guide, and for the task-file schema see the Task Definition Guide.
| # | Tutorial | You’ll learn |
|---|---|---|
| 01 | Your first evaluation | Install, configure a key, and run + read your first eval |
| 02 | Running Coder Eval in CI | Wire the suite into GitHub Actions with a pass/fail gate |
| 03 | Browsing results with evalboard | Explore runs in a local web UI — pass rates, timelines, artifacts |
| 04 | Writing a task | Author a task YAML with success criteria from scratch |
| 05 | Comparing two models | Use the experiment layer to A/B two configurations |
| 06 | Running tasks in Docker isolation | Run each task in a fresh container; add task-specific dependencies |
Contributions welcome — add a numbered
NN-title.mdfile and link it in the table above. Keep tutorials short, copy-pasteable, and outcome-focused.