Glossary · Phase 6 · Modern LLM engineering
Pass^k
The chance an agent succeeds on all k tries at the same task: a test of reliability, where pass@k tests whether it can succeed at all.
Learn it properly
Evaluating agents · Measure multi-step, tool-using behavior. About 35 minutes.
Other terms from the same lesson
- sandbox: A sealed-off test environment where an agent can take real actions without touching real systems or data.
- trajectory: The full record of what an agent did on a task: every message, tool call and result, in order.