Tutorial

A step-by-step guide to learning ABS — Agent Behavior Specification — from scratch. If you can write a bullet list, you can write ABS. No code required.

The 20-minute path

1. What ABS is and its structure — the acronym, the YAML format, the three fields, the four actors
2. Write a real conversation — model a refund bot step by step: user says, bot asks, APIs are called, bot confirms
3. Step-level evaluations — add llm_judge for quality checks and contains for hard facts
4. Chain evaluations — sequence, never, variable_consistency: properties of the whole trace
5. Run it — browser, terminal, or VSCode: three ways to execute against your agent
6. Datasets and golden data — from one happy-path test to 100 parameterized runs with .jsonl
7. Common mistakes — pitfalls every QA hits the first time, and how to avoid them
8. Available tools — CLI, Designer, VSCode extension, mock agent, chatbot
9. Cheat sheet — all actions and evaluators on one page

Each page takes ~5 minutes. Start at the top and work through — by the end you'll have a complete automated test suite for your agent.