Changelog
Acceptance criteria, one by one
- Improved
When a pull request lists acceptance criteria or a test plan, ZeusQA now marks each one met, not met or not checked, on the run page and in the pull request comment.
A pull request that lists what should be true after it merges now gets an answer for each item, not just one verdict for the whole change.
- Read from the description. List items under a heading such as Acceptance criteria, Test plan or How to test count as criteria. Without such a heading, a task list (
- [ ]) at the top or under Summary or Changes does. A template's own checklist, under a heading such as Checklist or Before merging, never does. Up to 10 criteria, 200 characters each. - Answered by number. The criteria are numbered in the test, and the agent marks each one met, not met or not checked, with a one-line note. A criterion it did not get to stays not checked rather than counting as met.
- A criterion not met fails the run. A run that otherwise passed is marked failed when any criterion is not met, so the check fails and blocks the merge when merge blocking is on.
- On the run page and the pull request. The run page shows the list with a count such as "2 of 3 criteria met". The pull request comment carries the same table under the verdict, and the check summary carries the count.
- Same rules as the description. The criteria are the author's words, quoted as data. Pull requests from forks and bots add none.
Turn on a repository in Connections, GitHub, and write your next pull request's test plan under a Test plan heading.
Part of the ZeusQA changelog. Follow new releases with the RSS feed.
Try it on your own site
Paste a URL, describe the flow in plain English, and watch a real browser do it. Three runs free, no card.