snapshot test
Compare serialized output with a reviewed expected snapshot.
Use this when Stable structured output is easier to review as a whole than through many individual assertions.
without the term
“Can you add a test that captures this whole generated config so we notice if it changes? But don't just blindly update it whenever it fails.”
with the term · How do you ask a model for snapshot test?
Add a focused snapshot for this output. Stabilize volatile fields and demonstrate that an unintended output change fails the test.
What is snapshot test?
The test saves the serialized output once, someone reviews it, and later runs fail on any difference. Each difference has to be reviewed, not accepted automatically.
Why does snapshot test matter when vibe coding?
An agent can accept a changed snapshot without checking whether it represents a regression.
How do you do snapshot test?
Keep snapshots focused and deterministic; pair them with assertions for essential behavior.
What goes wrong with snapshot test?
Updating every baseline to make a failing suite green.