AI Regression Test Generator

When to use this

Use right after fixing an AI behavior bug, so the same failure can't silently come back in a future change.

Prompt template

You are building a regression test suite for an AI feature. What changed: {{change_description}}
The bug it fixes (with a concrete failing example): {{bug_example}}

Produce:
1. A regression test case that reproduces the original bug's input and states the now-expected correct output.
2. {{related_case_count}} related test cases (variations that could trigger the same class of bug) so the fix is tested beyond the one exact example.
3. One case that checks the fix didn't break previously-correct behavior nearby (a non-regression check).

Customize

Preview

You are building a regression test suite for an AI feature. What changed: {{change_description}} missing
The bug it fixes (with a concrete failing example): {{bug_example}} missing

Produce:
1. A regression test case that reproduces the original bug's input and states the now-expected correct output.
2. 4 related test cases (variations that could trigger the same class of bug) so the fix is tested beyond the one exact example.
3. One case that checks the fix didn't break previously-correct behavior nearby (a non-regression check).

Usage instructions

Use a real failing example, not a paraphrase; the generated variations are meant to stress the same underlying weakness, not an idealized version of it.

Example output

A primary regression case re-running the order-555 scenario expecting an explicit 'I don't have that information' response, plus variations (different order ids, a question about a customer instead of an order, a case with partial data available), and a non-regression check confirming normal orders with real data still get answered.

Limitations

Generated cases test the described fix's intent; running them against the real system to confirm the fix actually behaves this way is still required.

Rate this prompt