QA agent
A QA agent is an LLM-driven tester that explores an application by reading its interface, deciding what to try next, and reporting what appears broken — covering exploratory testing that fixed scripts cannot.
It complements rather than replaces a scripted suite. Scripted tests are fast, cheap and deterministic and belong on critical paths; agents cover the surrounding space where the unimagined bugs live. Their precision must be measured during a shadow-run period before they are allowed to gate a release.
Related terms
- Flake rate
Flake rate is the proportion of test runs that fail intermittently without any change to the code under test, and it is the primary measure of whether a test suite can be trusted.
- Self-healing tests
Self-healing tests use resilient element location strategies — and often a model to resolve ambiguity — so that an automated test continues to work when the underlying markup changes but the user-facing behaviour does not.
- Eval harness
An eval harness is the test infrastructure for a non-deterministic AI system: a dataset of representative inputs, a method for scoring each output, and a threshold that determines whether a run passes or fails.
Tell us what you are building
Send us the problem in a paragraph. You will get a straight answer on whether we can help, and what we would do first.
Book a call