Index

QA Agent

Six months at Kona AI — autonomous test generation
Eng. 02 — Series B

Jan — Jun 2025 Kona AI · AI Engineer
LangGraph · Playwright MCP
TypeScript · Synthetic data
Surface
Explore
Trace
Scenarios
Generate
Verify
Result

01 — Surface

An application has more paths through it than anyone will test.

Every control, every state, every combination of the two. Coverage ends up bounded by how much time a QA team has, not by how much of the product matters.

02 — Explore

An agent drives the real browser.

Through the Playwright MCP server it clicks, types and navigates against a live page — observing what actually happened, rather than what a specification claimed would.

Runtime Playwright MCP

03 — Trace

Every run leaves a trace.

States reached, transitions taken, selectors that held steady across reloads. The application stops being a set of screens and becomes a graph.

04 — Scenarios

Synthetic data widens the search.

I generated synthetic users and inputs to simulate scenarios the real traffic never covered — pushing the agent down paths a human tester would not have thought to try, and filling in the graph where usage data was thin.

Purpose robustnessEffect coverage

05 — Generate

LangGraph turns the traces into TypeScript.

Plan, call, observe, revise — an agentic loop with memory, tool calling and feedback, emitting Playwright test cases in TypeScript that compile and run against the same application it just explored.

Orchestration LangGraphOutput TypeScript

06 — Verify

The tests are executed, not just written.

Whatever fails goes back into the loop as evidence. A generated test that cannot pass is not a test — it is a guess with syntax highlighting.

07 — Result

Half the time to a working suite.

Test case development time for the QA team fell by 50%, and coverage reached paths nobody had budgeted the hours to write by hand.

Dev time −50%

ENG. 02 KONA AI AI ENGINEER
SCOPE AGENTIC SYSTEMS SYNTHETIC DATA CODE SYNTHESIS
INPUT LIVE APPLICATION NO SPECIFICATION
OUTPUT PLAYWRIGHT SPECS TYPESCRIPT −50% DEV TIME
CYANOTYPE ONE PIGMENT 3 EXPOSURES
loading plate