Skip to content

Test AutomationDocumented behaviour

Playwright AI Reporter pipeline

What happens when a Playwright test fails with the AI Reporter enabled, from capturing the failure to an AI fix suggestion, a bug, a draft pull request, stored history and notifications.

  • Playwright
  • TypeScript
  • Azure OpenAI
  • GitHub
  • Jira

7 stepsPress play, or use next and previous to follow the flow one step at a time.

All steps

What this shows

Playwright AI Reporter is an open-source reporter that turns test failures into follow-up work. Each step after the first is optional and switched on through configuration, so a team can start with a report and add automation as it builds trust.

Design notes

  • Providers are pluggable. AI, bug trackers, databases, notifications and pull-request hosts each sit behind an interface, so no vendor is built in.
  • Fixes arrive as drafts. An AI-suggested fix is proposed as a draft pull request on its own branch for a person to review. It is never pushed to the main branch.
  • Failures degrade gracefully. If an optional provider is unavailable, the reporter carries on instead of failing the test run.

This diagram describes the documented behaviour of the published package.

More workflows

Test Automation

NL2Test, from a sentence to a Playwright test

How NL2Test turns a plain-language description into an executable Playwright test, with a model planning the test and an MCP server driving a real page.

10 steps 9 parts Simplified view

AI and Agents

How an MCP request flows

A walk through one Model Context Protocol request, from the client through authentication, memory and the model to a server that coordinates tools.

8 steps 8 parts Simplified view

AI and Agents

Multi-agent supervisor

A supervisor agent receives a request, hands sub-tasks to specialist agents one at a time, keeps shared memory, and combines their results into one answer.

8 steps 7 parts Simplified view