How an AI Agent Automates QA for the Cerebras Cloud Console

This post introduces `console-prompt-tests`, an internal framework that uses an LLM agent to drive a real browser for QA of the Cerebras Cloud Console. Key technical contributions include: 1. A plain-English test description format (`.pt` files) that focuses on intent rather than markup selectors. 2. The use of Playwright MCP as a tool interface for the agent to interact with the browser. 3. Automated test generation from PDF test plans (`generate_tests_from_pdf.py`) and UI baselines (`generate_tests_from_baseline.py`). 4. A PR coverage agent that reasons semantically about changes against test descriptions. 5. A self-healing mechanism (`heal-batch` skill) that classifies failures and automatically proposes fixes for UI drift by reproducing flows live. 6. A release pipeline that scores PR risk, runs tests, and drafts release recommendations. 7. A skill-based, scalable architecture running on EKS with a strict AI proposal vs. deterministic execution model.