$ npx playwright test --project=gary-parker
- playwright-smart-reporter116,435 downloads/mo · 90 stars
- playwright-affected696 downloads/mo · 6 stars
- playwright-shard-balancer548 downloads/mo
- tracescrub524 downloads/mo
- playwright-release-notes-examples36 stars
5 passed118,203npm downloads/mo · 132 stars
Gary Parker
Quality engineering for teams shipping with AI: I build open-source Playwright tooling and write up experiments with measured results.
writing
view all →- Finding Flaky Playwright Tests That Fail Every RetryA test failed 4 of 11 runs and Playwright's report never called it flaky. Tracking results across runs marked it flaky at run 5 and quarantined it. 11 scripted runs, public repo.
- Playwright 1.65: A Filter That Matches Nothing Now Fails Every Shard1,464 runs on Playwright 1.64.1 and 1.65.1. A sharded run with zero matching tests went from all green to all red. Empty shards still pass. One flag still slips through.
- Playwright 1.65 onlyFailures: Smaller Reports That Say Zero Tests Passed160 runs of a 2,000-test suite on Playwright 1.65.1. onlyFailures cut the JSON report from 3.05 MB to 158 KB at 20 failed tests. It also cut the totals, and the durations other tools read.
- ARIA Snapshots: The Assertion Layer Your Locators Are MissingFour suites, three rounds of UI drift, five invisible accessibility regressions. The suite that survived best noticed least — and ARIA snapshots were the only assertions that caught everything.
- Self-Healing Tests: What the Vendors Aren't Telling YouI broke a test suite twice and let Playwright's healer agent fix it. It repaired everything, fast and correctly — and that's exactly the problem with the sales pitch.
experiments
- poc-playwright-test-agentsMeasured evaluation of Playwright Test Agents (planner/generator/healer) against a one-pass baseline suite.
- poc-ai-code-test-coverageAn agent's own tests reached 100% line coverage and a 90.67% mutation score.
- poc-self-healing-selectorsOver two drift releases the healer made 14 repairs on a CSS-selector suite, 2 on ARIA, 1 on test IDs.
- poc-aria-snapshot-assertionsTest-ID assertions caught 0 of 5 seeded accessibility regressions; ARIA snapshots caught 5 of 5.
newsletter
QA Ark Newsletter
Test automation, AI in testing and quality engineering practice. No spam, unsubscribe any time.