Menu

Playwright 1.65: A Filter That Matches Nothing Now Fails Every Shard
📰

Playwright 1.65: A Filter That Matches Nothing Now Fails Every Shard

DEV Community: cicd·Gary Parker·1 day ago
#7xKOm5HP
#devtocicd#devto#dev#tests#shards
Reading 0:00
15s threshold

Playwright 1.65 has one line in its notable changes that reads like a small tidy-up: a sharded run now fails with "No tests found" when no tests match across all shards. If your CI builds a --grep or a path filter per pull request and fans it out over a shard matrix, that line decides whether a pull request that touches no tests is green or red.

I ran the same suite on 1.64.1 and 1.65.1 to see exactly which cases changed. The harness and raw results are in the PoC repo .

The setup

32 spec files with one test each. The tests use no browser.

fullyParallel: true and workers: 1 , so Playwright can put each test on any shard.

@playwright/test 1.64.1 and 1.65.1, on Node 24 and macOS.

0, 1, 2, 4, 8 and 16 selected tests, picked by tag.

2, 4, 8 and 16 shards. Every shard is its own process, as it is in a CI matrix.

Each cell with and without --pass-with-no-tests , with Playwright's own split and with playwright-shard-balancer in the config.

That is 1,464 runs.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.