testing – Page 28 – Türker Yıldırım

A data provider with string keys reads better on failure

NoteSeptember 15, 20202 min read

A provider returning a plain list produces failures reported as “with data set #3”, and you count rows to find out which one. The provider runs before setUp,…

Block patterns, and the page an editor can build

Deep diveAugust 19, 202010 min read

Eleven custom blocks that exist to produce one layout. 5.5 added patterns, which is the feature the blocks were being used for — and it needs no build…

Closure::bind, and the private property you had to reach

NoteAugust 12, 20202 min read

Asserting on a private property in a test usually means reflection, four lines of it, repeated — and there is a shorter route that is occasionally the right…

Auto-updates, and the site that changed underneath you

Deep diveAugust 6, 202010 min read

5.5 turns on plugin auto-updates per plugin, and a managed site is not a hobby site. A plugin updated at 03:00 and a checkout broken at 09:00.

Running mutation testing on the diff only

NoteAugust 6, 20201 min read

A full mutation run on a large codebase is hours, which means it runs nightly and nobody reads it. Running it on the changed lines takes minutes and…

Coverage of changed lines, not of the codebase

NoteJuly 28, 20201 min read

Total coverage moves so slowly that it says nothing about the change in front of you, and the question a reviewer has is whether the new code is…

Idempotency for an endpoint that takes money

Deep diveJuly 27, 202014 min read

The client timed out, retried, and the customer was charged twice. A timeout tells the client nothing about what the server did.

Compose in CI, and the service the tests need

Deep diveJuly 16, 202010 min read

The tests need MySQL and Redis, and CI gives you an empty machine. Service containers, where they differ from compose, and the readiness nothing does for you.

Validate a request against an OpenAPI schema

SnippetJuly 16, 20201 min read

Asserting on the job dispatched, and on the job itself

NoteJune 30, 20202 min read

Testing that a controller queued something by starting a worker is slow and flaky; testing it by reading the queue table couples the test to the driver. Splitting…