testing – Page 28 – Türker Yıldırım

Auto-updates, and the site that changed underneath you

Deep diveAugust 6, 202010 min read

5.5 turns on plugin auto-updates per plugin, and a managed site is not a hobby site. A plugin updated at 03:00 and a checkout broken at 09:00.

Running mutation testing on the diff only

NoteAugust 6, 20201 min read

A full mutation run on a large codebase is hours, which means it runs nightly and nobody reads it. Running it on the changed lines takes minutes and…

Coverage of changed lines, not of the codebase

NoteJuly 28, 20201 min read

Total coverage moves so slowly that it says nothing about the change in front of you, and the question a reviewer has is whether the new code is…

Idempotency for an endpoint that takes money

Deep diveJuly 27, 202014 min read

The client timed out, retried, and the customer was charged twice. A timeout tells the client nothing about what the server did.

Compose in CI, and the service the tests need

Deep diveJuly 16, 202010 min read

The tests need MySQL and Redis, and CI gives you an empty machine. Service containers, where they differ from compose, and the readiness nothing does for you.

Validate a request against an OpenAPI schema

SnippetJuly 16, 20201 min read

Asserting on the job dispatched, and on the job itself

NoteJune 30, 20202 min read

Testing that a controller queued something by starting a worker is slow and flaky; testing it by reading the queue table couples the test to the driver. Splitting…

Custom casts, and the value object that fits the ORM

Deep diveJune 26, 202010 min read

An accessor and a mutator per value object, in every model that has one. 7.0 adds a castable class, and the pair can retire.

Mutation testing, and the tests that assert nothing

Deep diveJune 18, 202010 min read

94% coverage, and a suite that passes with the logic inverted. Coverage measures execution rather than verification, and there is a tool that measures the difference.

assertContains split, and why a blind rename is wrong

NoteMay 27, 20201 min read

The old function accepted an array or a string and the two behaviours have been separated, so a search and replace is wrong in one direction or the…