logging – Page 5 – Türker Yıldırım

Import blocks, and the resources we had been pretending to manage

Deep diveSeptember 21, 202310 min read

Terraform 1.5 in June, and an import that is part of the plan rather than a side effect. Fourteen resources created by hand in 2019.

An outbox, and the publisher we removed from the transaction

Deep diveSeptember 20, 202310 min read

An order committed and an event never published, twice in one week. A broker call inside a database transaction, and a rollback after it.

Deleting thirty alerts, and the one that mattered

NoteSeptember 5, 20231 min read

Thirty-one rules, 412 firings in a month, four of which corresponded to something a user would have noticed. The rule that survived unchanged is the one written last…

The log line that contained a token

NoteAugust 23, 20231 min read

A debug log of an outbound request, including headers, including the authorisation header, retained for ninety days. A deny list is the wrong shape and is what everybody…

An event log that is not an event store

Deep diveAugust 10, 202310 min read

Wanting to know what happened to an order without adopting event sourcing. A support question that takes twenty minutes and three tables.

The N+1 that only appeared in production

Deep diveJuly 29, 202310 min read

An endpoint at 40 ms locally and 2.1 seconds in production. Nine hundred queries on one request, and three on the same request in a test.

Structured logs with a correlation id, end to end

NoteJuly 25, 20232 min read

A request that touches the web process, a queue job and an outbound API call produces three sets of logs with nothing connecting them. The propagation across the…

The state file two people wrote to at once

Deep diveJuly 14, 202310 min read

Two pipelines, one state file, and a plan that proposed deleting a database. A lock held by a run cancelled forty minutes earlier.

Two years of deprecations, and the upgrade we could no longer defer

Deep diveJune 6, 202314 min read

PHP 8.0 reaches end of life in November and the application is on it. 4,100 deprecation notices, and a log filter that had been hiding them.

Rebuilding the deploy as something a stranger could run

Deep diveMay 16, 202314 min read

A deploy that one person can run, and a holiday booked for August. A runbook of 22 steps, four of which say “check it looks right”.