logging – Page 7 – Türker Yıldırım

The webhook we sent, and the retries we owed

Deep diveDecember 7, 202210 min read

Being the sender, for the first time, and the obligations that come with it. A customer endpoint that was down for six hours.

A queue worker that scales on the metric that matters

Deep diveNovember 9, 202210 min read

Six workers, always, whether there is work or not. A backlog at 09:00 and idle capacity at 03:00.

Two burn rates: one pages, one raises a ticket

NoteOctober 28, 20222 min read

A single burn-rate alert either pages for a slow leak or misses a fast one, and two thresholds cover both without either being wrong. The multipliers come from…

A collector means the vendor is a configuration change

NoteSeptember 27, 20222 min read

Instrumenting an application against a vendor SDK makes the vendor a dependency in the code; instrumenting against a collector makes it a line in a configuration file. Tail…

The API version that was never going to be removed

Deep diveSeptember 21, 202215 min read

v1, v2 and v3 in production, and v1 has four clients. Every change is made three times.

OpenTelemetry when the PHP SDK is still beta

Deep diveSeptember 20, 202210 min read

The traces specification is 1.0 and the PHP implementation is not. Three tracing formats and a vendor decision nobody wants to make.

An audit log records reads, not only writes

NoteSeptember 2, 20222 min read

For anything with personal or financial data, who looked at it is a question that gets asked, and a write-only audit log cannot answer it. Recording a list…

An admin panel that was a security boundary

Deep diveAugust 2, 202210 min read

/admin on the same hostname, behind a login form. A support engineer with the same session cookie as a customer.

Log sampling, for the line that fires ten thousand times

NoteJuly 5, 20222 min read

A warning that fires on every request during an incident is the majority of the log volume and adds nothing after the first hundred. Recording the sample rate…

A GDPR deletion request across eleven tables

Deep diveJuly 4, 202214 min read

A request arrived and nobody could say where the data was. Personal data in eleven tables, three of them denormalised copies.