Simple and creative approach to distributed logging from Google Fiber https://apenwarr.ca/log/20190216

Author does slightly fall into the trap of "this was easy at Google with our incredible suite of internal tools, so it'll be easy for you" trap, though.

The log/event processing pipeline you can't have

Let me tell you about the still-not-defunct real-time log processing pipeline we built at my now-defunct last job. It handled logs from a la...

@russss I'd never before thought about sending userspace logs through /dev/kmsg but I do like the idea

When I first read it I was "but that's userspace, why would you send them into the *kernel*?" but then I reflected that calling write(2) or sendmsg(2) is going into the kernel anyway so ...