tefAug 6, 2024
seeing a "Senior Distributed Systems Engineer" job posting without any specifics about the day to day work and i know deep inside that this is a kafka based analytics pipeline, as ever
Show threadtef
i gotta say having to apply for a kafka job before you're told it's a kafka job is a pretty bad case of nominiative determinism
Aug 6, 2024 at 9:06pmMastodon for iOS
Show threadtefAug 6, 2024

time to pull out the classic post

Operations Skills: PRIMARILY KAFKA AND CASSANDRA BUT I CAN MAKE ANY SORT OF PREDICTION AND HAVE IT IGNORED BY ANY TYPE OF BUREAUCRACY

Show threadtefAug 6, 2024
also i went and checked with an inside source: it's a kafka job
Show threadgroxxAug 7, 2024
@tef
Show threadThe SecretbatcaveAug 7, 2024

@tef reminds me of when I was at the FT and saw this nugget from the New York Times: https://www.confluent.io/en-gb/blog/publishing-apache-kafka-new-york-times/

We all looked in horror, and were thankful that whilst our architects were doing CV driven design, they weren’t that imaginative.

Publishing with Apache Kafka at The New York Times | Confluent | UK

This post covers how Apache Kafka and its Streams API are used for storing and processing all the articles ever published by The New York Times

Confluent
Show threadTilde LowengrimmAug 9, 2024
@tef They don't even tell you it's a kafka job after you've started. You would not believe the forms they require just to learn what stack you're expected to use.