Published a new Blogpost regarding #thanos, #prometheus, remote write and reliability:

https://margau.net/posts/2025-10-26-thanos-prometheus-remote-write-reliability/

That Post especially documents how I've solved the question I asked a few weeks ago (how to detect broken remote writes): https://chaos.social/@margau/115390935606834356

As always, writing it was supported by some nice train rides, especially ICE1207 "Wetterstein" and ICE1204 "Karwendel" 🚄⛰️

Remote Write to Thanos: Are your Prometheus metrics being transmitted reliably? Are they lagging?

Push your Prometheus metrics to Thanos, and check if they’re actually arriving by monitoring the latest timestamp of a time series!

margau.net