I'm using #mtail to parse my logs and export that as a local #prometheus exporter server.

I got into a panic, because suddenly loads of production machines were showing 0 accesses, even though I could see they were in use.

Looks like mtail was outputting “total number of requests” in scientific notation, causing prometheus to essentially see nothing... 🤦🏻‍♀️🤦🏻‍♀️🤦🏻‍♀️

`accesses_total{prog="parse.mtail"} 2.991904e+06`

the solution was to restart mtail, causing the numbers to not need the `e+6` and hence each second has a different number.

#TurnItOffAndOnAgain