Finally got around to setting up the #nephentes AI crawler maze. Two birds with one stone: we had two extremely irritating crawlers persistently FOR YEARS hitting non-existing URLs via http, i.e., they first got a redirect to https and then the 404.
Now they will enter The mAIze(tm) on https (didn't figure out how to short-circuit the http-upgrade yet). Neat side-effect: I now know more about #nginx request handling and rewriting than I ever wanted to know 🥴