Blocking Crawls From Cloudflare's Browser Crawl Endpoint
Author: Ben Tasker
Blocking Crawls From Cloudflare's Browser Crawl Endpoint
Author: Ben Tasker
GET 和 POST 有何区别?我想也就 method 不一样罢了
在 RFC 7231 里定义了 HTTP 语义和内容。不幸的是,它没有明确说明带有正文的 GET 请求应该发生什么
🖥️ My ultra-budget server powering http://websysctl.alfonsosiciliano.net has been running smoothly for the past 2 months. So far, so good!
📈 #Crawlers hit tens of thousands of sysctl parameter pages daily. That's fine, since robots.txt allows it. But why keep requesting non-existent pages as if the site were built with WordPress 😤 ? Fortunately, the stack (#FreeBSD
+ #OpenResty 🌐 + #Lapis ✏️ + a custom-built #database 📦 ) stays well within the limited resources of my $5/month cloud server.
The code might soon be #OpenSource stay tuned!
#UNIX #sysctl #WebDev #WebServer #ThePowerToServe #coding #Lua #kernel
I've said this before, but I can't say it enough: OpenResty (nginx+lua) is painfully underappreciated. It's fantastic, and the only platform I trust for very high volume, high performance, mission critical web application servers.
I can’t exactly recall when this started happening but I want to say it was when I updated my container that runs #nginx / #openresty from #ubuntu 22 to 24.04.
Now I get these uptime kuma notifications at least every hour. There are no errors in OpenResty and no changes to my configuration. No changes in my DNS provider either. Checked #pihole and no obvious errors there (and no changes to the config). Anyone seen this before?