@mirq @lizzy qutebrowser

@mirq @lizzy Anubis in the default config checks whether the user agent contains Mozilla/5.0 and if not lets it go through without any checks. That's literally all it takes and it is by design so it doesn't break tools like curl.

I've already seen scrapers abusing this.

@mirq @lizzy
Only if certain browsers had a very nice feature that bypassed Anubis in most configs...
#ANUBIS
fuck_this_shit = [
'*://kernel.org/*',
'*://*.kernel.org/*',
'*://codeberg.org/*',
'*://archlinux.org/*',
'*://*.archlinux.org/*',
'*://*.gnome.org/*',
'*://openwrt.org/*',
'*://*.gentoo.org/*',
'*://*.freedesktop.org/*'
'*://rpmfusion.org/*',
'*://*.pussthecat.org/*',
'*://*.debian.org/*',
'*://*.ffmpeg.org/*',
'*://*.fedoraproject.org/*',
'*://*.luanti.org/*',
]

for url in fuck_this_shit:
with config.pattern(url) as p:
p.content.headers.user_agent = "<not telling because someone from gnome will block it.>"

@lizzy I'm sorry to tell you, it has already happened. At least since June of last year. That author is a stable release maintainer and already committed patches written by claude months ago.

One such example: https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=78d979db6cef557c171d6059cbce06c3db89c7ee

@yonle @cell

Here are the corrected links (forgot that commits and files changed are broken after migration to forgejo):
https://old.git.pleroma.social/pleroma/pleroma/-/merge_requests/4364 (uri encoding part 2)
https://old.git.pleroma.social/pleroma/pleroma/-/merge_requests/4417 (emoji reacts/invalid emoji encoding)

Here's the Akkoma emoji encoding issue: https://akkoma.dev/AkkomaGang/akkoma/issues/1042
It got merged before a fix landed in Pleroma and I then forgot about it. I might chime in later that it is incorrect.