David Buchanan
I hope google severely punishes twitter's search rankings, for authwalling
Jun 30, 2023 at 3:18pmWeb
Show threadDavid BuchananJun 30, 2023
fun fact, you can bypass it by setting the "googlebot" useragent

Edit: this no longer works
Show threadDavid BuchananJun 30, 2023
This one, specifically:

Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/113.0.5672.127 Safari/537.36
Show threadNicolás AlvarezJun 30, 2023
@retr0id I just read that WhatsApp/2.0 works too
Show threadWolf480plJun 30, 2023
@retr0id how pathetic of them
Show threadDio9sysJun 30, 2023
@retr0id same
Show threadNicolás AlvarezJun 30, 2023
@retr0id IIRC giving different content to Googlebot and to normal browsers is not allowed by policy, and I think Google occasionally makes requests with a normal browser UA to catch it.
Show threadDavid BuchananJun 30, 2023
@nicolas17 tbh given the number of sites that seem to get away with authwalling, I assumed it was a manual review thing
Show threadSiguzaJun 30, 2023
@retr0id @nicolas17 Or just no review at all? Fucking Pinterest showing up on Google Images all the time but then requiring a login when you open the page...
Show threadKelsey JordahlJun 30, 2023
@retr0id when is that going to happen for Pinterest, Reddit, etc.?