Ariadne Conill 🐰3d ago

honestly the thing that makes me walk from alpine might not even be the LLM debate, the governance issues, etc

it might be the fact that i can no longer properly maintain my packages in alpine because the gitlab is being DoSed by AI scrapers

Show threadColin3d ago
@ariadne ah so that's why it was so incredibly slow. I was going to ask what's up / if there's a problem on the server —but oh, it's overloaded :<
Show threadAriadne Conill 🐰
@colinstu our infrastructure is being decimated by LLM scrapers, and yet we can't even agree to say "fuck AI"
Jun 25 at 1:34amWeb
Show threadtaco, bird/cat 3d ago
@ariadne @colinstu i don't know why every fucking company decided to throw away best scraping practices - caching etc it's ridiculous
Show threadColin3d ago
@chirpbirb @ariadne caching? storage? why do that when we can just burn a zillion more tokens and charge for it and redo a bunch of work all the time?
Show threaddiffie3d ago
@colinstu @chirpbirb @ariadne My wild guess is it's designed and coded by a generation of people who don't know what a caching HTTP proxy server is.

(kinda joking)
Show threadAriadne Conill 🐰3d ago
@diffie @colinstu @chirpbirb i don't think they are motivated to be resource efficient, considering they can bill for token use
Show threadHaelwenn /элвэн/ 3d ago
@diffie @colinstu @chirpbirb @ariadne Well does reminds me that all the CI setups I've seen so far just rely on CDNs existing rather than caching proxies / local mirrors.
Show threadLuci “Milky Princess” Tea3d ago
@chirpbirb @ariadne @colinstu the current wave isn’t by traditional style of scrapers/indexers- from the perspective of the server admin it looks like a DDoS because the scrape is initiated by individual agent sessions on individual machines running user requests; and in an “agentic” workflow this is indistinguishable from a botnet
Show threadVoidZeroOne   3d ago
@chirpbirb @ariadne @colinstu pure desperation to feed the slopinator 5000 with fresh input
Show threadAyush Agarwal (आयुष अग्रवाल)3d ago
@ariadne @colinstu It’ll always be funny (and extremely hypocritical) to me when people using LLMs deploy Anubis or whatever on their own infra. I wonder if Alpine will do something similar.
Show threadAriadne Conill 🐰3d ago
@ayushnix @colinstu we already use go-away, but clearly it isn't working anymore
Show threadAyush Agarwal (आयुष अग्रवाल)3d ago
@ariadne @colinstu Ah, in that case, people who are advocating for using LLMs in Alpine should be fine with removing any sort of defenses like go-away from the Alpine infra if they really believe LLMs are a net positive and worth discussing rather than just banning it at the first opportunity.
Show threadnicole mikołajczyk3d ago
@ayushnix @ariadne @colinstu Anubis is slop and literally shares goals with ‘AI’ companies—it exists solely to gatekeep access to knowledge online
Show threadAriadne Conill 🐰3d ago
@mkljczk @ayushnix @colinstu cool, anyway, it would be nice to have a functioning alpine gitlab
Show threadGlyph3d ago
@ariadne @colinstu @daisy ugh I am so sorry. Definitely sympathizing from a similar situation over here