Several years ago now I started self-hosting things. Initially the learning process and how to set up everything drove me to eagerly keep learning more and more, and even how to manage keeping everything up and reliable. But then the LLM Scrapers arrived.
I looked at Anubis and decided I didn't want the delay loading for regular viewers, so moved to iocaine which is slightly different in what it does, and that was fine until so many scrapers hit my site that it saturated my upload with generated content feeding the them. So I removed it, watched iftop - for not even very long - over a few evenings and noted a bunch of IP ranges owned by cloud companies and the likes of Meta(Facebook) who's servers have zero reason to hit my sites. Pretty sure no one is sharing links to my blog there. Also Azure, Alibaba... and a bunch of others.





