2025-10-24 12:18:28
I'm going to implement Anubis on my sites, so I can get rid of the AI bots
I'm going to implement Anubis on my sites, so I can get rid of the AI bots
@dawid@social.craftknight.comIs Anubis still the state of the art in self-host scraper bot defence or are people using other things now?
@dawid@social.craftknight.comLOL.
Until last week, the scraperbots were poisoning models with the arcane performance details and masscheck logs of the ASF #SpamAssassin project. 2 decades of data that requires a deep knowledge of SA to make any sense of. It's freely available as a matter of principle. Between thousands of days & hundreds of rules with about a dozen distinct corpora, we poisoned the models wi…
Attack from, apparently, 47.79.192.0/19 (Alibaba). These requests must somehow be getting through Anubis.
Cette tristesse : une orga Š but non-lucratif qui aide des projets open-source, qui s'excuse pour des problèmes entièrement créés par des boîtes extérieures sans foi ni loi.
https://social.anoxinon.de/@Codeberg/115435661014427222
I'm using #Anubis to protect our Forgejo instance from scrapper #bots, but it doesn't seem to be enough for "classic" malicious scanners that try thousands of paths looking for vulnerabilities.
Granted, presenting a challenge increases the cost for the malicious scanners, but at some point I'd like a smarter tool that detects what's happening and blocks any further attempt.
Does anyone know about good solutions for this? I'm sure there must be something out there, I'm just ignorant about it.
#infosec #WebSecurity