User avatar
lux flag_nonbinary🦊ΘΔ @SharpLimefox@eldritch.cafe
1mo
Both @Soblow and i run iocaine, and we have a year-long backlog of URLs that iocaine gave to bots that contain a "poison" word. When we detect that word in a URL, instead of feeding garbage, we redirect to the other's site, trapping them in a Crawler Death Spiral.

This allows us to correlate and track bot operators across time and IPs, because a surprising number of them actually provide Referrer correctly.

RE: eldritch.cafe/@Soblow/116724464942776651
This note is quoting eldritch.cafe/@Soblow/116724464942776651
3
5
3
0
User avatar
illy [Shrimple-mode] protomoji_orange_flag_lesbian @illyBytes@shrimp.imsofucking.gay
1mo
@SharpLimefox @Soblow i remember curl having like a redirect limit of 30, do some IPs like drop the connection after like 30 rounds of being ping pong'd around?
0
0
1
0