It seems like some others my sites are being bombarded with hits from a mob called AllResearch. Apparently one of the things they do is hit RSS feeds and suck down every page referenced, for some kind of indexing. Judging from the amount of traffic they’re burning up, they suck big-time, in fact. I mean, indexers usually put in a lot of hits on web sites, but these guys are hitting more than 10 times as much as the next one down the list, MSN.
These are the top hitters over at toxiccustard.com:
- 45541 sp1.allresearch.com
- 3448 msnbot.msn.com
- 3110 index.atomz.com
- 1328 crawl25-public.alexa.com
Time for a little .htaccess magic:
deny from 38.144.36.
allow from all