May 03, 2005

[Research] Comment spam observation

It seems that the comment spam floods in MT are primarily caused by web crawlers downloading the comments that are there rather than attempts at posting new ones.

We had another brief meltdown from comment spam (happens every couple of days now), and I checked the Apache log file immediately afterward. Most of the mt-comments.cgi requests immediately before the incident were GET requests for specific comments, usually with a referrer off site.

I don’t think we’ve had any new comment spam since installing the Scode plugin.

So the trick now is to remove the comment spam from blogs where it’s gotten to. Nasty here, since most of these blogs are long dead class projects which could probably be safely deleted. But can’t do that, so I’ll have to just delete the comment spam.

Posted by Rowan Littell at May 3, 2005 02:18 PM