The Joy Of Watching Comment Spammers Scramble To Try To Delete Links After Google Demoted Them
from the it's-kind-of-fun dept
Starting a few months back, we started noticing a weird trend here at Techdirt. Every two or three days, we'd get an email from someone asking us, politely, to please remove a comment they had posted. Every single time, it was someone who had somehow gotten comment spam through our (pretty good) multi-layer comment spam filter (which catches more than 1,000 spam comments per day). Each one reads something like the following:Hi,There are a number of variations on this. My favorite is the following, which ridiculously implies that that we were working with them and they "appreciate the support."
We noticed that your site https://www.techdirt.com is linking to our site [redacted] on the url [Techdirt article URL]
Unfortunately [our company] has been hit by an Unnatural Link Penalty and we are now trying to get all links taken down where possible, rather than disavowing them.
If you could spare 5 minutes to take this link down we would be extremely grateful. Do not hesitate to contact me with any questions.
Hello Webmaster,One time, we got one that insisted that if we didn't remove the link, Google would punish us as well. Every time we get these (and it's been happening with increasing frequency), there's a bit of an internal dilemma. We don't delete comments unless they're spam. That's our general comment policy around here. But, these are clearly spam, and it's annoying they got through our spam filter. If we had discovered them on our own, we would have deleted them. But, just the fact that these jackass comment spammers are getting in trouble for them... makes us pause and think a bit. It feels somehow wrong to abide by the wishes of these comment spammers who littered our site.
My name is Matthew Victor and I’m a SEO specialist with [redacted], first off I want to thank you for linking to our site from https://www.techdirt.com/, we appreciate the support over the years.
Unfortunately, it has come to our attention that this link may be viewed by Google as a violation of the Google's Webmaster Guidelines.
It is important for us to bring our website into compliance, so we are requesting that you remove our link from this page and any other page on your website.
To assist you in the process of removing these links from your site I’m including a list of the pages we have been able to identify as linking to us.
[URLs redacted]
We would greatly appreciate your prompt response to this request and removal of these links along with any others on your site.
Thanks,
It appears that we're not the only ones dealing with this. Apparently, Google's algorithmic changes over the past year or so have hit those who abused comment spamming quite hard, and plenty of blogs are getting these kinds of emails. The folks over at The Awl have a nice article about it, in which they quote Boing Boing's Rob Beschizza going through the same debate we did, and ending up with the same conclusion:
This isn't only happening in The Awl's inboxes, either. "The funny thing is, we don't actually want that spam lurking around in old comments," Boing Boing's Rob Beschizza wrote to me in an email. "But we obviously like seeing the spammers suffering as a result of their own misbehavior."The Awl did some digging and found out that the changes to Google's algorithm have really hit those comment spammers hard, which is something worth cheering.
"So we just leave it up," he wrote, "even though we don't want it, in the hope that Google may penalize them further."
"The average drop was from page one to page five in Google," [the "SEO" guy trying to remove comments that The Awl contacted] said. In some cases they even dropped as low as page ten. How often do you find yourself on the fifth—much less the tenth—page of Google results? If you've gotten that far, you're better off just refining or revising your search terms.The Awl notes that it, too, has received emails from those trying to remove comment spams saying that Google will punish them as well. However, the first time we got one of those, we reached out to people at Google who told us that we were fine. First of all, all of the links in our comments automatically have rel=nofollow appended to them, which means that Google already does not use them as authoritative (though, I do wonder if they use them to help demote certain links...), and knows that we've "disavowed" the links. Also, our general page rank and reputation likely protects us from having the algorithm think we've suddenly turned into link spammers.
"We needed to delete all of the bad links," he said. "It was a big list—a few thousand, even ten thousand links. We just moved one by one: this is a toxic link, we need to delete it; this is a good, natural link."
"We had links from the Daily Mail, Huffington Post, and we had links from profiles in shitty forums or small websites that we didn't want to get the link from," he said. Apparently by that he meant... us. So the goal clearly isn't to remove all spam links. Just the least-good ones.
As we mentioned just recently, whenever I've brought this up on Twitter, some people have suggested we should offer to charge for the removal of those spam comments -- and at times that's tempting. But, in the end, the companies that spewed that spam deserve whatever crap they get. If they didn't realize it was evil to post comment spam, then they're not the kinds of organizations worth doing business with in the first place.
Now, if only the message that comment spamming is dead could make its way to the folks who are still hitting us with 1,000 or so comment spams per day...
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: comment spammers, google algorithm, rankings
Reader Comments
Subscribe: RSS
View by: Time | Thread
SO, Google policing that Mike approves of!
SO. Turns out that Mike WILL come round to my views, heh, heh! Because my views are aligned with common law. By the way, that's why I don't bother "making nice": reality is on my side (that's a joke, kids, as if "reality" is on my side, reversed, see?) ... my view is that I'm aligned with reality to best of my belief, and it's amusing how you kids struggle against it, but best way is for you to be dragged kicking and screaming, it's the only way anyone ever learns.
Just as Mike criticizes and advises MPAA and RIAA only so they'll actually get more money, so too my efforts here show that I'm Mike's friend, trying to improve his product so attracts more readers.
09:29:39[k-842-3]
[ link to this | view in thread ]
Re: SO, Google policing that Mike approves of!
[ link to this | view in thread ]
Please to edumicate me.
[ link to this | view in thread ]
Backfire?
Seems like this will quickly backfire...
[ link to this | view in thread ]
Heh
Here's my dilemma, though. I know that these are spammers, but there is a possibility that they are not personally spammers and had hired a dubious SEO company (which black hatted their way through rankings).
I do feel bad for those people, and I will occasionally delete a profile or two in response if the content was useless.
For the rest of them: Haha! I laugh nearly every time.
[ link to this | view in thread ]
[ link to this | view in thread ]
Google isn't punishing anyone
It's no more punishment than it is to not return Automobile web pages when the searcher was looking for the history of the NSA.
Now they don't like it, certainly! But it's not being done to punish them, it's being done to make Google a better search engine for the people doing the searches.
Boojum
[ link to this | view in thread ]
Re: Please to edumicate me.
[ link to this | view in thread ]
Here's my response, especially if they "thank" me for the link
"I know you are busy but I would really appreciate a favor. We really screwed up when we hired a company to do search marketing for us because they went out and placed many spam comments on sites including yours. We're sorry that we were responsible for that.
We're getting our comeuppance now because Google is punishing our search rankings because we have so many spammy links to our site. I know that this is all completely our fault, but it would mean a lot to us if you could delete this offending content from your site."
Please don't pin the blame for this on us. Show a bit of remorse and we'll be happy to help.
[ link to this | view in thread ]
Re: Heh
In which case, they're still spammers even if unwittingly. Punishing them is still a Good Thing, since it should cause them to fire the bastards that they hired.
[ link to this | view in thread ]
Is it possible to put the spam comments on a dedicated link spam article? Not just the ones people are asking to be removed, but all the ones the filters catch as well.
Real articles remain spam free while the links get counted and demoted.
'Course I could just be speaking nonsense here, but the idea amuses me.
[ link to this | view in thread ]
Re:
[ link to this | view in thread ]
[ link to this | view in thread ]
[ link to this | view in thread ]
Maybe
[ link to this | view in thread ]
If you can hide the spam then thats good enough, just dont leave them up intentionally.
[ link to this | view in thread ]
Re: Please to edumicate me.
[ link to this | view in thread ]
SEO, Spam and Googles Logic
1. It IS punishment. Spam has gotten so far out of hand over the years that previous efforts to discourage and otherwise eliminate otherwise undeserving results from the organic listings were not getting the message across. Spam just became a massive business.
So to really send the message across, Google is now much more SEVERELY penalizing sites that use spam tactics, one of which is crappy link techniques. The notion here being that when a site gets a manual penalty for crap links, it becomes a very daunting task to clean up now.
Couple that with most of those sites then needing to re-earn (or in actually earn for the first time in legitimate ways) rankings, and more sites are doing all they can to become good netizens.
2. Leaving spam comments up just to spite foolish site owners is NOT helpful to TechDirt. And it doesn't contribute to punishing those site owners because they'll just disavow the links if you leave them up.
In fact, where it CAN be a problem for TechDirt is if Google's system detects too many spam comments, this site WILL be penalized.
I doubt there are that many on TD, so it's highly unlikely that this scenario would happen (as compared to sites like Mashable or others that have free-for-all comment spam where those are more likely to see some sort of hit).
3. Charging site owners to remove their links is a possible revenue stream, however the overwhelming majority of site owners or link-clean-up providers who encounter a fee situation ignore it and just disavow those links.
And for those site owners who come to me for an audit after they've been penalized, that's exactly what I recommend to them. Along with noting in their tracking of their clean-up those sites that attempted to charge for the service. Because that's potentially subject to being viewed as an extortion scheme under some circumstances (not a TD scenario though either).
[ link to this | view in thread ]
Re: Re:
[ link to this | view in thread ]
Re: SO, Google policing that Mike approves of!
[ link to this | view in thread ]
Re: Hey Guys!
[ link to this | view in thread ]
Re: Google isn't punishing anyone
[ link to this | view in thread ]
Re: Re: SO, Google policing that Mike approves of!
[ link to this | view in thread ]
Post the spam
[ link to this | view in thread ]
Oddly ... the website they wanted the link removed from wasn't one of mine, nor had I ever heard of it before.
They have to spam people's emails too?
[ link to this | view in thread ]
Re: Google isn't punishing anyone
Company A makes a great product. Doesn't use any SEO.
Company B makes competing product, and spams company A's product all over the web.
Google reduces visibility of company A's product pages.
[ link to this | view in thread ]
Re: SEO, Spam and Googles Logic
The links are already disavowed because of nofollow HTML tagging. Techdirt can't be punished for them, [and as you acknowledge, nether can the spam contrary to what they believe].
[ link to this | view in thread ]
Crap Links
Pardon me sir. Would you please be taking down these links which unfortunately have been coming to bite us in the bum from Google.
[ link to this | view in thread ]
Re: Re: SEO, Spam and Googles Logic
[ link to this | view in thread ]
The requests are also spam, by the way
So the same spammers who have abused web forums with their filth are now abusing the mailboxes of the operators of web forums with unsolicited bulk email requesting that their earlier spam be cleaned up.
Since, unfortunately, spam is not yet a capital crime (a change I would STRONGLY support) the only real recourse is to blacklist them -- and that's exactly what I'd do. Have done. ;-) There is no reason to give any spammer any service or response whatsoever: there is every reason to blacklist them for life.
[ link to this | view in thread ]
Re: Re: Heh
You'll be hurting ignorant owners or their poor staff who have to clear up their mess.
[ link to this | view in thread ]
Re: Maybe
[ link to this | view in thread ]
[ link to this | view in thread ]
Re: Link Removal
Make it, say, $1 per removed link. But also note that you will bill them for the time your employees use, and won't remove until payment is received and cleared, and charge fees for CC payments, Paypal payments, and Checks.
I figure you could get them to have o pony up 20-30 US$ easy. Per link.
[ link to this | view in thread ]
Re: SO, Google policing that Mike approves of!
[ link to this | view in thread ]
Re: SO, Google policing that Mike approves of!
I woner what is happening to your google ranking?
[ link to this | view in thread ]
Re: SO, Google policing that Mike approves of!
That says it all.
[ link to this | view in thread ]
Re: Re: Re: SEO, Spam and Googles Logic
[ link to this | view in thread ]
Re: Re: SO, Google policing that Mike approves of!
[ link to this | view in thread ]
"We Want To Break Their Spirits"
Matt Cutts, head of Googles Search Spam unit stated on the record over on TWIT.TV their intent with the way they are going after spammers:
"If you want to stop spam, the most straight forward way to do it is to deny people money because they care about the money and that should be their end goal. But if you really want to stop spam, it is a little bit mean, but what you want to do, is sort of break their spirits. There are lots of Google algorithms specifically designed to frustrate spammers. Some of the things we do is give people a hint their site will drop and then a week or two later, their site actually does drop. So they get a little bit more frustrated. So hopefully, and we’ve seen this happen, people step away from the dark side and say, you know what, that was so much pain and anguish and frustration, let’s just stay on the high road from now on."
So my position that it IS punishment, in my opinion based on this statement,is correct. Punishment is designed to break people of a bad habit.
Here's the link to the full audio
[ link to this | view in thread ]
Re: "We Want To Break Their Spirits"
[ link to this | view in thread ]
Re: Re: Re: Heh
[ link to this | view in thread ]
Re: SEO, Spam and Googles Logic
Now that's an oxymoron if I've ever seen one.
[ link to this | view in thread ]
[ link to this | view in thread ]
Re: Re: Re: Re: Heh
I'm not sure why you feel the need to punish the other victim of the spammer.
[ link to this | view in thread ]
Make a special page for them
[ link to this | view in thread ]
Spam to remove spam
[ link to this | view in thread ]
Re: SO, Google policing that Mike approves of!
Glory to thee brother, I am Prince Wong Tang of the Nigerian Clan MacLeod. You have won our internet lotto prize of 42 million dollars. To collect there is a one time processing fee of 3700 dollar.
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Heh
[ link to this | view in thread ]
Re: Re: Google isn't punishing anyone
[ link to this | view in thread ]
Re:
I'm not sure if the weed and the hookers are into the equation though >.>
[ link to this | view in thread ]
Re: Re: Re: SO, Google policing that Mike approves of!
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Heh
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Heh
Not many analogies fit to be honest since there are a wide range of people involved in this with differing levels of compliance and understanding.
I know a local small businesses that has lost ranking because of an "expert" who convinced them he was white-hat and then proceeded to do comment spam. The owner has lost sales, lost the money he spent on his "expert" and lost man-hours trying to fix the problem. A "fuck em all it's their own fault" attitude is quite naive imo.
[ link to this | view in thread ]
Re: Re: Please to edumicate me.
Move the spam comments to a quarantine "post", where they don't do harm to anyone's visual orifices, but are indexed by google, thus detected as spam and demoted in response.
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Re: Heh
"The owner has lost sales, lost the money he spent on his "expert" and lost man-hours trying to fix the problem. A "fuck em all it's their own fault" attitude is quite naive imo."
Why did he hire the "expert"? Was he blindsided by a hugely promising professional whose credentials turned out to be false, or a highly recommended person from others knowledgeable in the field? Or did he just go for the cheapest option, or a guy he met in a bar who said he knew this stuff?
If the former, I have a lot of sympathy. If the latter, he got what he deserved.
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Re: Re: Heh
If the former, I have a lot of sympathy. If the latter, he got what he deserved."
This is exactly my point and why I objected to what John said above. There are victims of this both deserving and undeserving to say punishing them all is a good thing seems to miss the nuance of the situation.
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Heh
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Heh
[ link to this | view in thread ]
Re:
[ link to this | view in thread ]
So, take them down.
¹ And if you believe that, I have some ocean-front property in Arizona that you might be interested in.
[ link to this | view in thread ]
Re: Heh
i get that comment sections of blogs get the 'my sister made $15235 from home...' crap (and -really- easy to ignore at its low level), but email spam ?
who gets that crap ?
i don't think i have a LOT of email accounts, prob average (5-6?), but i hardly EVER, get ANY 'spam'...
what am i doing wrong ?
i get LOTS of 'junk email' that i technically signed up for when i created any of a million fucking 'accounts' you are forced to register for at practically every fucking website in the world, but i get close to ZERO unsolicited emails...
i seriously doubt my ISP is doing anything special in filtering it out, and i don't have anything particular set up in thunderbird, but i don't get much/any spam...
at work, we have the idiotic barracuda 'spam filter' crap, and it is total shit: THE ONLY THING it has blocked have been legitimate emails, NOT SPAM !
AND it CONTINUES to block them, even after i've said "these emails are okay"...
oh well...
guess i have to watch monty python for my spam...
[ link to this | view in thread ]
Re: Re: Heh
[ link to this | view in thread ]
Re: Heh
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Heh
I don't think it does at all. In a sense, it's no different than if you hire an incompetent person to configure your email relay. If they botch the job, your relay will be blacklisted. You get off the blacklist by fixing the problem. It ensures that people will actually fix the issue in a timely way. This is no different.
[ link to this | view in thread ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Heh
[ link to this | view in thread ]
NSA
I'm from the NSA and we instigated a program to secretly add links to our website via secret backdoors we designed into all Internet infrastructure. We thought that this may help improve our Google rating and thus improve how the general public perceives us. It has come to our attention that this program has in fact caused the opposite reaction. We would kindly ask that you remove the links to us immediately, otherwise we may be forced to invest in a new program to create a new secret backdoor to remove the link ourselves.
Sincerely,
Your Big Brother
PS: It'd be a shame if your friends found out what websites you were surfing last night...
[ link to this | view in thread ]
Re: So, take them down.
=P
[ link to this | view in thread ]
/s
[ link to this | view in thread ]
Getting Back to Reality
[ link to this | view in thread ]
First they violate us, then they ask us to pick up the mess.
I wonder what Google will do to me. I have a blog on addiction but degrees in Business and even a AAS as a paralegal.
[ link to this | view in thread ]
[ link to this | view in thread ]