New 'Perceptual' Ad Blocking Tech Doesn't Win The Ad Blocking War, But It May Put Advertisers On Their Heels... Permanently
from the the-mole-finally-got-whacked dept
We've long documented how there's a growing array of websites that seem intent on shooting themselves in the foot when it comes to "defeating" ad blocking. Quite often that includes punishing customers for a website's own misdeeds, or using ham-fisted (and frankly often broken) systems that attempt to block the ad blockers. Of course, this tends to obfuscate why these users are using blockers in the first place, whether it's to keep ads from eating their broadband usage allotments, or simply as an attempt to protect themselves from "ads" that are often indistinguishable from malware.
The bottom line is that thanks to aggressive, poorly designed or downright hostile ads, many consumers quite justly now feel that ad blockers are an essential part of their privacy and security. Here at Techdirt, we long ago decided to let our visitors decide what their ad experience looks like, letting visitors disable ads entirely if that's they're preference (we just, of course, hope they'll try to support us in other ways). Elsewhere though, websites are engaged in what feels like a futile game of Whac-a-Mole that seems increasingly obvious (to some) won't be "winnable."
New developments on the ad block front seem to indicate this game of Whac-a-Mole may soon end up with the mole being -- well -- most decidedly whacked.
Princeton and Stanford researchers say they've developed a new method of blocking advertisements that detects ads the same way human beings do -- by simply looking at things like container sizes, graphical layout, and words like "Sponsored" (usually mandated by regulations or voluntary, cross-industry commitments). Computer scientist Arvind Narayanan and his colleagues have published a new paper (pdf) and proof-of-concept code for something they're calling a Perceptual Ad Blocker. Their paper describes the new technology as such:
"Perceptual ad blocking seeks to improve resilience against ad obfuscation and minimize manual effort needed to create ad blockers. We rely on the key insight that ads are legally required to be clearly recognizable by humans. To make the method robust, we deliberately ignore all signals invisible to humans, including URLs and markup. Instead we consider visual and behavioral information. For example, an ad may include the tex "Sponsored" or 'Close Ad" within its boundaries, either directly or when hovered over. We expect perceptual ad blocking to be less prone to an "arms race."
Over at Freedom to Tinker, Narayanan is quick to point out that this new technology isn't "undefeatable" (as some websites quickly suggested), but it does certainly tilt the ad block battlefield in favor of the end user. He notes that the technology was developed in response to Facebook's decision to integrate ads that look like regular posts in the user's news feed, something systems like AdBlock haven't been able to detect (some smaller blockers like uBlock Origin have been able to, but apparently have such a small market share they've yet to get Facebook's attention).
The other ad blocking obstacle that Narayanan's perceptual ad blocker addresses is the growing numbers of websites that believe they've "solved" the problem by blocking users that block ad blockers. In short, it does this by convincing the web browser to effectively lie to any script trying to determine ad blocker use:
"The second prong of an ad blocking strategy is to deal with websites that try to detect (and in turn block) ad blockers. To do this, we introduce the idea of stealth. The only way that a script on a web page can “see” what’s drawn on the screen is to ask the user’s browser to describe it. But ad blocking extensions can control the browser! Not perfectly, but well enough to get the browser to convincingly lie to the web page script about the very existence of the ad blocker. Our proof-of-concept stealthy ad blocker successfully blocked ads and hid its existence on all 50 websites we looked at that are known to deploy anti-adblocking scripts. Finally, we have also investigated ways to detect and block the ad blocking detection scripts themselves. We found that this is feasible but cumbersome; at any rate, it is unnecessary as long as stealthy ad blocking is successful.
The researchers have developed both a standard and Facebook specific Chrome extension that you can try yourself, and they have no problem with identifying these types of integrated ads:
The researchers have yet to enable the actual blocking component of their ad blockers to, they say, "avoid taking sides on the ethics of ad blocking."
Now you'd like to think that should perceptual ad blocking be as effective as they're claiming, websites and advertisers would be forced to do some soul-searching into why users are flocking to ad blockers in the first place. But most of us know many of these websites won't learn a damn thing in this scenario, and may engage in behavior that forces users to somehow interact with the ads if they want the page to load. Narayanan is quick to point out that this -- like ad block blockers already have -- could only drive users away from these websites even faster:
"If publishers are willing to intrude on users’ attention by making them interact with ads, it does seem unlikely that ad blockers can succeed. But that will also drive away many users, and it’s not clear how many publishers would be willing to make that trade off. Sponsored content / native advertising is again a topic where the law has something to say. These need to be identified clearly as sponsored (and for the most part they are). We’ve found that people aren’t good at noticing these disclosures, but browser extensions can be! Ad blockers could take on the role of prominently alerting readers when a link they’re about to click on is in fact sponsored content."
If perceptual ad blockers are half as successful as the researchers claim they can be, many sites and advertisers have two options. One is to finally take serious stock of why ad block use has skyrocketed (and their own culpability for it) and develop more consumer-centric and creative monetization and advertising efforts. The other is to cry more, double down on blaming visitors for their adaptation failures, design systems that break the internet and annoy site visitors even further, or try to use the law to hamstring the use of ad blockers (an uphill climb, and in some places potentially a two-way street).
If stopping ad blockers truly is a fool's errand (and these researchers strongly believe it is), there's really only one choice that makes any real sense.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: ad blocking, ads, online ads, perceptual ad blocking
Reader Comments
Subscribe: RSS
View by: Time | Thread
They refuse to understand how shitty the advertising they push on their consumers is, and demand consumers just take it. You don't matter, the few pennies matter more.
It would be nice if there was some sort of government body who was charged with protecting consumers who gave a fsck. Do you think if a website/ad network could be sued for the costs of prying malware out of a victims computer... they might finally decide to clean up their act?
Bandwidth caps eaten away, your machine locked up by ransomware, video blaring away before the page loads. How did they get to a point where they decided to say fsck the consumers, we need these pennies more?
Chasing the imaginary money & punishing consumers who refuse to get shit upon... something something **AA's?
History keeps repeating, and no one learns.
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
Re: Re:
Now you're talking about Government mandated censorship Which is what that is. Funny, yet sad how so many just jump right to that. Here, take more of my rights away. Which is exactly what he's asking for.
[ link to this | view in chronology ]
Re: Re: Re:
[ link to this | view in chronology ]
Re: Re: Re: Re:
Just like net neutrality and privacy rules do, somehow. Remember how television was destroyed by limiting the amount of ad time? Or the inability to advertise cigarettes? Remember how much better TV became when they were allowed to start advertising prescription drugs? Yeah, me too!
[ link to this | view in chronology ]
Re: Re: Re: Re: Re:
[ link to this | view in chronology ]
Re: Re: Re:
You're a special kind of retarded aren't you.
The industry refuses to fix themselves.
Their clients refuse to demand it be fixed.
As it costs consumers money to fix the harm these asshats force unto them, it would seem that what they are doing is a 'Bad Thing™'.
Now reread what I actually wrote without your Infowars secret decoder specs on and apologize you lickspittle fscknugget.
[ link to this | view in chronology ]
Re:
I about lost it one day, heard the head of advertising talking about wanting pop-under ads. Just want to scream at these idiots. Sure someone might pay well for that to start with, but once we run off the last of our viewers with shitty ads the advertisers will leave.
Really sucks to work IT at a company and be totally embarrassed by the company website. I can't even stand to visit the site without ad-blockers running because the shitty scripts from the ads will lock up any machine short of a gaming rig.
[ link to this | view in chronology ]
Re: Re:
JavaScript version. Who is providing
the ads? Do some digging. Your web
site visitors and your company are
under attack. Your job depends on it.
Your management sucks.
[ link to this | view in chronology ]
Re: Re: Re:
[ link to this | view in chronology ]
Re: Re:
It would be a shame if they had to deal with the shit they want others to accept.
[ link to this | view in chronology ]
Nowhere to go BUT down
One is to finally take serious stock of why ad block use has skyrocketed (and their own culpability for it) and develop more consumer-centric and creative monetization and advertising efforts. The other is to cry more, double down on blaming visitors for their adaptation failures, design systems that break the internet and annoy site visitors even further, or try to use the law to hamstring the use of ad blockers (an uphill climb, and in some places potentially a two-way street).
I'm probably giving them way more credit than they deserve, but it's possible that at least some of the ad companies have realized that at this point, for many people, ads are seen as so toxic and dangerous that there's nothing they could do so get people to view them willingly, so they have to be sleazy in order to stay in business.
Beyond the insanely annoying ads, at this point my primary reason for having an ad-blocker, and one that ensures that it will never be disabled, is not convenience, it's security. I'd be willing to put up with a moderate amount of ads if I could be sure that an infected one wasn't in the pile, but as that's something I'd only learn too late, it's far too big a risk. A site asking me to disable my ad-blocker is little different than one asking me to disable my anti-virus program, it's simply not happening.
When ads became such a major vector for malware and viruses that even major sites could end up serving infected ads, and the response from the ad companies was an indifferent 'not our problem', it's more than a little absurd for them to then lash out against those that took basic security measures and blocked them all.
[ link to this | view in chronology ]
Re: Nowhere to go BUT down
1) security/malware
2) privacy/tracking
3) bandwidth (e.g. video ads)
Annoyance with ads themselves is rarely a concern anymore. Yes there are the occasional places that still try pop-ups, or make you see the ad before clicking through to the content. But for the most part, I'm perfectly OK with ads that don't mess with my 3 main concerns.
[ link to this | view in chronology ]
Re: Re: Nowhere to go BUT down
When I revisit a topic here with a large number of posts, I'll often type my name into the browser's "Find on page" textbox. That way not only are new posts highlighted, but my own posts have my name highlighted in yellow. It's a quick way to see if anyone replied to my posts.
But that's broken with the ad blocker turned off. The Find highlighting gets cleared, I think every time a video ad reloads.
[ link to this | view in chronology ]
Re: Re: Re: Nowhere to go BUT down
I'm not kidding, years ago on Firefox and IE there were certain ads I've had the displeasure of encountering that would either lockup and crash the browser or outright lockup my PC (mind you it was on an old eMachines PC with an AMD Athlon XP CPU but it wasn't like terrible for the time). That taught me to always keep my ad block on. Sorry, but if the advertiser networks are going to write complex JS they shouldn't hire idiots to write it.
[ link to this | view in chronology ]
Re: Re: Re: Re: Nowhere to go BUT down
On sites without ads, there is often reasonable use of whitespace, leaving space empty for both visual and "click in the window without triggering anything" reasons.
On sites with ads, the entire page tends to be cluttered with objects, to the point that frequently even clicking in what looks like empty space will actually trigger a hyperlink to whatever page the ad is pointing to.
I've started to use "clutter" as a curse word in the past year or two, for unrelated reasons, and the idea holds up just as well on the WWW as it does elsewhere.
[ link to this | view in chronology ]
[ link to this | view in chronology ]
On Browser Design
First, we all should be up in arms that anything coming over a browser, ever, is a security problem. That information versus executable code distinction is extremely useful and should not be broken down without a very good reason...and executable code should be able to be bounded effectively.
Second, there's nothing, especially if the user is handicapped, that says the browser has to be honest about the perceptual experience of the end user. Screen readers, debuggers, hell, just walking away for a cup of joe, all mean that that full-page splash has just gone unseen...and we all know about click-fraud!
Third, its still an arms race...think about the "I am a human" tests that now litter the web...what if you have to solve a puzzle (and look at the instructions in the ad) before the content you wanted was downloaded.
Of course, the further along this arms race goes, the more difference appears between "simple" websites and those that are trying to force ads.
[ link to this | view in chronology ]
Flash, just don't
Once they completely stop using Flash. I will consider white listing some of the providers. But, cautiously.
[ link to this | view in chronology ]
Mis-read Title
[ link to this | view in chronology ]
Re: Mis-read Title
[ link to this | view in chronology ]
Re: Re: Mis-read Title
[ link to this | view in chronology ]
Any element that blinks or otherwise changes as I view the page should be highly suspect. If it demands my attention, it's probably unworthy of it.
[ link to this | view in chronology ]
Fact is, advertisers brought it upon themselves with more and more intrusive, obnoxious ads. Now they are heaping what they have sown.
[ link to this | view in chronology ]
Ads never worked for me.
Have been serious avoiding Internet ads since Windows 98 era, and the experience without ads is so much nicer!
Flash, JS, and Silver Light are also seriously avoided, like a virulent disease.
[ link to this | view in chronology ]
Re: Ads never worked for me.
[ link to this | view in chronology ]
Re: Ads never worked for me.
[ link to this | view in chronology ]
Re: Ads never worked for me.
By which I mean, I never, ever, EVER click ads. If I see one that's interesting to me (I do run Adblock Plus with 9 different filter lists plus 140+ custom filters, so that's rare, but it happens) then I simply open a new tab and go directly to the site in question. In this way, the business isn't penalized, but the advertising firm is. If I make a purchase as a result of this, I will routinely point out that I've intentionally circumvented their advertiser's system and I'm buying their product DESPITE the ads, not because of it.
I've gotten 7 or 8 messages back where the businesses themselves tacitly admit that they don't like their own ads. Two of them told me they were surprised because they'd been running ads for over a year and I was the first person to ever make a purchase off them. Even the "customers" in this equation - which are the companies paying the ad firms to run their ads, not consumers - don't like this system. The only people genuinely happy with the advertising status quo are the ad agencies themselves.
Two more quick notes: First, I've bought 2 Techdirt T-Shirts and I freaking love them. Similarly, I've bought a premium Nexus Mods membership and other things specifically because I do want to support these sites, I'm just not willing to open myself up to all the cesspool of issues that advertising creates to do it. Second, I don't block Google's AdSense ads. Privacy concerns aside, text-only ads are neither obnoxious nor (usually) security concerns. If the entire industry could do the right thing and adopt Google's respect-other-peoples-sanity model, I doubt ad blockers would've ever even become a thing. Food for thought, ad guys.
[ link to this | view in chronology ]
Why
Also, most of the ad banners change into products and services I ALREADY OWN.
[ link to this | view in chronology ]
TV vs internet
The internet is a much more active engagement and people don't want someone popping in unannounced like banner ads.
[ link to this | view in chronology ]
Re: TV vs internet
People still complained any time the advertising per hour increased.
But remotes and DVRs and a trip to the fridge or loo are great for commercial breaks in a passive viewing scenario too. You are absolutely right about the internet, i just don't know that what they did with the tv model really always worked for tv so well, either.
[ link to this | view in chronology ]
uBlock is much better than AdBlock
The fact that some sites do not realize I am blocking ads is just a added plus.
Site owners have shown they can not be trusted to not crash my browsers by poorly designed and malicious ads. I honestly do not generally care about the ads themselves if they were not the spawn from hell. Well that and trying to track every move I make online so now I pretty much block everything except for a few sites I trust.
No pity for them from me, they are getting exactly what they deserve.
[ link to this | view in chronology ]
TV is the same way. Once I got a TiVo and could skip the commercials, I almost never see a commercial, I just skip them. About the only TV I watch without the TiVo is breaking news.
No matter if it is TV or websites, once you piss off your customers, you never get them back.
[ link to this | view in chronology ]
I think it would be fairly trivial for an ad blocker to assume that modals that show on page load, or that are triggered after a setTimeout(), are pretty much always ads.
Modals have a purpose and can be used for good -- basically by using them the same way on a website as they're used in programs. But I've had about enough of them being used as modern-day popup ads.
Also, I'd really like a mobile browser that just straight-up fucking ignores position: fixed. Sticky navbars are fine on my 27" desktop monitor, but they are very much not fine on my 5" phone screen, especially in landscape.
[ link to this | view in chronology ]
Will advertisers wake up? Not likely, they'll just continue to try and develop new ways to block the blockers and make themselves even more unpopular. I'm surprised they haven't started throwing pig troughs of money politicians (mostly Republicans no doubt) to put a stop to this dastardly crime be perpetrated upon them.
[ link to this | view in chronology ]
Adblocking
Now that the U.S. has no privacy from the ISP, I am using Tor and seeing more ads. My ISP was one that wanted the ability to make money from our aggregated use patterns. I wonder how they feel about more people using Tor and their bandwidth increase.
[ link to this | view in chronology ]
Re: Adblocking
Absolutely giddy I would imagine. You'll hit the arbitrary cap sooner & have to pay them for more.
[ link to this | view in chronology ]
Only adds I click
(still not sure if it's the apple hardware or the Microsoft software that causes this)
I will try ublock for the other porn sites now.
(most of this IS satire)
[ link to this | view in chronology ]
Doesn't allow for DRM
[ link to this | view in chronology ]
Re: Doesn't allow for DRM
[ link to this | view in chronology ]
Some webmasters have gone to the extreme to get coin when someone happens upon their website, having banner ads and ad's on the side of the site just weren't good enough so then became the scrolling ads, then the op up ads, then the pop under ad's, then the mouse over ads, then the redirects, then ad overlays,then the Iframes, and on and on.
The AD industry has itself to blame for this due to the fact that they have a hand in creating this mess. The Ad industry has made Ad's and the way they can be delivered so obtrusive that people are past the point of annoyed with it, webmasters also shoulder part of the blame for the type of Ads they are using on their site and serving to a visitor.
Some websites Ads and tactics to get clicks just make a person not want to bother going on the site any further and they close it out and go elsewhere. If you asked my honest opinion Streaming sites Ad's have become unbearable even with Ad Blocking, it's bad enough that even adult webmasters are looking like saints and they had a reputation as some of the worst for Ad's that did all sorts of shit when you landed on one of their websites.
Even with how prevalent Ad blocking has become look at some of the webmasters and advertisers and their response has been. Some Webmasters and advertisers see the Ad blocking as a sign that they are shooting themselves and their webmaster partners with obtrusive ads and are rethinking how they serve those ad's to not be so obtrusive.
And there are those Advertisers and webmasters who thwart anyone with an ad blocker from surfing there site or make it so navigation doesnt work correctly or content wont work or be served or is outright blocked. Instead of trying to see what would serve them better the Advertisers and webmaster have taken the thermonuclear war approach and have declared war on ad blockers and those who use them.
Honestly Ads have become intrusive enough on some sites even with Ad blocking that I just dont go to those sites anymore, and for those that want me to turn off my ad blocker or I dont get to see their content I say "Thanks, but I dont think so" and I move along, because there is still too much obtrusive and malware laden ad's out there for my liking.
I have sites I visit where I know there are ad's, and I have whitelisted because their ads arent full of pop ups, pop unders, mouse over, I frames and redirecting me to death and I have no problem with them.
The ones that have gone all nuclear war on my ad blocking, I just plain quit going to their sites, plenty of other places on the web where I can go where I dont have to deal with crap ads and webmasters who could give a rats ass what they serve up or how they serve up ads.
Sorry but advertisers and webmaster have to have a look in the mirror when it comes to what they are doing to monetize their websites with the type of ads and they way they choose to serve them to their sites visitors
[ link to this | view in chronology ]
Most Facebook ads are irrelevant
If they know I like Star Wars, Lord of the Rings, and Doctor Who, why are they showing me ads for realtors in my neighborhood? Why not show me an ad for "Rogue One" or Doctor Who DVD's? Or why not show me some ads for these kinds of toys? Not only would I click on these ads, but I'd very probably buy something from the advertiser's website.
But the more irrelevant ads they show me, the more likely I am to block them all.
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Advertisers are Scum. Period.
Just another frontier for spammers...
[ link to this | view in chronology ]