No, Netflix's New Deal With Comcast Probably Won't Destroy The Internet. Yet.
from the too-many-experts,-not-enough-data dept
The mysterious performance problems customers on large ISPs (specifically Verizon, AT&T and Comcast) have been having with Netflix streaming has just gotten slightly clearer. For months people have posted traceroutes as undeniable proof that large ISPs like Comcast, AT&T and Verizon had intentionally been throttling subscriber Netflix streams. However, as we've been noting, simple route analysis doesn't tell the whole story, and it's not always possible to determine where video transit breakdowns are occurring without direct access to ISP network data (data they hide completely).Adding a sliver of insight into the problems, Netflix and Comcast announced over the weekend that they had struck a new interconnection deal that involves Comcast providing Netflix with direct access to the Comcast network. The announcement itself says little, other than to insist that Netflix "receives no preferential network treatment under the multi-year agreement." A Wall Street Journal report had a little more insider detail, noting that the two sides bypassed core network operator Cogent in an arrangement that involves Netflix paying Comcast for direct access:
"(The connection to Cogent) was starting to become overwhelmed with Netflix traffic, congesting traffic and leading to slower Netflix streams for Comcast Internet users, people familiar with the matter said. At the same time, Comcast presented Netflix with more attractive deal terms than the operator had been offering, the people said. The deal spans several years. Netflix was aiming for a long-term deal to make sure its projected traffic growth wouldn't put it at a disadvantage, one of the people said. The connection is a so-called "paid peering" deal, which connects Netflix's network to Comcast's directly. Netflix was previously using several middlemen to access Comcast's network."Why the sudden interest on Comcast's part in getting a deal done? They're likely not too excited about the fact that they've been receiving bad press for poor Netflix streaming performance at the same time they're trying to sell regulators on the purported technical benefits of their $42 billion acquisition of Time Warner Cable.
Despite a lot of Internet hand-wringing about the deal and counter-kvetching about said hand-wringing (all based on no actual data, mind you) -- the agreement on its surface appears to be good for everybody involved except Cogent. That's thanks to the fact that in this case, Comcast appears to have been willing to make apparent concessions on price and deal length in order to keep up appearances for the merger. Netflix pays the same money they were paying Cogent to Comcast (or less), Comcast makes revenue they weren't making before, and customers get better streaming performance at no added costs (since Netflix is probably paying about the same, for now).
The problems are twofold: one, these deals are kept highly secret so promises of "no special treatment" aren't something people can confirm, and as Timothy Lee at the Washington Post discusses, the continued expansion of last mile ISPs into CDN and transit markets over time (note this is not new) could potentially lead to higher prices and less competition overall across the Internet's core:
"The fact that Netflix agreed to pay Comcast suggests that Cogent will likely lose its fight with Verizon as well. And as Cogent's chief executive Dave Schaeffer told Ars, "once you pay it's like blackmail, they've got you, there's nowhere else to go. They'll just keep raising the price in a market where prices [for transit] are falling." Indeed, in the long run, this development threatens the survival of independent backbone companies like Cogent. If it becomes industry practice for backbone providers to pay residential ISPs, companies like Cogent will become mere resellers of access to the networks of large broadband companies. Or they may be cut out of the loop altogether, as large customers such as Netflix cut deals directly with broadband providers such as Comcast."I'm not sure Lee helps his argument by bringing net neutrality into the discussion though, as this is again more about market power than neutrality (for the moment). It's also worth noting that Cogent has a reputation of being difficult in peering disputes, and when a breakdown happens, more often than not Cogent is at the heart of it for not following through on truly balanced peering. Cogent was busy telling media outlets last week that it was Comcast and Verizon that were to blame for recent slowdowns. To hear Cogent tell it, Verizon and Comcast have been refusing to upgrade their interconnection links, largely because the ISPs want to move from an era of settlement-free interconnection, to one where the ISPs play a larger role in transit and get paid:
"This isn't the kind of problem consumers can solve by purchasing a faster Internet connection, because they'd be paying only for a faster path to Verizon's network, not a faster path to the rest of the Internet. In some cases, Verizon has actually purchased and installed the necessary equipment to upgrade ports, but not turned it on, according to (Cogeco CEO) Schaeffer. "They actually put it in, so they spent the money, but they just politically have not been willing to turn it on in order to ensure that Netflix will not work as well as Redbox," he said. When Netflix can't get through to Cogent, it sends traffic through other providers, but Schaeffer claims that "everybody is full." So what are they fighting over? Schaeffer said Verizon "wants a price that is about 10 times the market price for transit." Again, transit is a service that takes traffic across the entire Internet, whereas peering is just a connection between two networks."To intentionally belabor a point again though, nobody can confirm anything either side says because the details aren't released. Meanwhile, while the Comcast deal might not be bad, the worry among consumer advocates is that in a world where ISPs get bigger and more powerful and transit options are reduced and replaced under absolutely no transparency, the overall industry could get less healthy. With Comcast controlling the last mile conduit, an ever-increasing slice of the core networks, and the media content itself, you start to see the monopsony concerns Comcast's expansion could raise among antitrust regulators.
Remember of course this deal only impacts Netflix on Comcast, there's continued ongoing problems for Netflix and YouTube traffic reaching the networks of a number of larger ISPs (Time Warner Cable, AT&T and Verizon), with no indication of when they'll get resolved. While I don't think the FCC's Wheeler is going to do much of anything meaningful on broadband competition, net neutrality, or prices, I do think he'll work to find some way to bring a dash more transparency to these disputes if everybody involved can't start getting along. Mainstream services grinding to a halt with nobody willing to admit fault and everything kept in the complete dark is simply bad for business. For everyone.
If this is all tl;dr for you, all you need to know is that if you're on Comcast and your Netflix streaming stinks you should either see improvements right away, or sometime over the next few months as the changes are implemented.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Filed Under: broadband, streaming, throttling
Companies: at&t, cogent, comcast, netflix, time warner cable, verizon
Reader Comments
Subscribe: RSS
View by: Time | Thread
And if...
[ link to this | view in chronology ]
I don't disagree there's a difficulty in pinpointing the problem, but how many times has Techdirt reported the "bandwidth clog" is a mere myth?
Thing is: it can't be both. There's either a bottleneck (clog) or there's not, and having any company pay to rid the issue is the first step in destroying the internet.
Think about it. If no one is actively engaged to solve the problem, then how is this not a problem in itself? Many people are using network tools to prove there is a problem somewhere.
Those who are serious in fixing the issue can't use the same tools between access points? I'm not buying it.
In fact, what I will buy is all these parties to send video from one server to a player on a consumer's system is doing everything in their power to collect more and more fees.
Any time there's a MitM, the customers lose and everyone else wins.
The internet has far too many MitMs controlling flow.
It's time for a monopoly.
[ link to this | view in chronology ]
Re:
FTFY: "it will destroy the American Internet". Guess what: there's more of Internet than Netflix and Comcast.
[ link to this | view in chronology ]
Re: Re:
Guess what, if Comcast can get Netflix to pay up for higher speeds then they can get others to pay up to. That's the danger we've been warning about, putting up that added tax on the Internet that harms tech start up companies most of all.
[ link to this | view in chronology ]
Re: Re: Re:
Now that Comcast has tasted sweet, sweet cash, it's just a matter of time before it goes after Google, Sony (Crackle), Disney (ESPN), and any other content pusher, regardless of "degradation" of connection.
This whole deal stinks like DarkHelmet's feet.
[ link to this | view in chronology ]
Re: Re: Re:
[ link to this | view in chronology ]
Re: Re: Re: Re:
Yes, it is paying for higher speeds. The consumer is being charged to have traffic delivered to them and the content provider is being charged to deliver the content. and since there is little competition in the U.S. consumers pay more for worse service.
[ link to this | view in chronology ]
Re:
never, as far as I remember. What Techdirt has reported is that a bandwidth shortage is a myth. "Clogs," n other words overloaded chokepoints, as and always have been very real.
They're also relatively cheap and easy to resolve for the owners of the system where the chokepoint exists.
[ link to this | view in chronology ]
Re: Re:
DWDM equipment to support 100Gbps connections can be quite costly in both modules (Cisco CPAK) and equipment to support it. It's one of the reasons people are still prefering SFP+ 10Gbps connections and bonding, but it probably wouldn't scale well for very large interconnections like Cogent and Comcast. Comcast uses Ciena equipment and does have a deal with them, so it might be a bit cheaper but not by that much.
[ link to this | view in chronology ]
Re: Re: Re:
[ link to this | view in chronology ]
Re: Re: Re:
[ link to this | view in chronology ]
This was not a good move by Netflix, even if they see the majors as having them by the balls.
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
A neutral network is one where filtering is performed at the protocol layer and not at the application layer. So filtering 'internet video' is not an example of neutrality violation, but filtering 'netflix' would be, if YouTube was left alone.
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
Destruction
They haven't disclosed the terms of this agreement, but Netflix doesn't have very much margin at all to play with. They had only $112 million in net income for all of 2013. How long is that going to last if they've got the major ISPs lining up with their hands sticking out, right behind the movie studios?
Either they'll have to jack prices (and watch subscribers jump ship), or hemorrhage money. Either way, they're in trouble. "House of Cards," indeed.
(I don't actually have a dog in that fight...I will never be a Netflix customer, because they sent me unsolicited commercial E-mail. I do not do business with spammers.)
[ link to this | view in chronology ]
Re: Destruction
[ link to this | view in chronology ]
Re: Re: Destruction
Seriously though, that it's public knowledge that Netflix is willing to pay off/bribe/pay a toll in order to keep their customer base satisfied, it won't be long [I'd say a month or so] before all ISPs big and small are lining up to get their pound of flesh from the company's net income.
And it's not just the US ISPs we have to worry about. I can see a future worldwide ISP dogpile on Netflix thanks to this announcement.
[ link to this | view in chronology ]
Re: Destruction
Not to mention that you may at some point in the last decade have agreed to have your email sold for marketing purposes, meaning you solicited the spam you're getting. Or maybe you're just the purest of web surfers?
It amazes me where people draw the line.
[ link to this | view in chronology ]
Re: Re: Destruction
I'm amazed you encourage their behavior by not considering these items.
[ link to this | view in chronology ]
Re: Re: Re: Destruction
[ link to this | view in chronology ]
Re: Re: Re: Destruction
But Netflix's problem can be neatly summed up as: "Once you pay the Danegeld, you never get rid of the Dane."
[ link to this | view in chronology ]
Re: Re: Destruction
I don't do business with companies that send me spam, either, and I get along just fine! Spammers are scum.
"you may at some point in the last decade have agreed to have your email sold for marketing purposes, meaning you solicited the spam you're getting."
I've never done so knowingly, and if I did so without knowing it, then it's still spam regardless of what the legalities might be. Spammers are scum.
"It amazes me where people draw the line"
What's so amazing about wanting to discourage spam?
[ link to this | view in chronology ]
Re: Destruction
These assumptions may obviously not be true. Netflix may be paying Comcast a higher per unit price than Cogent. And I'm sure there are plenty of fixed costs and overhead involved with dealing with more ISPs, rather than just one. But it's theoretically possible at least for these deals to be structured in a way that has a negligible impact on Netflix's bottom line.
[ link to this | view in chronology ]
Macro
______________________________
Only if you're a moron who can't see the bigger picture.
[ link to this | view in chronology ]
Re: Macro
[ link to this | view in chronology ]
Re: Re: Macro
[ link to this | view in chronology ]
Re: Re: Re: Macro
Oh I don't know. Maybe not today, but in a year, maybe two, or sooner with quarterlies, a careful reading of financial statements might indicate changes. A good analyst might sus out just what actually happened. Or come really close.
[ link to this | view in chronology ]
Re: Macro
Except Comcast gets more money, Netflix pays the same or less for more efficient transfer, and consumers get better streaming at probably the same price.
The probably isn't with THIS deal, the problem is with the precedent it sets and the hikes that will come down the road.
[ link to this | view in chronology ]
Netflix also talking to Verizon
[ link to this | view in chronology ]
Speaking of VPN's... and again I'm no expert. But this entire situation has led me to do quite a bit of research and I've come to the conclusion that regardless of your internet usage, a VPN is a good idea... especially if you use one that takes privacy and security seriously, preferably one outside the U.S.
[ link to this | view in chronology ]
cogent
While I agree this may not be a good precedent, Cogent is as much at fault here as anyone.
[ link to this | view in chronology ]
How to Make Switches Cheap, (to: Michael Becker, #19, Anonymous Coward, #20 )
This was a recurrent event in the emergent mass-production industries. They tended to bring out the bottlenecks in tools designed for custom production, and, every so often, heated exchanges took place.
The same thing applies to Telco/ISP switches. Naturally, Cisco is not very keen on the idea of a switch built on the Redundant Array of Inexpensive Devices principle, but a certain sort of customer will simply have to insist, even to the point of building its own. The designer will simply have to find out what kinds of mass-produced components are inexpensively available, and devise some means of hooking them together to form a big system. For example, I find that there are some Ethernet switches intended for hooking offices full of diskless desktop computers together, so that they can boot from a common server, and be centrally managed, and that these switches are very powerful and quite inexpensive, say 50 Gbits for a thousand dollars. There are vastly more such offices than there are Telco switchrooms, so a greater economy of scale exists (*). With modifications of firmware, it ought to be possible to find ways to hook up arrays of such machines to make a central switching office.
(*) parallel example: In railroading, there is something called a Genset locomotive, developed by the Union Pacific Railroad, which is powered by three 18-wheeler truck engines. There are about a hundred trucks for every locomotive, and a truck engine is much more of an off-the-shelf item than a locomotive engine.
[ link to this | view in chronology ]
Extortion
[ link to this | view in chronology ]
Falling Away From Logistics
NetFlix chose not to find a means of shortening its physical logistic lines, something like Redbox. More generally, whenever someone has a business model which essentially involves sitting behind a website and trading stuff, that is a danger sign. The winners will be the ones who are doing something meaningful on the ground.
[ link to this | view in chronology ]
Re: Falling Away From Logistics
Netflix still rents disks, and it's a better selection of films on DVD and Bluray than streaming offers.
They're on the streaming bandwagon because it's bringing lots and lots of customers to the service - more than the disc rental service ever could - because it's a much easier way to watch movies.
[ link to this | view in chronology ]
Nexflix is fine to make whatever deals they want, as a company that has made some money, this might not be a bad way to add another layer of cost on any new competition.
[ link to this | view in chronology ]
This way, Netflix subscribers that use Comcast will stream from a server at Comcast, where it doesn't use any upstream data.
[ link to this | view in chronology ]
Costs to Netflix unknown
Nobody knows what Netflix has agreed to pay, now and in future, who is not in on the details of the contract. And that means nobody outside Netflix and Comcast.
Some other blogger offered that this must be a lower amount, because "why would Netflix pay Comcast more than they were paying Cogent? They wouldn't." But maybe Netflix might pay more so that customers could watch Netflix streaming and not cancel the service, and watching on Comcast was becoming, according to a lot of people, unwatchable.
So, yeah, nobody knows -- but there is a good reason why Netflix would pay Comcast more than they paid Cogent. And there is every reason why we should expect that Comcast would seek just as high a fee as they possibly could get.
[ link to this | view in chronology ]
used semi-trucks
[ link to this | view in chronology ]
Service quality maybe a big problem.
[ link to this | view in chronology ]