Didn't We Already Do This? Press Relies On Questionable Stats To Claim Instagram Lost Half Its Users

from the they-didn't dept

Ah, whatever happened to good, old fashioned, fact checking. It was just a few weeks ago that many people were writing about how the press had been confused by data claiming a massive drop in Instagram users following its terms of service kerfuffle. Of course, it later came out that the data from Appdata, was suspect, as it only looked at Instagram usage on Facebook, despite the fact that most Instagram usage is done directly through its app on mobile phones. So here we are a few weeks later... and a bunch of news sources, including Wired, are reporting that Instagram has lost half of its daily users. This is based on data from a different organization, AppStats, but appear to suffer from the exact same flaw: it only looks at app usage on Facebook, which is a minority of Instagram usage. There may or may not be trouble with Instagram usage, but shouldn't the press by now be at least a little skeptical of claims based on dodgy data?

Filed Under: data, statistics, terms of service
Companies: appdata, facebook, instagram

Doing Data Journalism Badly

from the flop dept

While there was a lot of rhetoric concerning the Instagram terms of service mess recently, most observers of these kinds of things noted that for all the claims from people that they were "quitting" the service, few people ever actually follow through on such threats. So, it surprised some this morning when the NY Post reported that Instagram users actually did flee in large droves, citing data from a company called AppData. They argued that there was a potential 25% decline in users, which is huge. The news apparently contributed to Facebook's stock dropping by nearly 3%... despite the claim being almost entirely bogus.

Even a quick look at the data that AppData presented should have raised some eyebrows: As lots of folks pointed out, starting with Zachary Seward at Quartz (linked above), the drop shown does not occur until December 24th... a good week after the whole controversy went down. Furthermore, AppData does not measure all Instagram usage at all, but the small subset of people who have connected their Instagram accounts to their Facebook accounts. But most people just use Instagram as a mobile app, and AppData doesn't measure that.

Meanwhile, Robin Wauters over at TheNextWeb does a brilliant job of showing plenty of other services that AppsData's "data" also shows "plunged" during the same time period, including Yahoo! Social bar, which shot up... and then back down: Or Pinterest, which dropped a bunch during that same time period: Wauters lists a bunch of other examples as well, all suggesting that maybe the original claim by AppData, repeated by the NY Post (and then others) had little basis in reality.

Filed Under: data, journalism
Companies: appdata, instagram, ny post