Twitter Could Be A Good Predictor Of Box Office Sales

from the crystal-ball dept

Twitter is very useful for figuring out "what is happening right now." For example, Twitter has been used to figure out where an earthquake is happening. But instead of what's happening now, can it also be useful for telling what will happen in the future? Two researchers at HP Labs, Sitaram Asur and Bernardo A. Huberman, postulate that Twitter can actually be used to predict future box office results for movies. By building a computer model around the tweets for 24 movies, they claimed were able to predict the opening weekend box office results with 97.3% accuracy. An accuracy of around 97% seems unnaturally high, so I dug a little further into the actual report and found that both of these numbers were a result of combining each approach with the number of theaters associated with each release. Without taking into account the number of theaters in the release, tweets alone were able to predict at 93%. According to Asur, the correlation between theater counts alone and box office results is a paltry 39%. Considering that theater counts are probably a good indication of how well a studio thinks a film is going to perform, it seems that Hollywood should take notice of these forecasts.

The supposed gold-standard of box office predictions is Hollywood Stock Exchange, a prediction market. The researchers found that HSX had a 96.5% accuracy (when also combined with number of theaters). It's impressive that HSX gets a fair amount of accuracy despite it using "fake" currency. HSX is currently awaiting a ruling from the U.S. Commodity Futures Trading Commission that will allow it to trade using real money. When that happens, the accuracy of its prediction market should increase. At that point it may be interesting to see how much more closely the two prediction systems compare, since the apparent edge that the Twitter algorithm has right now seems too small to be significant.

In any case, with Twitter, since it's also a communications medium, tweets about a movie not only indicate interest, but also can ultimately influence a movie's sales at the box office. However, this effect seems distinctly different than the traditional notion of "observer effect," since the act of measuring the interest in a movie can actually occur without directly participating in the Twitter conversation. That said, if it becomes common practice to predict box office success by analyzing Twitter, the incentive to exploit this by spamming Twitter with tweets about an upcoming movie increases greatly. After all, the many predictions that foretold that Avatar would break box office records certainly played a self-fulfilling part in its breaking of those box office records. Furthermore, Tweets were taken for the 7 days before the weekend -- which means there would not be enough time to make any adjustment to any marketing (in the event of a dire prediction), and certainly not to production budgets, which have already been spent.

So, while, in their report, Asur and Huberman conclude:
While in this study we focused on the problem of predicting box office revenues of movies for the sake of having a clear metric of comparison with other methods, this method can be extended to a large panoply of topics, ranging from the future rating of products to agenda setting and election outcomes. At a deeper level, this work shows how social media expresses a collective wisdom which, when properly tapped, can yield an extremely powerful and accurate indicator of future outcomes.
The simple fact is that there is still quite a chasm to cross before Twitter can be used practically for any type of prediction or forecasting activity.
Hide this

Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.

Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.

While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.

–The Techdirt Team

Filed Under: forecasting, movies, predictions, twitter
Companies: hp, hsx, twitter


Reader Comments

Subscribe: RSS

View by: Time | Thread


  1. identicon
    Anonymous Coward, 6 Apr 2010 @ 9:04pm

    not now it wont

    haha

    link to this | view in thread ]

  2. icon
    Pontifex (profile), 6 Apr 2010 @ 9:06pm

    The earthquake story reminds me of a recent xkcd comic:
    http://xkcd.com/723/

    link to this | view in thread ]

  3. identicon
    Anonymous Coward, 7 Apr 2010 @ 12:31am

    Snakes on a Plane.

    link to this | view in thread ]

  4. icon
    PaulT (profile), 7 Apr 2010 @ 2:01am

    Re:

    Damn you, Pontifex, that was what I was going to post!

    Anyway, this should not be a surprise to anybody with half a brain or an understanding of how the market has traditionally worked (which sadly leaves out many studio executives). Word of mouth has always been an important indicator of general awareness, and an important tool to promote a movie. Twitter simply moves this online, publicly visible to all.

    Of course, the marketplace can be fickle, and the online buzz around a particular movie can help drive its success (Paranormal Activity) or lead to inflated expectations that aren't met (Snakes On A Plane). High tweeting levels don't necessarily lead to financial returns, but it's a great tool if looked at correctly and not in isolation.

    link to this | view in thread ]

  5. identicon
    enrolled agent test, 7 Apr 2010 @ 3:22am

    "Twitter is very useful for figuring out "what is happening right now." For example, Twitter has been used to figure out where an earthquake is happening. "

    Damn! Either the person who did this is courageous, or he's just plainly a Twitter addict. ^_^

    link to this | view in thread ]

  6. identicon
    Gumnos, 7 Apr 2010 @ 4:51am

    And in other news...

    a movie called "RT" will be coming out shortly...a somewhat inane plot line, but the twitter predictors are OFF THE CHARTS!

    link to this | view in thread ]

  7. identicon
    Anonymous Coward, 7 Apr 2010 @ 5:05am

    Are you allowed to tweet during the movie?

    link to this | view in thread ]

  8. icon
    fogbugzd (profile), 7 Apr 2010 @ 7:00am

    Convergence

    The Exchange will probably get closer to the predictions of social networks because the people who are really serious at playing the exchanges will probably start incorporating social network-based predictions into their buy-sell decisions.

    link to this | view in thread ]

  9. identicon
    hegemon13, 7 Apr 2010 @ 12:41pm

    Really?

    "After all, the many predictions that foretold that Avatar would break box office records certainly played a self-fulfilling part in its breaking of those box office records."

    Funny, all the articles I read prior to it's release focused on the high budget and said it was unlikely to make back that budget. Could just be the sites I frequent, but I saw FAR more negative predictions than positive ones before Avatar's launch. I must admit, I thought that they were probably right. I guess I should have had more faith in the Cameron blockbuster machine.

    link to this | view in thread ]

  10. icon
    Dennis Yang (profile), 7 Apr 2010 @ 6:01pm

    Re: Really?

    Related to this, the researchers found that the *number of tweets* had a good correlation to the opening weekend numbers. The sentiment (positive/negative) of the tweets did not really affect the first weekend numbers -- however, sentiment did start having an affect starting week 2.

    So, the moral of this story is that a ton of chatter (good or bad) will get you a great opening weekend, but sustaining power is netted by if people actually liked it...

    link to this | view in thread ]


Follow Techdirt
Essential Reading
Techdirt Deals
Report this ad  |  Hide Techdirt ads
Techdirt Insider Discord

The latest chatter on the Techdirt Insider Discord channel...

Loading...
Recent Stories

This site, like most other sites on the web, uses cookies. For more information, see our privacy policy. Got it
Close

Email This

This feature is only available to registered users. Register or sign in to use it.