Obama's Tech Team Was Firing On All Cylinders While Romney's Was Still In Beta
from the wow dept
Obviously some of the following may be biased by the hindsight view of who won and who lost -- but it's fascinating to see two very, very different stories emerge about the technology/data teams involved in the two major party presidential campaigns. Right after the election, Time published an account of a massive and extremely sophisticated datacrunching team working to get President Obama re-elected.The new megafile didn’t just tell the campaign how to find voters and get their attention; it also allowed the number crunchers to run tests predicting which types of people would be persuaded by certain kinds of appeals. Call lists in field offices, for instance, didn’t just list names and numbers; they also ranked names in order of their persuadability, with the campaign’s most important priorities first. About 75% of the determining factors were basics like age, sex, race, neighborhood and voting record. Consumer data about voters helped round out the picture. “We could [predict] people who were going to give online. We could model people who were going to give through mail. We could model volunteers,” said one of the senior advisers about the predictive profiles built by the data. “In the end, modeling became something way bigger for us in ’12 than in ’08 because it made our time more efficient.”Compare that, then, to the data driven efforts on the Romney side. First, the campaign ignored all the public polls that turned out to be fairly accurate and plugged in a bunch of their own assumptions when looking at key variables, all of which made them believe they had a stronger position than it turned out they had. But, much more interesting are the stories coming out about ORCA, the Romney campaign's secret computerized weapon in the "get out the vote" effort. It's like the exact opposite of the description of the Obama campaign's data tool.
Early on, for example, the campaign discovered that people who had unsubscribed from the 2008 campaign e-mail lists were top targets, among the easiest to pull back into the fold with some personal attention. The strategists fashioned tests for specific demographic groups, trying out message scripts that they could then apply. They tested how much better a call from a local volunteer would do than a call from a volunteer from a non–swing state like California. As Messina had promised, assumptions were rarely left in place without numbers to back them up.
Romney campaign volunteer John Ekdahl's description of how poorly planned out ORCA was is a must-read. It really sounds like the team there didn't do much testing, and failed to consider how the system would work under load. From the explanations, it also sounds like they didn't do much usability testing, or even think through some basic use cases. It sounds as though either the Romney team didn't think ORCA was ready or they didn't want to "reveal" it until the last minute to avoid tipping their hand to Obama's campaign. The night before the election, they sent volunteers who were supposed to be poll watchers a huge PDF with instructions -- expecting them to print it out, which isn't so easy for everyone these days. They also forgot to tell them they needed to get and bring their "poll watcher certificate" to polling places. And they didn't release the actual app until 6am on election day, giving volunteers no time at all to learn how it worked (or to report bugs).
Now a note about the technology itself. For starters, this was billed as an "app" when it was actually a mobile-optimized website (or "web app"). For days I saw people on Twitter saying they couldn't find the app on the Android Market or iTunes and couldn't download it. Well, that's because it didn't exist. It was a website. This created a ton of confusion. Not to mention that they didn't even "turn it on" until 6AM in the morning, so people couldn't properly familiarize themselves with how it worked on their personal phone beforehand.A different report points to similarly massive problems with other aspects of ORCA, including handing out the wrong PINs, making the app useless in Colorado (and possibly elsewhere):
Next, and this part I find mind-boggingly absurd, the web address was located at "https://www.whateveritwas.com/orca". Notice the "s" after http. This denotes it's a secure connection, something that's used for e-commerce and web-based email. So far, so good. The problem is that they didn't auto-forward the regular "http" to "https" and as a result, many people got a blank page and thought the system was down. Setting up forwarding is the simplest thing in the world and only takes seconds, but they failed to do it. This is compounded by the fact that mobile browsers default to "http" when you just start with "www" (as 95% of the world does).
By 2PM, I had completely given up. I finally got ahold of someone at around 1PM and I never heard back. From what I understand, the entire system crashed at around 4PM. I'm not sure if that's true, but it wouldn't surprise me. I decided to wait for my wife to get home from work to vote, which meant going very late (around 6:15PM). Here's the kicker, I never got a call to go out and vote. So, who the hell knows if that end of it was working either.
Then at 6PM they admitted they had issued the wrong PINs to every volunteer in Colorado, and reissued new PINs (which also didn't work). Meanwhile, counties where we had hundreds of volunteers, such as Denver Colorado, showed zero volunteers in the system all day, but we weren't allowed to add them. In one area, the head of the Republican Party plus 10 volunteers were all locked out. The system went down for a half hour during peak voting, but for hundreds or more, it never worked all day. Many of the poll watchers I spoke with were very discouraged. Many members of our phone bank got up and left.Once again, I'm sure that the Obama system wasn't nearly as perfect and all-knowing as the Time article describes. Nor was the Romney system a total disaster as described in those links -- but it is fascinating to see these stories emerge following the election. Given the Obama win, along with these stories about that datacrunching effort and the worldwide reverence towards Nate Silver, you can bet that everyone gunning for the 2016 nomination is going to spend some time trying to build up a killer technical/data team.
Thank you for reading this Techdirt post. With so many things competing for everyone’s attention these days, we really appreciate you giving us your time. We work hard every day to put quality content out there for our community.
Techdirt is one of the few remaining truly independent media outlets. We do not have a giant corporation behind us, and we rely heavily on our community to support us, in an age when advertisers are increasingly uninterested in sponsoring small, independent sites — especially a site like ours that is unwilling to pull punches in its reporting and analysis.
While other websites have resorted to paywalls, registration requirements, and increasingly annoying/intrusive advertising, we have always kept Techdirt open and available to anyone. But in order to continue doing so, we need your support. We offer a variety of ways for our readers to support us, from direct donations to special subscriptions and cool merchandise — and every little bit helps. Thank you.
–The Techdirt Team
Reader Comments
Subscribe: RSS
View by: Time | Thread
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
I'm also not sure why a regular BI system couldnt easily handle this problem.
[ link to this | view in chronology ]
Data Crunching Wasn't the Only Factor
Unless the campaign pays attention to the facts, and not their own hopes/fears/assumptions, it won't matter how much data they have or how well they crunch it, they'll still lose.
Put 20 tons of hopes/fears/assumptions in the left hand pan of the scale, put one ounce of fact in the right. The left hand pan will soar as the right hand pan hits the table with a loud thud.
[ link to this | view in chronology ]
Re: Data Crunching Wasn't the Only Factor
[ link to this | view in chronology ]
Re: Re: Data Crunching Wasn't the Only Factor
Romney's people didn't actually believe their spin, they just hoped enough other people would to turn the tide. The media preferred their version because a close race draws more interest.
[ link to this | view in chronology ]
Re: Re: Re: Data Crunching Wasn't the Only Factor
[ link to this | view in chronology ]
Re: Re: Re: Re: Data Crunching Wasn't the Only Factor
"Oh, those pesky polls! They're all biased to those darn pinko-commie-liberals! Use THESE polls, they're much better because they make us think all of AmurrriKKKa is with us!
"Someone get me my Metamucil! I'm feeling a bit plugged up with my own bullshit!"
-Mitt Rmoney
[ link to this | view in chronology ]
Re: Data Crunching Wasn't the Only Factor
No shocking news here.
[ link to this | view in chronology ]
The Romney campaign got sucked into the pro same syndrome that has struck the entire conservative movement. Doctrine is king. All data is viewed through the lens of beliefs and dogma. Karl Rove is now the poster child of this policy. After every major network (including Fox) had called Ohio for Obama Rove was still insisting that Romney had won it. Rove was so insistent that Fox even sent a reporter to grill one of Fox's own data analysts on why they had called Ohio. It was kind of amusing to watch this poor, wide-eyed data analyst who didn't expect to be on live TV defending his findings against Fox orthodoxy.
[ link to this | view in chronology ]
Re:
[ link to this | view in chronology ]
[ link to this | view in chronology ]
I got Obama pitches and responded to them
In other words, I was conscious of the process and liked the fact that I got a variety of different emails and some were so effective that I would donate on the spot. Of course, there were other factors. The election looked close and I was seeing some of the outrageous claims being made on the other side, which got me mobilized. I felt it was important to be involved this time.
But yes, the Obama campaign was so good at knowing what might interest me. I've never seen another email campaign by anyone, any company work so well. In fact, one reason I don't trust Facebook is that it keeps sending me pitches that appear to be personalized, but are totally wrong for me. So whatever info they have on me is either wrong, or the company is misinterpreting it. If a company is collecting data on me and it is giving me an inaccurate picture of me, I am very worried.
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Re:
If I understand the term correctly, these are people who make sure that if the lines get long, they encourage people to stay in line to vote. They make sure those in line have the proper identification so they can vote. They also make sure people at the polls aren't given misinformation and turned away when they shouldn't be turned away.
I don't go to the polls on election day (I vote early), so I haven't seen poll watchers in action, but all of the above is what I am aware people were doing on election day to make sure everyone who wanted to vote got to vote.
[ link to this | view in chronology ]
Re:
1) Collect the names of the people you expect (or hope you can convince) to vote for your candidate ahead of time.
2) Categorize them as how much help they need to vote; i.e. pushing via calls, etc.
3) Guess when they should (by time) vote.
4) Track who votes at each poll on voting day.
5) If a voter does not show up when expected, call them. If they need help getting there send someone to pick them up, etc.
Obama's team has been as master of this like no other.
[ link to this | view in chronology ]
Re: Re:
The video of Obama thanking the campaign workers in Chicago is so relevant given the amount of work those workers (both there and across the country) gave to the campaign. In Boulder, at the office where I was, the two campaign office managers grabbed lists and hit some college areas about one hour before the polls closed. And these were areas where walkers had already knocked on doors at least once on Monday and at least twice on Tuesday. Every vote was considered worth making an extra effort for.
[ link to this | view in chronology ]
Re: Re: Re:
President Obama: "I'm Really Proud of All of You." - YouTube
[ link to this | view in chronology ]
Re:
Poll Watchers: Poll Watcher Appointments
There are three categories of observers who are permitted in polling places:
“Official Observers” -- credentialed by Colorado Secretary of State or by federal government.
“Media Observers” -- credentialed members of news media.
“Poll Watchers” -- credentialed by county Clerk and Recorder. This page tells you how to get your poll watchers credentialed.
-----------
Board of Election Commissioners for the City of Chicago: A poll watcher is a representative of a candidate, political party, civic organization or proposition who is legally in the polling place to observe the conduct of the election. All poll watchers must be registered voters in Illinois.
[ link to this | view in chronology ]
Re:
Beyond the technical explanations that others gave, campaign pollwatchers are a big part of the "get out the vote" effort. They know who's registered in what polling place, and they basically "eavesdrop" on who is signing in to vote. This way they can keep tabs on who HAS NOT voted, and then target them with phone calls, visits later in the day if they think those people are important to voting for their candidate.
That's what ORCA was all about. It was supposed to track who had voted, so they would have a huge database of who they had to help/encourage to go out and vote. Without that data, they didn't have that effort targeted, and likely got out a lot less of the vote.
[ link to this | view in chronology ]
Re: Re:
Another thing they did was to have big events where to get a ticket you either needed to be currently volunteering or willing to volunteer.
[ link to this | view in chronology ]
Re:
I was in one of those offices and I was handing out canvassing sheets to walkers. On the day of the election, the sheets I had were not updated during the day. They were just handed out multiple times to volunteers going door to door. There were other people doing phone calling and perhaps they got frequently updated lists.
According to what I have read the Romney and the Obama poll watchers had mobile apps allowing them to report voters as they passed through the poll check in. Romney's system evidently didn't work properly.
I never had an overview of the Obama system and never asked. So most of what I have learned about poll watchers has come from what I have found online, not what I was able to witness on election day.
But I did see how hard paid staffers and volunteers worked. There was a lot of effort involved. I was there multiple days and hours before election day and on election day. I saw a lot of blocks walked. A lot of phone calls made. A lot data entered. A lot of events organized.
[ link to this | view in chronology ]
Isnt it ironic, dontcha think?
[ link to this | view in chronology ]
Re: Isnt it ironic, dontcha think?
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Who lost: The people.
What else is new?
[ link to this | view in chronology ]
Re:
Who lost: The people.
Since I think some commons and co-operative forms of organization are necessary to protect and deliver certain property, I believe we'll always have a type of "government." I don't think we'll have a world where everyone operates unto himself.
So I have never been against "government." For me it's an on-going discussion of what kinds of government. Even churches and homeowners associations are forms of government. Any group that attempts to create some rules and owns collective property operates as a "government."
[ link to this | view in chronology ]
Well it's about time. Finally, politics will actually lead to genuine job creation.
[ link to this | view in chronology ]
It wasn't just data, but also manpower
What the data was able to do was to identify the best people to focus on and the most effective pitches, but the campaign still depended on a lot of personal contact. If you don't have a grassroots army of people to work the campaign, you are at a disadvantage.
[ link to this | view in chronology ]
Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Technology had nothing to do with it
Do you really want to get into a discussion about the tax breaks for the wealthy -- both individuals and corporations?
If we are talking about people who work hard, let's hear it for those who do manufacturing and day labor, and who take care of the elderly and the disabled. Do you really think those on Wall Street who push around lots of numbers without actually creating much of real value are working hard?
[ link to this | view in chronology ]
Re: Technology had nothing to do with it
Noahpinion: Asian-Americans destroy the "maker/taker" narrative: "As you can see, the 'maker/taker' narrative has a strong ethnic angle; the 'takers' are supposed to be mostly minorities and single women. White men and their wives produce things; blacks, Hispanics, and sluts single women live on the dole. Naturally, this ethnic angle plays well with the conservative 'base', i.e. Southern and exurban working-class whites for whom politics is ethnic and tribal.
[ link to this | view in chronology ]
Re: Re: Technology had nothing to do with it
You do realize the middle class is walking a tightrope without a net? A guy I know, through a poor choice of his own right before the economic collapse lost everything but a $4000 car. He was $50000 in debt and was refused help until he got rid of the car. This guy has a masters degree and spent 20 years working professionally and got nothing out of the tax dollars he paid. But walk in having never earned a thing and you will get signed up for half a dozen programs.
this is not sustainable.
[ link to this | view in chronology ]
Re: Re: Re: Technology had nothing to do with it
However, Republicans wouldn't go through with these plans either. If the Republicans slashed government jobs, government contracts, and government transfer payments, the economy would fast slip back into recession.
Because I am all about sustainability, I don't believe we can have an endless growth economic model. I think the shareable movement, where people try to get by on less is better for the planet.
I saw what happened during the Bush administration (a combination of government spending and tax cuts resulting in expanding debt) and the Republicans never convinced me they wouldn't do the same thing again if in office. I didn't seen a lot of economic responsibility then and haven't been convinced they actually believe in it.
I don't have a lot of confidence that any President can work miracles, so given that, I'll at least vote for the party that seems the least nasty.
[ link to this | view in chronology ]
Re: Re: Re: Re: Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Technology had nothing to do with it
However, I was really turned off by the Fox viewpoint of the world, so there was no way I was going to vote Republicans given the party's move to the right.
I recommend you read that article I posted if you haven't. Don't just go by the excerpt I quoted. In the full article the author quotes Republicans who do make it a racial issue.
And actually, it works well for the Democrats if Republicans continue to insist Democrats won because voters want something for nothing. As many people are pointing out, the Republicans seem genuinely surprised that Romney lost. The move to the right didn't serve them well this year. This is an increasing diverse country and the politics need to reflect that. The social issues many Republicans were mentioning in their campaigns don't reflect where this country is headed. Sure, campaign on fiscal conservativism, but drop the fight against gays, abortion and birth control, immigration, non-Christians, and so on.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
Second, diversity isn't a problem, the business world is very diverse. It is a problem when half the county is on the public dole.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
As for protecting the fetus, that's cool. But let's follow that all the way and make sure pregnant women aren't exposed to environmental pollutants which might hurt unborn children. Let's hold businesses accountable if they spew stuff in the air or water.
I also feel that if one is truly pro-life, one should oppose capital punishment and war. And I also believe that society must provide a basic level of health care, shelter, and education for all children. If we want all children to be born, let's make sure we set aside enough resources to take care of them, even when their parents can't or won't.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
There are legal complications if we grant those. As I mentioned, if the mother exposes a fetus to something that produces or even might produce a birth defect, should she be jailed? If a company produces a product that results in birth defects or abortions, what should the law do about that? There are many products which can be unsafe for a fetus but are safe after birth. Should we test products for fetus safety? We do to some extent, but our standards could be higher.
I'm after legal and ethical consistency, so I could live with full legal protection of the unborn, but along with a full pro-life policy, I would expect the country to avoid any activity that hurts unborn or born children. I want the pro-life movement to be strongly anti-war and anti-capital punishment as well.
I don't see enough concern for children after they are born, so I view the abortion issue with some skepticism. Let's have a significantly expanded social welfare network for children. That doesn't have to include their parents, but let's make sure all children are taken care of in terms of the basics.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
It's a legal grey area right now. If we do give fetuses full personhood, it will be another way government gets involved in people's lives. Maybe we want that and maybe we don't.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Re: Re: Re: Re: Technology had nothing to do with it
You don't want to see all the info I could show you to suggest a different take on that. Let's just say we support different parties and leave it at that.
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Technology had nothing to do with it
So not only do you not understand the difference between debt and deficit, but you claim that putting Afghanistan and Iraq wars on the budget (rather than hiding their costs) is a bad thing?
Perhaps if you actually understood the issues, you would understand why we voted for Obama.
You've changed your narrative three times now - and brought up "RACISM!" to try to deflect. Please stop, you're not fooling anybody.
[ link to this | view in chronology ]
Re: Re: Re: Re: Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Re: Re: Re: Re: Technology had nothing to do with it
[ link to this | view in chronology ]
Re: Re: Technology had nothing to do with it
Romney Is President - NYTimes.com: "Romney and Tea Party loonies dismissed half the country as chattel and moochers who did not belong in their 'traditional' America. But the more they insulted the president with birther cracks, the more they tried to force chastity belts on women, and the more they made Hispanics, blacks and gays feel like the help, the more these groups burned to prove that, knitted together, they could give the dead-enders of white male domination the boot."
[ link to this | view in chronology ]
Re: Technology had nothing to do with it
The flipside of that is that Romney lost because Republicans offer nothing for something.
ie. if you want your job shipped to China and the elimination of the middle class, Romney was your guy.
[ link to this | view in chronology ]
Re: Technology had nothing to do with it
I'm afraid that for Republicans, it's very much a "do as I say, not as I do" thing when it comes to something for nothing, like free money from the government.
Months ago during the Republican primaries, I remember reading a column or website that detailed how every single one of the 9 people running in the Republican primaries was getting some sort of a rich-person hand-out from the government. Off the top of my head, Bachman, for instance, was getting $80,000 a year for NOT planting a specific crop on a piece of land she owned, plus her husband was getting gum'mint money for his "I can fix that for you" anti-gay "clinic". They were all very savvy about how to apply to the government, and who to apply to, to get free government money.
This doesn't even touch on how most of these loudmouth conservatives are members of the lucky sperm club who got their start in business by touching mumsy or daddy for cash, or getting an inheritance from grandpapa, or asking one of their daddy's friends for a job.
[ link to this | view in chronology ]
Here's more detail about the system
I do know that once a person has voted and that info has been entered into the state system, that info is available publicly. But that doesn't happen instantaneously on election day.
The quote from the article below points out that even if you are monitoring who is voting on Election Day, there is a limit to what you can do as a result. So a lot of the work is done beforehand.
Why Romney's Orca killer app beached on Election Day | Politics and Law - CNET News: "There is only so much resource you can move around at 3:00 p.m. on Tuesday afternoon on Election Day," Issenberg said. "On short notice, you can send robocalls, reorder a call list and employ paid phone banks, but you are not radically changing the shape of the electorate. They acted like they had invented the wheel, but really all it would have been was a slightly better tread on the tire."
[ link to this | view in chronology ]
Here's another good article on data, message, and campaigns
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Re:
If abortion were not available through clinics, some women would still be finding ways to abort. In fact, that was a significant reason it was made legal -- to avoid the dangers of back alley abortions.
So the difference between a woman who goes to a clinic and a woman who doesn't have a clinic to go to but finds a way to "miscarry" may be the same result without the safety of medical follow up.
I'm old enough to remember when there were no legal abortion clinics. In my college dorm, when an unmarried college student thought she was pregnant, she'd be told from other classmates, "I know a doctor. I'll give you his name." That's why I don't want abortion made illegal. I don't want to go back to those days.
But if society is truly concerned about the unborn, let's make sure we offer great options to women who do get pregnant and especially to those children who are born to them. I can get behind making abortions illegal again if as a country we create a model society for children. Let's make it a wonderful world for all children. Let's have a children's bill of rights so that every child born in this country has adequate food, health care, and access to education.
[ link to this | view in chronology ]
Re:
It also doesn't help when your side conflates genuine birth control and abortion, or conception and implantation and viability.
Remember: Every sperm is sacred!
[ link to this | view in chronology ]
[ link to this | view in chronology ]
[ link to this | view in chronology ]
Re:
I say we start by throwing off the shackles we call government. But since I'm an anarchist and you're not, we don't agree on that either.
Are you an anti-abortion anarchist? Kind of an interesting, but potentially dangerous combination. Are women going to be targets of your anarchy?
[ link to this | view in chronology ]
Here's an even more detailed look
Inside Romney's Election Day Collapse - Business Insider
[ link to this | view in chronology ]
Yet another article
So the data was important in keeping track of what was being done and who to contact, but the human interaction was essential to the process.
Jim Messina offers his tips on how Barack Obama’s campaign team beat Mitt Romney. - Slate Magazine
[ link to this | view in chronology ]
And yet another article
It's cool to now know I was a small part of this enormous undertaking.
When the Nerds Go Marching In - Alexis C. Madrigal - The Atlantic
[ link to this | view in chronology ]