« McCain Campaign: Exit Polls Will Overstate Obama Numbers | Main | A Memo I'm Half-Expecting To See »

The Blumenthal Scenarios: What If We're All Wrong?

03 Nov 2008 04:44 pm

Pollster.com's Mark Blumenthal on big three potential problems:

Will the growing number of voters reachable only by cell phone make polls less accurate? (Only in Obama's direction.)

Are likely voter models missing a surge of new voters?  (Probably not.)

What about the Bradley Effect?  (There's very little evidence for it.)

And the nightmare scenario for Democrats...

What if those who refuse to take pollsters' calls  -- remember, response rates for polls are usually less than 50% --  vote disproportionately for McCain?

This concern is far from trivial, as even the most rigorous national surveys struggle to achieve response rates over 30 percent. And it is hard to know much for certain about those who do not respond because, obviously, we cannot interview them.

One way that pollsters can study the potential impact of non-response is to look at the most difficult-to-interview respondents. In 1997, the Pew Research Center conducted an experiment  that involved an unusually rigorous attempt to "convert" to respondents those who initially refused to participate in the survey. They found "strikingly different views" among white respondents "on several race-related questions, with reluctant respondents significantly less sympathetic than amenable respondents toward African-Americans."

Pew could not replicate those findings in a follow-up study conducted in 2003. Still, Andrew Kohut, president of the Pew Research Center, says Pew has always had a harder time completing interviews with a cohort of older, white, less well-educated respondents who typically demonstrate less tolerance on race-related questions. Kohut told me that they identify a demographic cohort that should be 29 percent of adults, but typically represents 20 to 25 percent of adults in their unweighted samples. While they always weight this group up to its appropriate level, he could not rule out the possibility that the missing respondents may be those with less racial tolerance, as they were in Pew's 1997 study.

Although Kohut remains uncertain about how much of problem these harder-to-reach respondents might be, he considers it something "small to worry about" that might mean at most a percentage point or two in the results, not a game-changer for a candidate with a lead as large as Obama's.

Hopefully, we learned from this year's New Hampshire primary to never say never about the potential for a polling failure. Still, all signs from the polls point to an Obama victory.


Comments (12)

We get these stories all the time just before an election, and they really don't matter nearly as much as this. The NH primary was a specific case with some weird aspects to it (artificial boost to Obama's numbers from Iowa without time for him to firm them up, Independents being assigned to Obama in polls who ended up voting for McCain, strong Clinton organization in NH which makes a bigger diff in a smallish primary like NH, etc).

At most, all of this means just a point or two either way. Obama has a commanding lead. He'll probably get the maximum 2-3 point benefit of field work advantage.

It's all over but the counting.

This effect, if it exists, would have been captured as part of the Bradley effect since it is part of the difference between polled estimations and the final result.

Which is to say, this may or may not exist, but if you want to believe in this, you have to believe that the Bradley effect is real.

One huge wild card is the effect of voter suppression and voting machine fraud -- it could potentially be 3-5% in some states. I'm surprised Blumenthal didn't cover that.

Oh for Jesus Christ. We'll find out tomorrow, frickin 24 hours from now. The die is nearly cast people. Let it go.

LOL. Think about what this is *really* saying: People who weren't polled aren't represented in the poll, and those people could be racists, therefore the polls could be wrong. Are you kidding me?

And the polling failures from New Hampshire cannot be explained based on the race factor. The best explanation for those polls being off is the "fluidity" of voters; people were not firm in their commitment to vote for one candidate over another. This was further complicated by having the first woman vs the first black man, and by the 5-day time frame some of the polls were conducted (rushed?) btw Iowa and New Hampshire. In the general, we've got trends and averages...multiple models, etcetera, so the margins for error are more stable...

The nightmare scenario for the Dems is if people wake up in time. Fingergate II, the coal issue, and BHO wanting to deport his own aunt while letting millions of other illegal aliens stay here should help.


The ONLY election where these alleged 'truths' seemed to have shown themselves was in exactly 1 state - Ohio, in few districts, in 2004, as reported by Zogby, who went out of his way to make excuses.

I still believe, to my dismay, that like 2000, the election was decided based on fraud, and a dismembered disorganized DNC up against a well organized RNC.

I do not believe we will see that happen this year. 1) the poll results, even by GOP pollsters who have released their numbers, show Obama taking the election with at least 300 electoral votes - along with every other survey.

The ONLY reason the polling data (and most pollsters use a random number generator to create blocks of numbers in cellphone exchanges, and a lesser number based on information on unlisted phones, in states where voters do not include their phone number when they register to vote, or numbers are not 100% available from public and built-off-public and purchased databases) would be off would be if there were some reason McCain supporters are not as proud of their man as Obama voters are proud of him.

There are NO behavioral factors (including the rhetoric shouted by some at McCain rallies) to show they are ashamed of their vote or particularly reluctant, as a group, to be unhappy with their candidate, enough to hide their choice or run away from exit pollsters.

If the exit polls do not match the returns from those key polling places where they are taken, call the cops and the lawyers.

Serious question: do these difficult-to-reach people vote?

Hi Marc,

Do yo regret voting for McCain/Palin? A couple of weeks ago you informed us that you had sent in your absentee ballot in support of those two. At the time you didn't explain your action

I wonder if, upon further reflection, you have any regrets. A blog entry justifying or attempting to excuse your vote would, I dare say, interest many of your readers.

Peter

My husband refuses to talk to pollsters, so goes down as "undecided," I'm sure, since he's too polite to just hang up.''

But he's not undecided, he'd just one of those folks who's quaint enough to think his vote is private. (Hint: he's also disgusted with the incompetence of the last eight years and will not reward it.)

I'm betting there's lots of other folks like him -- people who just don't think it's anybody else's business but the voting booth.

I am older (53), white, and have a Master's degree....and I HATE pollsters.

One thing that the article does not bring up but I saw on TV last night is that Obama has such a enthusiastic following that a larger number of his backers may be willing to talk to pollsters than those who back McCain.

Either way we will know tonight.

I think people are unrealistic about the underlying racist attitudes in this country still.

I have seen people that I would have never though harbored a racist thought come out and blatantly say they might be racists.

My concern for Obama is the over-enthusiasm of his supporters and the closet racist Democrats that will not vote or vote for McCain which could be disastrous in ethnic districts of Detroit and Philadelphia. If McCain pulls nearly even in Philadelphia with Obama, he could steal those electoral votes.