Is MPR reconsidering the Humphrey Institute poll?

No poll missed the 2010 Minnesota governor’s race like the MPR/Humphrey Institute poll. The final survey, released five days before the election, had DFLer Mark Dayton up by 12. Dayton currently holds a 0.4 percent lead.

No other media poll during the general election showed Dayton up by double digits.

Republicans — who howl that the HHH poll consistently overestimates DFL leads — were livid. They were ultimately vindicated after their internal poll, released the same day and showing a tied race, proved right on the mark.

But the Minnesota GOP are not the only grumblers. While no one is talking publicly, MPR’s newsroom isn’t happy, either. While the HHH partnership was designed to more deeply measure voter attitudes, it’s no fun to be a political football — especially when your pollster shanks it so badly.

So what is MPR doing about it? That’s a bit opaque. MPR News managing director Chris Worthington says, “Larry and I have already discussed next steps. We didn’t discuss ending the partnership.”

Jacobs: “We are in conversations with MPR about the poll. No talk of altering the partnership.”

The two institutions did unveil a nice election-year feature in 2010: Poligraph. Authored by HHH grad student and reporter Catharine Richert, it may have been this season’s most nuanced fact-checker. So there are reasons for HHH and MPR to stay yoked.

However, I got a tip last week that MPR was concerned enough about HHH’s polling methodology to ask Carleton political science Prof. Steven Schier to vet it.

Worthington says he’s “not asked anybody to review the poll.” But when I asked Schier if MPR had sought an evaluation, he declined to answer.

Likewise, Jacobs ducked my query about what may have gone wrong. But on WCCO’s Sunday Morning, he offered this explanation to host Esme Murphy:

Well, of course, any poll is just a snapshot in time. We’d begun the interviewing almost two weeks before Election Day. Barack Obama visited, and we’d talked openly about the fact that this would likely change. There were, of course, all sorts of other factors that happened at the end, including that the almost one out of five undecided voters started to make up their minds.

Let’s dismiss the “snapshot in time” disclaimer by noting two nearly contemporaneous polls (Rasmussen and SurveyUSA) showed 3- and 1-point Dayton leads, respectively.

Jacobs’ poll did show Dayton racking up 53 percent support in the two days following Obama’s visit, but SurveyUSA was in the field those two days, and it found a near-dead heat.

The two polls didn’t perfectly overlap. (Oct. 21-25 for HHH, Oct. 24-27 for SUSA. By the way, HHH’s poll was in the field eight to 12 days before Election Day). But remember, Dayton’s margins were expanding in the HHH poll’s final days; SUSA’s slightly later time frame probably doesn’t explain the vast difference.

So what did?

While Schier won’t divulge conversations with MPR, he is willing to critique HHH’s methodology. “What I can tell you is that the poll problems may lie in two places — the likely voter screen and the attempt to factor in cell phone use.”

As I noted this summer, HHH does not survey cell-phone-only voters, or CPOs. However, it tries to simulate that 25 percent of households by giving additional weight to land line respondents who also have cell phones.

SUSA president Jay Leve — who added CPOs to his final Minnesota survey — has criticized this. “There is no defensible weighting that can be done to a universe of reachable respondents [landliners] to compensate for a universe of unreachable respondents [CPOs],” he told me this summer.

As for HHH’s likely voter model, it has a lot of moving parts. SUSA, for example, uses a two-question screen and basically excludes voters ranking themselves as less than 9 on a 10-point likely voter scale. HHH’s screen includes more questions and more weighing, based on past voting trends.

Most pollsters don’t massage party ID — it’s a result, not an input. HHH’s final sample tilted Democratic 45-38 — Schier says the +7D margin is well above +3 to +4 Democratic margins in 2004 through 2008. “Party ID gaps double that or more just don’t seem realistic,” he says.

In contrast, SUSA’s sample was 35 percent Republican, 33 percent DFL — also an ahistorical tilt, but more in line with what other pollsters showed in a year with a Democratic “enthusiasm gap.”

HHH’s survey isn’t always wrong; in the 2006 and 2008 U.S. Senate races, the pro-D gap was 1 and 4 points. However, the 2006 governor’s race was high by 7 and the 2008 presidential race by 9. And then came this year’s 12.

Why the consistent DFL tilt? According to WCCO’s Murphy, Republicans believe HHH (and presumably MPR) wants to depress GOP turnout by publishing such negative numbers.

Even if you ignore the ever-more-obvious reputational damage of such a conspiracy, does anyone — especially GOP hardcores — take the HHH poll that seriously?

And if I can’t convince cynics that MPR’s newsroom is ethical, do you really think they’d imperil bipartisan support for their state subsidy by playing a publicly obvious partisan game?

Nevertheless, neither MPR nor the Humphrey Institute is helping itself without a complete explanation of this miss, and the poll’s recent history — and of course, the remedies. Hopefully, they’ll let all of us know soon.

Comments (8)

  1. Submitted by John Edwards on 11/09/2010 - 11:58 am.

    When we start examining methodology and motives of left-leaning pollsters, do not forget this one released Oct. 25:

    The poll, taken by St. Cloud State University (SCSU) and partially sponsored by MinnPost, had it: Dayton: 40 percent; Emmer: 30 percent;
Horner: 19 percent; Other, don’t know, refused: 11 percent.

  2. Submitted by Mark Heuring on 11/09/2010 - 12:40 pm.

    One other embarrassed entity would be KARE-TV, which reported the Humphrey Institute/MPR poll numbers as gospel and continued to use them right up until the election. I’ll be John Croman is greatly pleased to have relied on these guys.

  3. Submitted by Jeremy Powers on 11/09/2010 - 12:48 pm.

    One odd bit abut polls and their affect on results. As a Democrat, I want nothing more than to see a poll the day before an election showing Democrats 2 points behind. That gets DFL voters to the polls. If the Republicans are honest, they willsay the same thing.

    So, a poll that shows Dayton ahead by 10 points may anger Republicans, but it is actually a death knell for the Democrat.

  4. Submitted by Hal Davis on 11/09/2010 - 01:02 pm.

    ==a poll that shows Dayton ahead by 10 points may anger Republicans, but it is actually a death knell for the Democrat.==

    Except perhaps in this case.

  5. Submitted by David Brauer on 11/09/2010 - 02:00 pm.

    John – The St. Cloud poll has such a long interviewing time (12 days!) and is sort of a one-shot non-professional, non-media-sponsored deal that few folks I know give it much prominence. (As you’ll notice, I didn’t, though Eric Black may have.)

    Mark – Don’t know about KARE. I think you can see the incredulity built in to my very first piece on the final HHH poll. Most reporters know the track record.

    Jeremy – I think at some point, a big poll margin might depress the trailer’s turnout. Do we have a poll studying this?

    Hal – 😉

  6. Submitted by Thomas Swift on 11/09/2010 - 07:39 pm.

    I enjoy many PBS programs, and hope to have the opportunity to continue to do so, but I think public broadcasting has come of age and no longer requires a government subsidy.

    Given the fiscal realities the state faces, I’m guessing that message is one that Bill Kling had better count on hearing this session.

  7. Submitted by Mark Heuring on 11/09/2010 - 09:21 pm.

    David,

    I realize that you and a lot of other people were skeptical and rightly so. I watched KARE’s 10 o’clock news throughout the period and they kept referring to that poll. I believe they might have a relationship with MPR, but I’m not certain. In any event, Croman and Mike Pomeranz both talked about Dayton’s big lead in the days leading up to the election.

  8. Submitted by Stan Daniels on 11/09/2010 - 09:33 pm.

    MPR should just exit the polling business. We are using a government subsidy to predict an election horse race? Seems a bit backwards.

Leave a Reply