The Numbers Rasmussen Was Hiding

Last month I called out Rasmussen Reports for skewing questions in its Minnesota polling to make it seem as though the state's Republican Governor -- and seeming Presidential aspirant -- Tim Pawlenty was more popular than he actually was relative to the state's well-known Democratic Senator, Al Franken. After Mark Blumenthal of Pollster.com got on Rasmussen's case, the pollster fessed to have run a bad poll. Now, via pollster SurveyUSA, we have an indication of what Pawlenty's numbers look like relative to those of Franken -- and not too surprisingly, when the same question is asked about both elected officials, they show Pawlenty in a significantly weaker position.

Do you approve or disapprove of the job Tim Pawlenty is doing as Governor?

Approve: 45 percent
Disapprove: 52 percent

Do you approve or disapprove of the job Al Franken is doing as United States Senator?

Approve: 49 percent
Disapprove: 44 percent

Rasmussen claims that it was all a big mistake, that the different questions for the two candidates was unintentional. Fair enough. Let's take them at their word. Nevertheless, what we do know is this: When Rasmussen asked two separate questions gauging approval -- one that tends to show higher approval numbers for Pawlenty, one that tends to show lower approval numbers for Franken -- the numbers came out as expected, with Pawlenty scoring 15 points higher than Franken. When SurveyUSA asked the same question about both Pawlenty and Franken, Franken came out ahead. So much for the notion of Pawlenty being popular in his home state, let alone more popular than other elected officials there.

Tags: Rasmussen Reports, Tim Pawlenty (all tags)

Comments

6 Comments

Re: The Numbers Rasmussen Was Hiding

Good stuff!  Thanks for continuing to follow-up this story.

by dvk 2009-10-06 11:13AM | 0 recs
Re: The Numbers Rasmussen Was Hiding

Great post - it is fantastic to see people are watching our pollsters for accuracy.  Unfortunately, you have your own inaccuracy in this post:

You say "when the same question is asked about both elected officials, they show Pawlenty in a significantly weaker position."  The difference in approval ratings is 4%, and the margin of error on both polls is 4%.  The word "significantly" in a statistical context implies that the difference is greater than the margin of error.  This is not the case.

If you meant that the new numbers differ significantly from the Rasmussen numbers, you should revise the quoted sentence.

-Xander

by Reductive 2009-10-06 11:18AM | 0 recs
Re: The Numbers Rasmussen Was Hiding

In the earlier poll, Pawlenty came in at 56 percent; here he came in at 45 percent -- a difference outside the margin of error.

by Jonathan Singer 2009-10-06 11:52AM | 0 recs
Re: The Numbers Rasmussen Was Hiding

It is significantly weaker relative to the prvious poll

by lojasmo 2009-10-06 12:23PM | 0 recs
Why take them at their word?

They clearly have their thumb on the scale. A company as experienced as Rasmussen does not make this kind of mistake, and they have a well-known GOP bias. I'm waiting for Nate Silver or SOMEONE to just come out and say they're not going to take their polling seriously anymore, or at least treat every Ras poll as if the GOP itself (whether a committee or a candidate) commissioned it.

by bpfish 2009-10-06 01:30PM | 0 recs
Re: The Numbers Rasmussen Was Hiding

Trust, but verify.

Let's give SOME props to Ras for actually responding substantively rather than calling for a blogger ethics conference.

I remember hating the beejezus out of Rasmussen because they consistently seemed to be skewing the election to the right in their poll results, but IIRC they actually ended up being one of the most accurate (non-aggregated) pollsters in the presidentials and mid-terms from 2000 on.

Please correct my memory if that recollection is in error.

I guess I'm sounding negative, what I'm really trying to say is don't be too quick to blow them off, even after this "mistake." Maybe they called a lot of elections correctly BECAUSE they skew right and looked good when elections skewed right themselves (e.g. Ras got lucky). But maybe they generally know what they're doing-- moreso than many of their competitors. Don't rule it out.

Let me conclude with, major, major props to Singer/MyDD for busting Ras on the Franken thing AND following up. Awesome work.

by alteran 2009-10-07 05:13AM | 0 recs

Diaries

Advertise Blogads