Print the page
Increase font size
How Election Polling Should Work

Posted September 06, 2024

Matt Insley

By Matt Insley

How Election Polling Should Work

We’re just 60 days away from Election Day.

It’s the perfect time, then, to address one of our stated missions for Election Insider: Examining the angles of election polls, how they’re conducted and how to read them.

What follows isn’t an exhaustive look at every potential bias in political polls, but it’ll show you what to look for. And what to view with skepticism.

First, let’s define the term oversampling…

Oversampling is deliberately including a larger number of certain demographic groups in a survey sample than their actual representation in the population.

How Oversampling Works

When pollsters oversample, they select respondents so that some groups make up a larger share of the survey sample than they do in the population.

For example, a poll might include a higher percentage of rural respondents than their actual share of the population to get more precise data about rural voters’ opinions.

Correcting for Oversampling

Reputable pollsters account for oversampling through a process called weighting.

After collecting raw data, they adjust the oversampled groups back to their actual proportion of the population.

This ensures that the overall results reflect the population while still benefiting from increased precision.

Now, how do these practices affect polls?

Send your opinions to, feedback@newsyoucanacton.com

Your Rundown for Friday, September 6, 2024...

… But Liars Use Numbers

When done correctly — and that’s key — oversampling and weighting do not bias the overall poll results.

Instead, they allow for more accurate analysis without skewing conclusive findings. But there’s an asterisk…

Margin of Error

The margin of error in polls represents the range of values above and below the sample estimate within which the actual parameter is likely to fall. In English, that means…

  • If a poll shows a candidate with 48% approval and a 3-point margin of error, it means the candidate's actual support in the population is likely between 45% and 51%.

Margin of error is typically calculated for a 95% confidence level, meaning that if the survey were repeated multiple times, you’d get the same results 95% of the time.

When weighted appropriately, oversampling can actually help pollsters reduce the margin of error. Which brings us to…

Challenges in Modern Polling

Some recent trends have complicated the polling landscape:

  • Response bias: Certain groups — like those with graduate degrees — are more likely to respond to surveys than others.
  • Demographic shifts: Changes in voting patterns among different demographic groups can make historical models less reliable.

Those two factors explain why Trump was behind in most Rust Belt polling leading up to the 2016 election, but won Michigan, Pennsylvania and Wisconsin to huge mainstream surprise.

Importance of Methodology

To assess a poll's reliability, reputable polls will provide detailed information about their sampling methods, weighting procedures and margins of error.

An easy way to crosscheck polls you see online — click the links in the fine print. Check the methodology and the disclosures for yourself.

You can also Google the name of the polling agency and check their partisan alliances.

Bottomline: Polls, even those with good data, can be relatively subjective snapshots of a moment in time.

They reveal a trend… but as we saw in 2016, they are not necessarily predictive.

Remember this the next time the mainstream media crows about week-over-week polling numbers like they’ve been sealed with a papal bull.

Market Rundown for Friday, Sept. 6, 2024

The S&P 500 is down 0.30% to 5,503.41.

Oil’s up 0.45% to $69.46 for a barrel of WTI.

Gold is up 0.42% to $2,553.80 per ounce.

And Bitcoin’s up 0.95% to $56,708.54.

Send your comments and questions to: feedback@newsyoucanacton.com

Big Win for Vance

Big Win for Vance

Posted October 02, 2024

By Matt Insley

Vance's debate performance stood out with a particularly strong showing that could energize Republicans in the coming weeks.
Lies and the Democrats Who Tell Them

Lies and the Democrats Who Tell Them

Posted September 30, 2024

By Matt Insley

A closer look at Pennsylvania…
Vance Annihilates Harris Talking Point

Vance Annihilates Harris Talking Point

Posted September 27, 2024

By Matt Insley

Last Saturday, vice presidential candidates made campaign stops in Pennsylvania. Something Vance said calls Harris’ competency into question…
Adios, Kamala

Adios, Kamala

Posted September 24, 2024

By Matt Insley

Here’s an intriguing angle that could affect the election’s outcome…
Why Libs Hate Silver

Why Libs Hate Silver

Posted September 23, 2024

By Matt Insley

We highlight an update from acclaimed election forecaster Nate Silver — who not only reports news… but has himself become news.
Unpacking Harris’ “Opportunity Economy”

Unpacking Harris’ “Opportunity Economy”

Posted September 20, 2024

By Matt Insley

During the recent presidential debate, Harris trotted out her latest buzzword: the “Opportunity Economy.” Sounds nice… But what does it mean?