Self-selecting surveys and sample sizes

The size of a self-selecting sample is often unimportant.

Anthony B. Masters
3 min readJul 24, 2021

Richard Tice, the Reform party leader, asserted on Twitter:

FASCINATING: huge poll, totally at odds with YouGov ( Govt propaganda arm) that says 71% favour them. Is YouGov so discredited it’s better to believe the opposite of many of their polls?

The cited YouGov survey had a different subject (nightclubs) and wording:

Would you support or oppose people being required to show they have received both doses of the Covid-19 vaccine as a condition of entry into nightclubs?

To reiterate: self-selecting surveys are not reliable ways to measure public opinion.

A self-selecting survey means respondents choose whether to take part. They put themselves into the sample. There are many examples, including text-in ‘polls’ and clickable website surveys. Social media sites may allow their users to generate a survey, which others can vote in.

We can make no inferences from self-selecting surveys to the general population.

There are many statistical issues with these surveys, including self-selection bias. People who see a…

--

--

Anthony B. Masters
Anthony B. Masters

Written by Anthony B. Masters

This blog looks at the use of statistics in Britain and beyond. It is written by RSS Statistical Ambassador and Chartered Statistician @anthonybmasters.