Consultation fatigue: is your evidence base being distorted?

Most consultation practitioners recognise the pattern: the same people keep responding, and fewer of them each time. Consultation fatigue does more than reduce participation. It skews the results, weakens the evidential quality of your findings, and creates a legal vulnerability if your process is later challenged.

What is consultation fatigue?

The legal consequence is direct. The Gunning principles, the established legal test for fair public consultation in the UK, require that responses are conscientiously taken into account. That standard cannot be met if the evidence base has been quietly distorted by who chose to keep engaging and who did not. Courts examining contested consultations look at whether the process was genuinely capable of producing representative evidence. A high response volume is not the same thing.

Why does repeated consultation produce skewed results?

Studies of online survey panels show that previous experience of consultation strongly predicts whether someone will respond to the next exercise. Each additional ask makes dropout more likely, and the groups most likely to stop engaging are time-poor residents, people with less confidence in formal processes, and communities that feel their previous contributions made little difference. Those who keep responding tend to be organised, experienced, and already engaged. Over repeated consultations, their voice grows louder not because their views are more valid, but because everyone else has stopped showing up.

Attempting to address this by chasing higher response numbers does not work. Research has consistently found that additional follow-up approaches increased response rates without eliminating the underlying bias. The people harder to reach differed in exactly the characteristics relevant to the subject being studied. More responses from a skewed pool is still a skewed result.

The quality of individual responses falls too. When people feel over-consulted, they put less thought into their answers: ticking boxes quickly, picking whatever seems reasonable, or skipping questions entirely. Research published in the British Journal of Political Science confirms that response quality is directly affected by how burdensome participation feels. There is a further risk: when repeated exercises gradually drive away less engaged participants, the remaining respondents increasingly agree with each other. What looks like consensus may simply be the disappearance of dissenting voices.

What should practitioners do about it?

Bring in new voices deliberately. If you are returning to the same community, do not rely on the same contact lists. Actively seek new routes in, particularly to groups less likely to engage through formal channels. This directly reduces the representativeness risk that repeated consultation creates.

Be honest about who responded. If participation has dropped in areas that have been consulted repeatedly, say so in your analysis. A report that acknowledges the limits of its evidence base is more defensible than one that presents a skewed result as straightforwardly representative. Conscientious consideration, as required by the Gunning principles, includes being clear about what the responses do and do not represent.

Do not rely on online surveys alone. Digital surveys favour respondents with time, digital confidence, and experience of formal processes. They are the method most vulnerable to fatigue effects. Face-to-face engagement, community interviews, and targeted outreach reach the people most likely to have disengaged from previous exercises and produce more defensible evidence as a result.

The question worth asking before your next consultation is not whether you have consulted enough people, but whether you have consulted the right ones. A process that has quietly shed its least engaged, least confident, and most time-poor participants is not a neutral sample. It is a distorted one, and if that distortion goes unnamed, it will not stay invisible for long.

How tCI Can Help

Organisation Wide Learning Hub Access
Equip your entire team with professional consultation skills through one platform. Self paced courses, live virtual classrooms, practical toolkits and expert resources that build a shared baseline of competence across your organisation. Trusted by councils, NHS bodies and regulators nationwide.

Bespoke Training Workshops
Training that works with your real projects, not hypothetical scenarios. Sector tailored sessions help teams apply good practice to live challenges: sharpening consultation documents, building defensible codebooks, strengthening equality analyses. Half day or full day workshops for health, local government, planning and public service teams.

Coaching for Complex or High Risk Consultations
Expert guidance when the stakes are highest. One to one and small group coaching for senior officers navigating legally exposed or politically contentious decisions. Strengthen your judgement on proportionality, evidence standards and challenge management. Essential for organisations that may face judicial review risk or major service changes.

Whether you’re preparing for a high stakes service change, building long term consultation capability, or need confidence that your evidence approach will stand up to scrutiny, we can help.

Contact tCI: hello@consultationinstitute.org