Consultation questionnaire design: the legal risk organisations keep repeating

In 2016 the courts quashed a devolution consultation because the questions did not ask what needed to be asked. Standards improved for a few years. They are now deteriorating again. This article examines what the Sheffield case established, why the lessons keep being lost, and what organisations must do before the next consultation questionnaire goes out.

What did the Sheffield judicial review establish?

R (Derbyshire County Council) v Secretary of State for Communities and Local Government and Sheffield City Region Combined Authority [2016] EWHC 3355 (Admin) was not a case about whether the right people were consulted or whether enough time was given. It was a case about the questions themselves.

Sheffield Combined Authority wanted to extend its devolution deal to include Chesterfield. The consultation it carried out did not ask whether Chesterfield should join the Sheffield City Region Combined Authority. It asked an abstract question about whether local authorities should cooperate where economic links existed. The Court held that this failed to consult on the actual proposal. The framing misled through abstraction. Respondents had not been given a genuine opportunity to answer what was truly at stake.

The judgment applied the Gunning principles, the established legal test for fair public consultation in the UK, and in particular the requirement from R (Moseley) v Haringey LBC [2014] UKSC 56 that consultees must understand what is genuinely proposed and that options must be presented fairly. Sheffield confirmed that questionnaire design is not a communications exercise. It is a legal one.

tCI published its own analysis at the time: Derbyshire wins the legal challenge to Sheffield’s consultation question. The core finding was unambiguous. If the questionnaire does not ask the real question, the consultation does not consult on the real proposal.

Why have those lessons been forgotten?

Several overlapping causes explain the deterioration, and none of them is simply carelessness.

Institutional memory in public bodies is fragile. Consultation expertise is frequently outsourced, project-specific, or held by individual officers who leave during restructuring. The lessons from Sheffield were absorbed by people who are often no longer in post. They were not embedded in organisational processes in a way that survived their departure.

Resource pressure has made this worse. Good questionnaire design requires iterative drafting, cognitive testing, expert review, and piloting. Under sustained budget constraint, that rigour gives way to templated, rapidly produced exercises. The Government Analysis Function questionnaire design guidance is explicit that the aim is for every respondent to interpret each question as the researcher intended. That standard takes time and expertise to meet. Both are in shorter supply than they were.

Digital engagement platforms have introduced a different pressure. The drive toward brevity and mobile-friendly formats has produced questions that are sentiment-led or so simplified that they no longer engage with what is proposed. The Cabinet Office Consultation Principles require questions to be clear and limited to what is necessary. That is a floor, not an aspiration, and many current questionnaires fall short of it.

Fragmentation of responsibility makes the problem structural. A modern consultation is typically managed by communications, policy, legal, and engagement teams simultaneously, often alongside an external agency. Each has different priorities. None consistently holds responsibility for the legal quality of the questions. When no one in the room can say “this question does not ask what needs to be asked”, the questionnaire goes out as drafted.

There is also a less comfortable explanation. Ambiguous questions can be administratively convenient. Abstract wording allows authorities to aggregate results flexibly, avoid binary opposition, and preserve discretion over how responses are interpreted. Sheffield rejected that approach directly. The incentives that produced it have not gone away.

What should a decision-maker check before the questionnaire is published?

The legal standard is not complicated. Before any significant consultation questionnaire is published, an organisation should be able to answer all of the following honestly.

• Does each question engage directly with what is actually proposed, not a related abstraction?
• Has someone with public law knowledge reviewed the questions, not just communications or policy knowledge?
• Have the questions been tested with representative respondents to confirm they are understood consistently?
• Are realistic alternatives explained fairly, or does the framing steer toward a preferred answer?
• Is one named person responsible for the legal quality of the questionnaire, with the authority to require changes?

If any of those questions cannot be answered clearly, the questionnaire is not ready to publish. Sheffield was not an isolated failure of one authority on one occasion. It was a visible example of a recurring pattern: the legal risk of poor question design is real, it has been demonstrated in court, and it is currently being underestimated again. Organisations that treat questionnaire design as a drafting task rather than a legal discipline are not cutting corners. They are creating exposure. The question is whether that exposure becomes apparent before the consultation closes, or after the challenge is filed.

---

How tCI Can Help

Advice and Guidance
A tCI faculty member will work alongside you to support the development of your decisions and engagement approach. We provide independent, constructive advice at critical stages, helping you strengthen stakeholder mapping, test communication strategies, and plan robust post-decision engagement. Our role is to act as a critical friend, offering practical recommendations grounded in consultation law and good practice that build confidence in your process.

Risk Assessment
Early identification of legal, political or reputational risks in your engagement approach. Using tCI’s five-risk methodology, we spot gaps before challenge arises, helping you strengthen stakeholder communication and demonstrate procedural fairness from the outset.

Executive Briefings
Concise updates for senior leaders on consultation law, engagement duties and post-decision risks. Helps boards and leadership teams make confident, defensible decisions when under pressure, with clear guidance on what good engagement looks like after difficult choices are made.

Whether you’re preparing for a high stakes service change or building defensible evidence for complex decisions, we can help.

Contact tCI: hello@consultationinstitute.org