Contents
Academy · Research Data, Analytics & AI · Survey questionnaire
Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting
Questionnaires seldom fail because respondents provide untruthful answers. More commonly, they fail because a question is ambiguous, a response scale is unfamiliar, or an order effect shifts an honest response away from the answer that would otherwise have been given.
A survey questionnaire is a structured data-collection instrument made up of a defined set of questions, administered consistently to every respondent, designed to measure specified constructs (attitudes, behaviours, knowledge) in a way that produces comparable data across the sample.
Learning objectives
- The sequence Boynton and Greenhalgh describe for selecting, designing or developing a questionnaire.
- Why selecting an existing validated instrument is usually preferable to writing new questions.
- The specific wording and ordering pitfalls that distort questionnaire responses.
- The problems that piloting a questionnaire is intended to identify.
Common misconceptions
- “Writing new questions is simpler than, and equivalent to, using a validated instrument.” The methodological guidance of Boynton and Greenhalgh recommends first establishing whether a validated questionnaire already exists for the construct being measured, because a new, unvalidated instrument has unknown measurement properties, whereas those of an existing validated instrument are established.
- “If a question seems clear to the researcher, it will be clear to respondents.” Ambiguous wording, double-barrelled questions (which ask about two things at once) and unfamiliar technical terms are common, well-documented sources of response error, and a researcher’s familiarity with the topic can make them difficult to detect without piloting.
Selection, adaptation or development of an instrument: the decision sequence
Boynton and Greenhalgh, in their BMJ methodological guidance on questionnaire development, set out a deliberate decision sequence: researchers should first establish whether an existing, validated questionnaire already measures the construct of interest and would suit the study population; if none is suitable, adaptation of an existing instrument should be considered; and only where neither option is feasible should an entirely new questionnaire be developed1. This sequence is recommended because validated instruments have known measurement properties (reliability, validity) that a newly written set of questions has not yet demonstrated.
Common errors in question wording and ordering
Boynton and Greenhalgh's guidance identifies specific, recurring sources of measurement error in questionnaire wording: double-barrelled questions that ask about two things at once and cannot be answered with a single accurate response; leading or loaded wording that steers a respondent toward a particular answer; unfamiliar jargon that respondents may interpret inconsistently; and question-order effects, in which an earlier question alters the interpretation of a later one1. Each of these distorts the data in a way that is often not apparent to the researcher who wrote the question, precisely because its intended meaning seems obvious to that researcher.
Purpose of piloting
Piloting a questionnaire with a small sample resembling the target population before full deployment is the step that Boynton and Greenhalgh's guidance recommends specifically to detect the wording and ordering problems described above before they affect the full dataset. Piloting checks that questions are interpreted consistently, that response options cover the range respondents require, and that the length and flow of the questionnaire do not themselves introduce fatigue-related response error1.
Key points
Key points
Questionnaire design should follow a deliberate sequence: selection of a validated instrument first, adaptation of an existing instrument second, and development of new questions only as a last resort. Whichever path is taken, piloting with a small representative sample is the means by which ambiguous wording, double-barrelled questions and ordering effects are detected before they distort the full dataset.
Practical application
Practical application
- The literature should be searched for a validated instrument before new questions are written. Researchers should identify any existing validated questionnaire that measures the construct of interest in a comparable population before drafting original items.
- Draft questions should be screened for double-barrelled wording and technical terminology. Each item should be reviewed to determine whether it asks about more than one thing and whether its language assumes a familiarity that the respondent population may lack.
- The questionnaire should be piloted before full deployment, with provision for revision. The questionnaire should be administered to a small sample resembling the target population, with time allowed to revise wording or ordering in response to the pilot findings.
Frequently asked questions
In general, yes, for the construct it was validated to measure and in a comparable population; a custom instrument is justified when no validated option suits the specific construct or population.
There is no single universal number; the sample should be large enough to reveal problems of interpretation and flow in the target population, and methodological guidance treats piloting as a qualitative, problem-finding step rather than a statistically powered exercise.
Yes; an earlier question can prime or anchor a respondent’s interpretation of a later one, which is why question order should be determined deliberately rather than for convenience.
References
- Boynton PM, Greenhalgh T. Selecting, designing, and developing your questionnaire. BMJ. 2004;328(7451):1312-1315. read 10 October 2026. View on The BMJ
Every source above is a peer-reviewed article, a publisher’s record of one, or a standard issued by the body that owns it. Each carries the date it was last read. Where a standard moves, this article is revised rather than left up with a note.
How to cite this article
Pick your referencing style and copy it. Your university or target journal may vary the punctuation — check its guide if it has one.
Pubrica Academy. (2026, October 10). Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting. Pubrica. https://pubrica.com/academy/concepts-definitions/survey-questionnaire/
Pubrica Academy. “Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting.” Pubrica, 10 Oct. 2026, pubrica.com/academy/concepts-definitions/survey-questionnaire/.
Pubrica Academy (2026) Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting. Pubrica. Available at: https://pubrica.com/academy/concepts-definitions/survey-questionnaire/ (Accessed: 15 October 2026).
Pubrica Academy. “Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting.” Pubrica. October 10, 2026. https://pubrica.com/academy/concepts-definitions/survey-questionnaire/
Pubrica Academy, ‘Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting’ (Pubrica, 10 October 2026) <https://pubrica.com/academy/concepts-definitions/survey-questionnaire/> accessed 15 October 2026.
Pubrica Academy. Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting. [Internet]. Pubrica; 2026 Oct 10 [cited 2026 Oct 15]. Available from: https://pubrica.com/academy/concepts-definitions/survey-questionnaire/
Pubrica Academy, “Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting,” Pubrica, Oct. 10, 2026. [Online]. Available: https://pubrica.com/academy/concepts-definitions/survey-questionnaire/
@misc{survey_questionnaire_2026,
author = {{Pubrica Academy}},
title = {Designing a Survey Questionnaire for Research: Instrument Selection, Wording and Piloting},
howpublished = {Pubrica},
year = {2026},
month = {oct},
url = {https://pubrica.com/academy/concepts-definitions/survey-questionnaire/},
note = {Accessed: <span data-cite-acc="iso">2026-10-15</span>}
}This article is written to be learned from. Cite it if you are referring to what it says; if you are using the evidence behind it, cite the sources listed above instead.
Questionnaire development checklist
This checklist applies when a survey questionnaire is selected, adapted or developed.
[ ] Searched for existing validated instrument for this construct [ ] Adaptation of existing instrument considered if no exact fit [ ] Draft items screened for double-barrelled wording, jargon, leading language [ ] Question order reviewed for priming/anchoring effects [ ] Pilot conducted with representative small sample [ ] Revisions made based on pilot findings
Pubrica AcademyWritten and maintained by Pubrica’s subject matter experts. Articles are revised when the underlying standards change, and each article states the date on which it was last reviewed.
How Pubrica can help
Pubrica’s research methods team identifies validated instruments where they exist, reviews draft questionnaire wording for common errors, and designs the pilot process so that problems are identified before full deployment.