Randomization reduces bias by varying the order of questions and responses across respondents. As a general rule, randomize response options when they're inherently unordered, and randomize questions or pages when order might influence results.
Questions with a list of options include a randomization setting in the question's settings panel.
To randomize the order of questions on a page:
).An indicator appears next to the page name when randomization is active. The randomized order is not saved to respondent data.
Page randomization is managed at the block level. By default, all pages live in a single block, but you can organize your survey into multiple blocks. See the Blocks article for more.
To randomize pages within a block:
).An indicator appears next to the block name when randomization is active. The randomized order is not saved to respondent data.
Once your survey has multiple blocks, they can be grouped into a block collection and randomized. To randomize blocks within a collection:
).This toggle is also available in the editor when the collection is selected. An indicator appears next to the collection name when randomization is active. The randomized order is not saved to respondent data.
Randomization can interact with skip logic in ways worth understanding. The behavior differs slightly depending on what's being randomized.
When a page randomizes its questions, a skip into a specific question will display that question and all remaining questions in randomized order. Earlier questions are skipped entirely.
For example, given a page with four randomized questions:
Page 2
Q4
Q5
Q6
Q7
A skip to Q6 results in only Q6 and Q7 being randomized and shown.
Consider a block with 4 pages set to be randomized:
Page 1
Page 2
Page 3
Page 4
Similar to questions on a page, a skip to an element on Page 3 will result in Page 3 and Page 4 being randomized.
Collections work differently — the block order is determined first, then the skip is applied.
For example, given four blocks in a collection:
Block 1
Block 2
Block 3
Block 4
If the randomized order resolves to:
Block 4
Block 1
Block 3
Block 2
A skip to Block 3 would show only Block 3 and Block 2.
If a block subset is used and a skip targets a block not included in the subset, the respondent starts at the beginning of the collection instead.
For example, if the subset resolves to:
Block 4
Block 1
Block 2
A skip to Block 3 (not in the subset) would redirect the respondent to Block 4, then Block 1, then Block 2.
