Why Randomization Matters
Randomization helps reduce order effects in social science research surveys. Depending on the measure, researchers may randomize answer options, matrix rows, conjoint rows or columns, slider orientation, or the order of questions inside a block.
Preview: Respondent View
Preview
Walk through respondent-facing behavior in the same preview surface.
Configure Randomization
Step 1: Open Block Builder. Select the question or block whose order could bias responses.
Step 1: Open Block Builder
Block Builder: Randomized Response Order
Response order is set to Shuffle — each respondent sees options in a different sequence, reducing order bias.
Step 2: Click Options on the question card. The Options button opens the configuration panel where order controls live.
Step 2: Click Options on the question card
Block Builder: Multiple Choice
Click Options on the question card to access randomization and ordering controls.
Step 3: Choose the order setting. Use the order dropdown for answer order, row order, column order, ranking item order, conjoint attribute order, or slider flip.
Step 3: Set the order in the options panel
Options: Multiple Choice
Set response order to Fixed, Reverse, or Shuffle to control how answer options are displayed.
Step 4: Keep meaningful sequences fixed. Do not randomize consent, instructions, dependent follow-ups, or ordered scales where sequence matters.
Step 4: Review fixed versus randomized options
Options: Multiple Choice
Set response order to Fixed, Reverse, or Shuffle to control how answer options are displayed.
Step 5: Preview multiple times. Open Preview repeatedly to see whether random draws and fixed options behave as expected.
Step 5: Preview randomized question
Block BuilderPreviewDeployPreview: Randomized Options
Open Preview multiple times and observe policy issue options appearing in a different order each time — confirming the Shuffle setting is active.
Step 6: Export order data. Open Export and include order fields when display order affects analysis.
Step 6: Include order fields in Export
Block BuilderPreviewDeployExport: Randomized Options
An answer_order column records the actual option sequence shown to each respondent, enabling order-effect analysis in post-processing.
Randomization Options In Domandata
- Multiple Choice: fixed, reverse, or shuffle answer options.
- Ranking: fixed, reverse, or shuffle the starting item order.
- Grid Matrix: randomize rows, columns, or both for repeated measures.
- Conjoint: randomize attribute rows and alternative columns independently.
- Slider: flip orientation while keeping stored values consistent.
- Blocks: shuffle questions inside a block when question order is not meaningful.
Options Panel: Grid / Matrix Row and Column Order
Options: Grid / Matrix
Randomize row order, column order, or both independently to reduce order effects in repeated-measures batteries.
Options Panel: Conjoint Attribute and Column Order
Options: Conjoint
Randomize attribute row order and alternative column order independently for unbiased discrete choice profiles.
Export Randomized Order
When randomization affects interpretation, include order information in the export. Order snapshots help researchers audit what each respondent saw and model display-order effects if needed. See Export Research Survey Responses.
Export: Data and Files
Export: Randomized Options
An answer_order column records the actual option sequence shown to each respondent, enabling order-effect analysis in post-processing.
Best Practices
- Do not randomize consent, instructions, or dependent follow-up sequences.
- Pin Other options last when respondents need an easy catch-all answer.
- Pilot randomized paths before publishing.
- Document randomization choices in your codebook.