Attention Checks

Ensure data quality by verifying that respondents are paying attention. Attention check questions have a known correct answer and help identify inattentive or bot responses.

Quick Start

Add an attention check to your survey:

1. Open your survey's Section Manager and click into a section
2. Add or edit a choice-based question (Single Choice, Multiple Choice, or Dropdown)
3. Expand Advanced Settings in the question modal
4. Enable the Attention Check toggle
5. Enter the Expected Answer value (must match option value exactly)
6. Save the question

How It Works

Attention checks validate respondent engagement:

1. The question is presented like any other question
2. When answered, the system compares to the expected answer
3. The result is stored in the response data
4. You can filter responses by attention check status during analysis

Question Types

Attention checks work with choice-based questions:

• Radio (single choice)
• Checkbox (multiple choice)
• Dropdown

Setting Up Attention Checks

Creating an Attention Check Question

1. Open your survey in the Section Manager and click into a section
2. Add or edit a choice-based question
3. Expand the Advanced Settings accordion in the question modal
4. Enable the Attention Check toggle
5. Enter the Expected Answer (the correct response value)
6. Save the question

Choosing the Expected Answer

The expected answer must match the option value exactly:

• For single choice: Enter the value that respondents should select
• The value must match the option value, not the label

Example: If your option has value="blue" with label "Blue Color", enter blue as the expected answer.

Response Data

When a respondent answers an attention check question:

• attention_check_passed: true if the answer matches
• attention_check_passed: false if the answer does not match
• attention_check_passed: null if the question was not answered

This field is included in:

• Response exports (CSV, Excel, SPSS)
• Response viewer (badge shown for failed checks)
• Webhook payloads
• API responses

Real-World Examples

Example: Instructed Response

Scenario: Simple verification that the respondent is reading.

Q: To verify you are paying attention, please select "Blue" below.

Options:
- Red (value: "red")
- Green (value: "green")
- Blue (value: "blue")  <- Expected answer: blue
- Yellow (value: "yellow")

Example: Reading Comprehension

Scenario: Ensure respondent understands the content.

[After a paragraph about company policies]

Q: According to the text above, employees are required to:

Options:
- Work from home every day (value: "wfh")
- Submit timesheets weekly (value: "timesheets") <- Expected answer: timesheets
- Attend meetings daily (value: "meetings")
- None of the above (value: "none")

Example: Obvious Answer

Scenario: Test basic attention with an obvious question.

Q: What color is grass typically?

Options:
- Red (value: "red")
- Green (value: "green") <- Expected answer: green
- Purple (value: "purple")
- Orange (value: "orange")

Viewing Results

In the Response Viewer

Responses that failed attention checks display a red "Failed Check" badge in the response list.

In Exports

The attention_check_passed column shows:

• "Yes" for passed
• "No" for failed
• Empty if the question was not answered or no attention check exists

Filtering Data

When analyzing results, you can filter by attention check status to:

• Include only responses that passed
• Review failed responses separately
• Compare data quality between groups

Placement Strategy

Where to place attention checks in your survey:

Recommendation: Place 1 attention check around 30-50% through your survey for best balance.

Plan Availability

Attention checks require the attention_checks feature, available on Pro plans and above.

Troubleshooting

Issue: Correct answers marked as failed

Symptoms: Respondents giving the right answer are marked as failed.

Solutions:

• Verify the expected answer matches the option value exactly
• Check for trailing spaces in the value
• Remember: match the value, not the label

Issue: Attention check not recording

Symptoms: All responses show null for attention_check_passed.

Solutions:

• Ensure "Attention Check" toggle is enabled on the question
• Verify an expected answer is specified
• Check that the question is being answered

Issue: Too many failures

Symptoms: High percentage of respondents failing attention checks.

Solutions:

• Review the question for clarity
• Check if the correct answer is obvious enough
• Ensure the question is not confusing or tricky
• Test with colleagues before publishing

Best Practices

• Keep it simple - The correct answer should be unambiguous
• Do not trick respondents - The goal is to verify attention, not intelligence
• Use sparingly - 1-2 per survey is usually sufficient
• Be transparent - Consider informing participants about quality checks
• Review failures - Some failures may be honest mistakes
• Match values exactly - Double-check your expected answer matches the option value