ConductCognition
  • Domains

    Tests

    • Processing speed43
    • Attention113
    • Working memory50
    • Executive function143
    • Episodic memory72
    • Response inhibition9
    • Social cognition75
    • Language42

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 547 tests

    Browse by

    • Phone290
    • Tablet323
    • Untimed326
    • Up to 5 minutes69
    • Evidence grade A40
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 547 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test101
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,398
    • Depression and bipolar disorder1,247
    • Stroke1,233
    • Substance use and addiction895
    • Parkinson's disease892
    • Cancer760
    All 25 conditions
    16,361Registered studies name a cognitive test in an outcome measure11,688 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia188
    • Decisions and reward105
    • Child development and education87
    • Language and bilingualism64
    • Social behavior62
    • Psychiatric groups35
    • Training and intervention28
    • Mood, anxiety and trauma25
    • Substance use and impulsivity25
    • Neurological and movement research19
    • Brain injury and concussion14
    • Sleep and fatigue14
    • ADHD11
    • Eating and obesity8
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Resources
  3. /How test order works

Resources

How test order works

A battery runs its tests in one fixed order for everyone. In your own study, each section can run its tests in a fixed order, a random order or a balanced Latin square, and each participant's order is saved.

Updated
10 November 2026
Version
1.0.0

On this page

  1. Why order matters
  2. In a battery
  3. In your own study
  4. Balanced Latin squares
  5. What is saved

Why order matters

A test can change how people do on the next one: they tire, they get practice, or a strategy carries over. When every participant takes the tests in the same order, practice and fatigue build up in the same tests for everyone. Counterbalancing spreads those order effects across the tests, so they do not pile up on one.

Each choice suits a different question. A fixed order gives every participant the same session, which suits comparing people or groups, and comparing sessions over time. Counterbalancing suits comparing one test with another in the same people.

In a battery

A battery's order is part of the battery. Every participant takes its tests in the order its page and guide list, and a study started from it keeps that order. Reordering the tests makes the study a custom study.

  • How test batteries work
  • All test batteries

In your own study

A study can be split into sections of tests, instructions and breaks. Each section runs its tests in one of three orders.

In your own study
OrderWhat it does
Fixed orderSteps run in the order shown.
Random orderEach participant gets the tests in a new random order. Instructions and breaks stay where they are.
Latin squareTests rotate across participants in a balanced Latin square, so each test is used in each position equally often. A section needs 2 to 12 tests. Instructions and breaks stay where they are.

Balanced Latin squares

ConductCognition builds balanced Latin squares, also called Williams designs: each test is used in each position equally often, and each test comes directly after every other test equally often. Each new participant gets the order the fewest active participants in their group have, so the orders fill evenly.

Whole sections can be counterbalanced the same way, and a section such as a practice block can keep its place while the others rotate.

  • Randomize test order and assign study groups

What is saved

A participant's order is set when they agree to the consent form, or when they start the study if the consent screen is off. Their group, order number and exact sequence of tests are saved then, and they do not change, even when you publish a new protocol version.

Exports carry each participant's order, so you can check for order effects in your analysis.

What is saved
Export columnWhat it holds
order_indexThe participant's order number, counted from 1 as in the app.
section_labelThe section this test was in.
sequence_positionWhere this test came among the participant's tests.
realized_sequenceThe participant's tests in the order they received them, joined by >.

All methods and common questions

ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

New tests and features, about once a month. Unsubscribe at any time.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • Affiliate Program
© 2026 ConductScience, Inc. Research use only.