ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention143
    • Working memory51
    • Executive function191
    • Episodic memory84
    • Response inhibition10
    • Social cognition97
    • Language50

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 681 tests

    Browse by

    • Phone380
    • Tablet415
    • Untimed419
    • Up to 5 minutes81
    • Evidence grade A48
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 681 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,848 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia202
    • Decisions and reward136
    • Child development and education114
    • Social behavior87
    • Language and bilingualism80
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma28
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue17
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Study design

Study design

Randomize test order and assign study groups

Put tests in sections, choose the order inside each section, and assign participants to study groups. Each participant's group and order are fixed when they agree to the consent form, or when they start the study if the consent screen is off, and both go into your exports.

Start freeSee an example study

In the protocol builder

Sections
Up to 20, holding tests, instructions and breaks
Order inside a section
Fixed order, Random order or Latin square
Section order
Fixed, or rotated in a Latin square
Study groups
Up to 12. Random, weighted or balanced assignment, with optional caps
Saved for each participant
Group, order number and the tests in the order received

See each participant's path

The protocol builder's Flow view draws the path from start to end for each study group, with a text version below it. This is the example study used on this page, drawn by the same component. Practice stays first, the attention tests rotate in a Latin square, and each group gets one more section.

Flow diagram: Example studyConsentParticipant agrees to take partBalanced assignment2 study groupsGroup AGroup BPractice1 test, fixed orderIn placeAttention3 tests, Latin squareSpeed1 test, fixed orderPractice1 test, fixed orderIn placeAttention3 tests, Latin squareMemory and speed2 tests, random orderEndCompletion page
Sections rotate in a Latin square, 2 orders

Text version of the diagram

  1. Consent: Participant agrees to take part.
  2. Balanced assignment to Group A, Group B.
  3. Group A: Practice (1 test, fixed order); Attention (3 tests, Latin square); Speed (1 test, fixed order).
  4. Group B: Practice (1 test, fixed order); Attention (3 tests, Latin square); Memory and speed (2 tests, random order).
  5. Group A: Attention, Speed rotate across participants in a Latin square with 2 orders.
  6. Group B: Attention, Memory and speed rotate across participants in a Latin square with 2 orders.
  7. End: completion page.

Choose the order inside each section

A section is a named block of tests, instructions and breaks. Each section has one order rule.

Fixed order

Steps run in the order shown.

Random order

Each participant gets the tests in a new random order. Instructions and breaks stay where they are.

Latin square

Tests rotate across participants in a balanced Latin square, so each test is used in each position equally often. A section needs 2 to 12 tests. Instructions and breaks stay where they are.

Instructions are plain text of up to 5,000 characters. A break can ask for up to 900 seconds of rest (15 minutes), with or without an early Continue. A protocol can hold up to 20 sections and 128 steps.

Counterbalance whole sections

Section order can rotate in a balanced Latin square too. Keep a section in place, such as practice at the start, and the other sections rotate around it.

When a study counterbalances more than one thing, each participant gets one order number and every part stays balanced. In the example study, the 3 attention tests have 6 orders and the 2 sections after practice have 2, so each group rotates through 6 orders. A group can have up to 1,000 orders.

Latin square counterbalancing, explained

When every participant takes the tests in the same order, practice and fatigue build up in the same tests for everyone. Counterbalancing spreads those order effects across the tests, so they do not pile up on one.

A Latin square is a set of orders in which each test appears once in each position. A balanced Latin square, also called a Williams design, adds one more rule: each test comes directly after every other test equally often. ConductCognition builds balanced Latin squares.

With an even number of tests, a balanced square needs as many orders as tests. With an odd number, it needs twice as many. Each new participant gets the order that the fewest active participants in their group have, so the orders fill evenly. For an exactly balanced design, plan a number of participants per group that is a multiple of the number of orders.

Random order is the other choice. It gives each participant a new shuffle, so positions even out only on average across many participants.

Williams, E. J. (1949). Experimental designs balanced for the estimation of residual effects of treatments. Australian Journal of Scientific Research, Series A, 2(2), 149-168. https://doi.org/10.1071/CH9490149

4 tests, A to D, in 4 orders
Order1st2nd3rd4th
1ABDC
2BCAD
3CDBA
4DACB
Built by the same function the app uses. Each letter appears once in each column, and each letter comes directly after every other letter exactly once.

Orders a balanced square needs

  • 2 tests: 2 orders
  • 3 tests: 6 orders
  • 4 tests: 4 orders
  • 5 tests: 10 orders
  • 6 tests: 6 orders
  • 7 tests: 14 orders
  • 8 tests: 8 orders

Assign participants to study groups

Study groups, which clinical teams call arms, each receive their own sections. A participant joins one group when they agree to the consent form, or when they start the study if the consent screen is off, and keeps it, even when you publish a new protocol version.
AssignmentHow it works
RandomEach participant has an equal chance of joining each group.
WeightedEach group's chance follows its ratio.
BalancedEach participant joins the group furthest below its ratio. Someone who has not started a test 60 minutes after joining their group stops counting, so their place is reused.
CapsA cap limits a group's active participants. A full group takes no one new. Someone who has not started a test 60 minutes after joining their group frees their place.

A study can have up to 12 groups, each with a ratio from 1 to 100 and an optional cap of up to 100,000 participants. Groups differ by the sections they receive. To give two groups the same test with different settings, put each version in a section that only one group receives.

Before launch, Simulate assignments in the Groups view shows how a number of participants would spread across groups and orders. People join one after another and every one starts. Nothing is saved and no places or credits are used.

Running a trial with arms? See cognitive tests in clinical trials.

Preview as any group and order

Choose a study group and an order number, then run the whole protocol through the screens participants see. The preview opens in a new tab. It creates no participant and uses no places or credits.

What the exports record

Score and trial CSV exports add these columns for every participant, after the columns they already had.
ColumnWhat it holds
group_keyThe study group's key.
group_nameThe group's name in the protocol version the participant ran.
assignment_methodHow groups were assigned: random, weighted or balanced.
order_indexThe participant's order number, counted from 1 as in the app.
section_labelThe section this test was in.
sequence_positionWhere this test came among the participant's tests.
realized_sequenceThe participant's tests in the order they received them, joined by >.

Example: the first 8 participants

Simulated participants in the example study, placed by the same assignment code the app runs when a participant joins. Example data, not real participants.

Participantgroup_nameassignment_methodorder_indexrealized_sequence
1Group Abalanced1srt>flanker>stroop>gonogo>crt
2Group Bbalanced5srt>flanker>gonogo>stroop>digit-span>crt
3Group Bbalanced1srt>flanker>stroop>gonogo>crt>digit-span
4Group Abalanced3srt>gonogo>flanker>stroop>crt
5Group Abalanced4srt>crt>gonogo>stroop>flanker
6Group Bbalanced2srt>crt>digit-span>stroop>gonogo>flanker
7Group Abalanced6srt>crt>stroop>flanker>gonogo
8Group Bbalanced6srt>digit-span>crt>stroop>flanker>gonogo

Every column and file: research data export. The tests in the example: the full test list.

Repeat visits in one study, and what is not built

A study can test the same people again. Each later visit opens a set number of days after the participant finishes the first, stays open for a set number of days and can accept late sessions. Each participant keeps one link, which opens the visit that is due, and uses one place for all visits. The longitudinal export gives each score at two visits and the change between them.

Branching is not built: a score or an answer cannot send a participant down a different path.

Price a design with repeat visits: the study cost calculator.

Questions about study design

What is the difference between random order and a Latin square?

Random order shuffles the tests for each participant, so each test lands in each position only on average. A Latin square rotates the tests through a fixed set of orders, so each test is used in each position equally often, and each new participant gets the order the fewest active participants in their group have.

How many orders does a balanced Latin square need?

As many orders as tests when the number of tests is even, and twice as many when it is odd. 4 tests need 4 orders; 5 tests need 10.

When is a participant assigned to a group and an order?

When they agree to the consent form or, if the consent screen is off, when they start the study. Their group, order number and exact sequence of tests are saved then and do not change, even when you publish a new protocol version.

What happens when a group is full?

A full group takes no one new. When every group has a cap and all are full, the open study link turns new people away before they start, and a participant link shows that the study is full before the person starts. Someone who has not started a test 60 minutes after joining their group stops counting toward caps and balance.

Can a score decide what a participant does next?

No. Branching on a score or an answer is not built. Every participant in a group gets that group's sections.

Can participants come back for a second visit?

Yes. A study can hold repeat visits. Each later visit opens a set number of days after the participant finishes the first, stays open for a set number of days and can accept late sessions. Each participant keeps one link, which opens the visit that is due, and the longitudinal export gives each score at two visits and the change between them.

Do sections and study groups cost extra?

No. They work on every plan, including the free plan. A participant counts once toward your participant limit, or uses one credit, whatever their group or order.

Plans and prices: pricing.

Design your study

Start free, build a protocol with sections and groups, and preview it as each group.

Start free
ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

New tests and features, about once a month. Unsubscribe at any time.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Big Five personality test
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • ConductScience Fellows
© 2026 ConductScience, Inc. Research use only.