Test settings

Adjust each test to your protocol

Change trial counts, timing and test parts within limits set for each test, choose the order participants follow, and keep a record of every setting.

47 of 54 tests have settings
94 settings in all, each with a standard value and a range.
Preview before you launch
Run the exact test with your settings before participants see it.
Every setting in your export
6 columns record each session's settings and versions.

See what you can change in each test

Pick a test to see its settings, the standard value and the allowed range. Try a value to see how the session would be labeled.

47 tests with settings

Task Switching Test

Standard configuration

Percentiles against a published norm, on paid plans and pay-as-you-go studies.

Settings for Task Switching Test
SettingStandardAllowed range
Practice trials168 to 40
Single-task trials3216 to 120
Mixed-task trials7232 to 200
Switch probability0.50.25 to 0.75

Try a value

Standard value: 16

Standard value: 32

Standard value: 72

Standard value: 0.5

The values you try here are not carried over. Set them in the study builder on a paid plan.

7 tests have no settings and always run as designed: Trail Making Test A, Trail Making Test B, Paired Associate Learning, Dot-Probe Task, Emotional Stroop Task, Implicit Association Test (IAT) and Operation Span.

What changes when you change a setting

The test is scored the same way.
The session is marked modified, and no percentile is shown for it.
The settings each session ran with are saved and appear in the score and trial exports.
You can preview the exact test with your settings before you launch.

The settings columns in your exports

ColumnWhat it holds
test_versionThe version of the test the session ran.
config_versionThe test version its settings were checked against.
scoring_versionThe scoring version used for the session.
customization_statusstandard, or scored_modified when any setting was changed.
configuration_normative_eligibletrue when the session could show a percentile.
configuration_jsonEvery setting the session ran with, as JSON.

Every column and file: research data export. How percentiles work: test norms.

Length, timing, rates and parts

94 settings across 47 tests, grouped by what they change.
KindWhat it changesSettingsTestsExample
LengthTrials, blocks, items and spans5439Navon Global-Local Task: Trials per block, 24 to 96
TimingDisplay times, delays, response windows, time limits and lapse thresholds2318Stop-Signal Task: Initial stop-signal delay (ms), 100 to 600
RatesHow often targets or switches come up55Task Switching Test: Switch probability, 0.25 to 0.75
PartsParts of a test to include or leave out76Digit Span Test: Include backward span, on or off
ChoicesA version of the test53Semantic Priming Task: Prime-to-target interval, 200 ms (standard) or 1,200 ms

Design the order participants follow

Group tests into sections, randomize or counterbalance their order, assign participants to study groups, and add instruction screens and breaks.
Flow diagram: Example studyConsentParticipant agrees to take partBalanced assignment2 study groupsGroup AGroup BPractice1 test, fixed orderIn placeAttention3 tests, Latin squareSpeed1 test, fixed orderPractice1 test, fixed orderIn placeAttention3 tests, Latin squareMemory and speed2 tests, random orderEndCompletion page
Sections rotate in a Latin square, 2 orders

Text version of the diagram

  1. Consent: Participant agrees to take part.
  2. Balanced assignment to Group A, Group B.
  3. Group A: Practice (1 test, fixed order); Attention (3 tests, Latin square); Speed (1 test, fixed order).
  4. Group B: Practice (1 test, fixed order); Attention (3 tests, Latin square); Memory and speed (2 tests, random order).
  5. Group A: Attention, Speed rotate across participants in a Latin square with 2 orders.
  6. Group B: Attention, Memory and speed rotate across participants in a Latin square with 2 orders.
  7. End: completion page.

How study design works

Set what participants see

Write your own consent text, choose English or Italian for participant pages, use larger text for older adults, and choose whether to ask demographic questions.

Italian participant pages and setting changes come with paid plans.

Connect your recruitment service

Use presets for Prolific, Sona Systems, CloudResearch Connect and Qualtrics, save up to 10 extra link parameters with each participant, and send people back with a completion code. Recruitment setup guides

Start from a template, or save your own

  • Reaction Time Study
  • Pilot Screening Battery
  • Executive Control Battery
  • Working Memory and Learning Battery
  • Language-Minimized Screening Battery
  • Older Adult Executive Speed Battery

Save your own protocol as a template on paid plans. The tests in each template

What stays fixed

Each test's stimuli, instructions, keys, scoring and device rules are fixed for its version, so results stay comparable across studies and over time.

Need something the tests do not offer?

Questions about test settings

Can I change the number of trials?

Yes, in 39 of the 54 tests. Their settings include the number of trials, blocks, items or span lengths, each within a set range. Pick a test in the settings explorer on this page to see its ranges.

Can I change stimulus timing?

In 18 tests: Psychomotor Vigilance Task, Rapid Visual Information Processing, Continuous Performance Test, Stop-Signal Task, Recognition Memory Test, Delayed Recall Module, Visual Search Test, Affective Go/No-Go, Spatial Working Memory, Intra/Extra Dimensional Set Shift, Symbol Coding, Delayed Match-to-Sample, One-Touch Tower Planning, Short Story Recall, Verbal Learning, Verbal Fluency, Category Fluency and Clock Drawing Task. Their settings include display times, delays, response windows or time limits. The other tests keep their standard timing.

Can I use my own words, pictures or categories?

No. Each test's stimuli are fixed for its version. If your protocol needs different stimuli, ask about custom work.

Do changed settings affect percentiles?

Yes. A session with any changed setting is scored as usual and marked modified, and it shows no percentile, because published norms apply to the standard settings. A session with standard settings shows a percentile when the test has a published norm, on paid plans and pay-as-you-go studies.

Can I change the test language?

Participant pages are in English on every plan, and in Italian on paid plans. 45 of the 54 tests also have their own instructions and screens in Italian; each test's page lists its languages.

Can I randomize the order of tests?

Yes, on every plan. Put tests in sections, and give each section one order rule: Fixed order, Random order or Latin square. Whole sections can be counterbalanced too.

Which plans can change settings?

Every yearly plan: Academic Research, Academic Department, Academic Institution, Commercial Research, Commercial Team and Enterprise / CRO. Studies on the free plan, including pay-as-you-go studies, run the standard settings.

Will my settings appear in the data?

Yes. Every session saves the settings it ran with, and the score and trial exports add 6 columns for them: test_version, config_version, scoring_version, customization_status, configuration_normative_eligible and configuration_json.

Plans and prices: pricing.

Fit the tests to your study

Preview every test free, then change settings on a paid plan.

Start freeSee plans