ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention143
    • Working memory51
    • Executive function191
    • Episodic memory84
    • Response inhibition10
    • Social cognition97
    • Language50

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 681 tests

    Browse by

    • Phone380
    • Tablet415
    • Untimed419
    • Up to 5 minutes81
    • Evidence grade A48
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 681 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,848 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia202
    • Decisions and reward136
    • Child development and education114
    • Social behavior87
    • Language and bilingualism80
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma28
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue17
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Tests
  3. /Number Order Task

Processing Speed

Number Order Task

Also called: ordinality judgment task, order judgment task, number ordering task, ordinal verification, numerical order judgment, reverse distance effect

Measure how quickly people judge whether three numbers are in order, such as 3 4 5 or 7 5 3, and how much faster neighbors are than sets with gaps.

5-6 minTimed: desktop or laptop with a mouse or trackpad

Create a study with this test

Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.

Papers, 2021 to 2025
34
Evidence grade
C
Registered clinical studies
0
How these are counted
+
753
F
J
F: in order, going downNeighbors such as 3 4 5 are faster
Press F if the three numbers are in order, J if not
  • Overview
  • Evidence
  • Task design
  • Quality checks
  • Settings
  • Cite
  • Questions

What it measures

Measures how quickly people judge numerical order. Three numbers from 1 to 9 flash in a row, and participants press one key if they are in order, going up or going down, and another if they are not. The main score is the median time of correct answers. Sets of neighbors such as 3 4 5 are usually judged faster than sets such as 3 5 7, the reverse distance effect.

Constructs

  • Numerical order
  • Symbolic number processing
  • Processing speed

Research uses

  • Math learning and dyscalculia research
  • Numerical cognition research
  • Education research

How the paradigm works

The Number Order Task measures how quickly people judge whether numbers are in order. Lyons and Beilock (2011) found that adults' skill at judging the order of numerals predicted their mental arithmetic even with the precision of their approximate number sense held constant, and Lyons and colleagues (2014) found in 1,391 children that its unique link to arithmetic grew from grade 1 to grade 6, when it overtook every other numerical skill they measured. Sets in order whose numbers are neighbors, such as 3 4 5, are usually judged faster than sets with gaps, such as 3 5 7: the reverse distance effect, read as a sign that familiar sequences are recalled from the count list rather than compared number by number (Lyons and Beilock, 2013).

More about the paradigm

On each trial a cross shows for 500 ms, then three numbers from 1 to 9 appear in a row for 500 ms, then the empty panel until the participant presses F (in order, going up or going down) or J (not in order), or until 2,500 ms from the numbers' onset, the timing of Lyons and Beilock (2013). The numbers of a set are evenly spaced, 1 apart (1 2 3 to 7 8 9) or 2 apart (1 3 5 to 5 7 9): 12 sets. Each round shows every set going up, going down and in two mixed orders, so a fourth of the trials go up, a fourth go down and half are mixed, as in that study. The standard session has 3 rounds (2 to 4), 144 trials in a seeded order with no set twice in a row, after 8 practice trials with feedback, about 5 minutes in all. A setting shows the numbers as arrays of dots too brief to count, with dot size and total area balanced as in the Dot Comparison Task. The displays switch on screen frames, and response times run from the frame that drew the numbers. Desktop and laptop only.

The main score is the median response time of correct answers. Accuracy, the times for ordered and mixed sets, and the reverse distance effect (among sets in order, the median time for sets 2 apart less sets 1 apart; positive values mean neighbors were faster) are also reported. Responses under 100 ms count as anticipations. How large the reverse distance effect is depends on the mix of trials in the list (Vos, Gevers, Reynvoet and Xenidou-Dervou, 2021), so it suits group comparisons best.

Scores

Median Correct Response Timems
Median response time of correct answers over all sets, counting answers at or after 100 ms.
Lower is faster
Accuracy%
Share of all test trials answered with the right key: F for sets in order, J for mixed sets.
Higher is better
Reverse Distance Effectms
Among sets in order, the median correct response time for sets 2 apart (such as 3 5 7) less sets 1 apart (such as 3 4 5).
Positive values mean neighbors were judged faster
Mixed Sets Distance Effectms
Among mixed sets, the median correct response time for sets 1 apart less sets 2 apart.
Positive values mean close numbers took longer
Ordered Sets Response Timems
Median correct response time for sets in order, going up or going down.
Lower is faster
Mixed Sets Response Timems
Median correct response time for sets not in order.
Lower is faster
Ordered Sets Accuracy%
Share of sets in order answered with F.
Higher is better
Mixed Sets Accuracy%
Share of mixed sets answered with J.
Higher is better
Ordered Neighbors Response Timems
Median correct response time for sets in order whose numbers are 1 apart.
Lower is faster
Ordered Gaps Response Timems
Median correct response time for sets in order whose numbers are 2 apart.
Lower is faster
Going Up Response Timems
Median correct response time for sets in order going up, such as 3 4 5.
Lower is faster
Going Down Response Timems
Median correct response time for sets in order going down, such as 5 4 3.
Lower is faster
Anticipationscount
Answers under 100 ms from the numbers' onset.
Lower is better
Missed Responsescount
Trials with no key press within 2,500 ms of the numbers' onset.
Lower is better
Early Key Pressescount
F or J pressed during the cross, before the numbers appeared, which are not taken as answers.
Informational
Frame Intervalms
Median time between screen frames during the trials.
About 16.7 on a 60 Hz screen
Displays on Time%
Share of answered trials whose numbers showed within one frame of 500 ms.
Under 0.9 is flagged for review
Completed Trialstrials
Trials shown in the scored run.
Fewer than planned is flagged for review
Planned Trialstrials
Trials the run set out to show.
Informational

Use and evidence

34 papers from 2021 to 2025 name this task in their title or abstract, up 70% compared with 2016 to 2020. That ranks it 536 of 711 test families in our census. See the counts for every test.

2021 to 2025, the years gradedEarlier years
Papers per year naming the Number Order Task, 2000 to 2025Bar chart. 2021: 9; 2022: 3; 2023: 9; 2024: 6; 2025: 7 papers. Peak year 2016.02.557.5102000: 1 papers2001: 1 papers2002: 2 papers2003: 0 papers2004: 0 papers2005: 2 papers2006: 2 papers2007: 2 papers2008: 2 papers2009: 4 papers2010: 2 papers2011: 2 papers2012: 7 papers2013: 5 papers2014: 7 papers2015: 2 papers2016: 9 papers2017: 5 papers2018: 2 papers2019: 3 papers2020: 1 papers2021: 9 papers2022: 3 papers2023: 9 papers2024: 6 papers2025: 7 papers200020052010201520202025
Papers per year naming the Number Order Task, 2000 to 2025Bar chart. 2021: 9; 2022: 3; 2023: 9; 2024: 6; 2025: 7 papers. Peak year 2016.02.557.5102000: 1 papers2001: 1 papers2002: 2 papers2003: 0 papers2004: 0 papers2005: 2 papers2006: 2 papers2007: 2 papers2008: 2 papers2009: 4 papers2010: 2 papers2011: 2 papers2012: 7 papers2013: 5 papers2014: 7 papers2015: 2 papers2016: 9 papers2017: 5 papers2018: 2 papers2019: 3 papers2020: 1 papers2021: 9 papers2022: 3 papers2023: 9 papers2024: 6 papers2025: 7 papers200020052010201520202025
Papers per year whose title or abstract names this task (OpenAlex).
Show the numbers
YearPapers
20257
20246
20239
20223
20219
20201
20193
20182
20175
20169
20152
20147
20135
20127
20112
20102
20094
20082
20072
20062
20052
20040
20030
20022
20011
20001
D

Use grade D

30 to 99 papers from 2021 to 2025.

C

Evidence grade C

At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.

Papers on test-retest reliability
3
Papers on reliability or validity
15
Registered clinical studies using it as an outcome
0

Measured on ConductCognition

Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.

No pooled figure yet.

How the grades work

Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.

Source: ConductCognition test census 0.58.0, counted 12 November 2026 from OpenAlex and ClinicalTrials.gov.

Task design

The trial sequence as the test runs in ConductCognition.

Display
On a dark panel: a cross for 500 ms, then three numbers from 1 to 9 in a row for 500 ms, then the empty panel until a key or 2,500 ms from the numbers' onset.
Keys
F when the three are in order, going up or going down, and J when they are not. The two letters stay on the panel under the outer places.
Sets
12 sets of three evenly spaced numbers: 7 sets 1 apart (1 2 3 to 7 8 9) and 5 sets 2 apart (1 3 5 to 5 7 9). Each round shows every set going up, going down and in two mixed orders: 48 trials, a fourth going up, a fourth going down and half mixed.
Trials
3 rounds (standard; 2 to 4): 144 trials, each round in its own seeded order, with no set twice in a row. The two mixed orders of a round put the smallest number in the middle once and the largest once, and two rounds show all four.
Practice
8 trials, 2 going up, 2 going down and 4 mixed, with feedback for 800 ms.
Dots setting
The numbers can be shown as arrays of dots in three circles, too brief to count. Half the trials keep the mean dot size equal across the three arrays and half keep the total area equal, as in the Dot Comparison Task.
Score
Median response time of correct answers, counting answers at or after 100 ms, from the screen frame that drew the numbers. The reverse distance effect is, among sets in order, the median time for sets 2 apart less sets 1 apart.

Three numbers in order or not, going up or going down, with the timing and trial mix of Lyons and Beilock (2013), who found the reverse distance effect with digits but not with dots. How large the effect is depends on the trial list, so it suits group comparisons best. No percentile is given.

Quality checks

Each session is marked valid, needs review or invalid, with the reason, before you see its scores.

Scored rows: number_order_test from the scored run, F (in order) or J (not in order) within 2,500 ms of the numbers' onset (chance 50%; half the sets are in order), graded from the saved numbers. Below chance invalidates and not above chance is flagged. One key on 90% of answers invalidates when accuracy is not above chance. Missed responses and responses under 100 ms follow the timed-test rule. A run short of its planned trials, too few correct answers to compute the reverse distance effect, or numbers that ran off their 500 ms on more than a tenth of trials are flagged for review.

Why these rules

Accuracy significantly below chance (one-sided exact test, p < .05) cannot come from guessing; it means the response mapping was reversed or the task was not followed (Slick, Sherman and Iverson 1999 treat below-chance forced-choice performance as definite response bias). Chance-level accuracy can be a real result in impaired participants, so it is only flagged. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). Missed responses and responses under 100 ms keep the platform's timed-test rule: more than max(3, 25%) missed responses or more than max(2, 20%) responses under 100 ms invalidate, and any is flagged. A response under 100 ms cannot be a reaction to the stimulus.

No percentile. Scores and quality flags only.

Running this test

Settings you can change

SettingStandardAllowed
Rounds of the 48 sets32 to 4
Numbers shown asDigits (standard)Digits (standard), Dot arrays

Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.

How test settings work

Need a setting this test does not have?

Devices and languages

  • Timed test: participants need a desktop or laptop with a mouse or trackpad. Participant devices
  • Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
  • Available on: Every plan, including the free plan.
  • No percentile. Scores and quality flags only. How norms work
  • Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.

Cite and describe

Methods text, with the standard settings

Participants completed the Number Order Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Lyons and Beilock, 2011; Lyons and Beilock, 2013; Lyons, Price, Vaessen, Blomert and Ansari, 2014), with the standard settings (rounds of the 48 sets: 3; numbers shown as: Digits). The main score was median correct response time (median response time of correct answers over all sets, counting answers at or after 100 ms).

ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.

  • Lyons, I. M., & Beilock, S. L. (2011). Numerical ordering ability mediates the relation between number-sense and arithmetic competence. Cognition, 121(2), 256-261. https://doi.org/10.1016/j.cognition.2011.07.009Number ordering as a predictor of mental arithmetic in adults.
  • Lyons, I. M., & Beilock, S. L. (2013). Ordinality and the nature of symbolic numbers. Journal of Neuroscience, 33(43), 17052-17061. https://doi.org/10.1523/JNEUROSCI.1775-13.2013The sets, timing and trial mix, and the reverse distance effect with digits but not dots.
  • Lyons, I. M., Price, G. R., Vaessen, A., Blomert, L., & Ansari, D. (2014). Numerical predictors of arithmetic success in grades 1-6. Developmental Science, 17(5), 714-726. https://doi.org/10.1111/desc.12152Number ordering as a growing predictor of arithmetic from grade 1 to grade 6.
  • Vos, H., Gevers, W., Reynvoet, B., & Xenidou-Dervou, I. (2021). Ordinality: The importance of its trial list composition and examining its relation with adults' arithmetic and mathematical reasoning. Quarterly Journal of Experimental Psychology, 74(11), 1935-1952. https://doi.org/10.1177/17470218211016794How the mix of trials changes the reverse distance effect.

Source papers

  • Lyons IM, Price GR, Vaessen A, Blomert L, Ansari D (2014). Numerical predictors of arithmetic success in grades 1-6. Developmental Science, 17(5):714-726.Paradigm source, Children in grades 1 to 6

Questions

How long does the Number Order Task take?

About 5 to 6 minutes, as listed in the test library.

What device does a participant need?

Timed test: participants need a desktop or laptop with a mouse or trackpad. The browser must be Chrome, Edge, Firefox or Safari.

What scores does it produce?

Median Correct Response Time, Accuracy, Reverse Distance Effect, Mixed Sets Distance Effect, Ordered Sets Response Time, Mixed Sets Response Time, Ordered Sets Accuracy, Mixed Sets Accuracy, Ordered Neighbors Response Time, Ordered Gaps Response Time, Going Up Response Time, Going Down Response Time, Anticipations, Missed Responses, Early Key Presses, Frame Interval, Displays on Time, Completed Trials and Planned Trials. Each session is also marked valid, needs review or invalid, with the reason.

How widely is the Number Order Task used in research?

34 papers from 2021 to 2025 name it in their title or abstract, up 70% compared with 2016 to 2020. That ranks it 536 of 711 test families in the ConductCognition test census (use grade D). Source: ConductCognition test census 0.58.0, counted 12 November 2026 from OpenAlex and ClinicalTrials.gov.

How much reliability evidence does the Number Order Task have?

In the published research, 3 papers report its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade C in the ConductCognition test census).

Does it report a percentile?

No. Scores and quality flags only.

Which settings can a researcher change?

Rounds of the 48 sets (2 to 4) and numbers shown as (Digits (standard), Dot arrays). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings.

Which languages can participants use?

Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.

Is this a clinical test?

No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.

Every test: the full test list.

New tests and features, about once a month. Unsubscribe at any time.

Run this test in your next study

Start free with 10 free participants on any test, then use participant credits or a yearly plan.

Start free

Related tests

Digit Comparison TaskOrdered Number Search TaskArithmetic Fluency Task
ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Big Five personality test
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • ConductScience Fellows
© 2026 ConductScience, Inc. Research use only.