ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention143
    • Working memory51
    • Executive function191
    • Episodic memory84
    • Response inhibition10
    • Social cognition97
    • Language50

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 681 tests

    Browse by

    • Phone380
    • Tablet415
    • Untimed419
    • Up to 5 minutes81
    • Evidence grade A48
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 681 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,848 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia202
    • Decisions and reward136
    • Child development and education114
    • Social behavior87
    • Language and bilingualism80
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma28
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue17
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Tests
  3. /Mixed Reasoning Task

Reasoning

Mixed Reasoning Task

Also called: ICAR-style reasoning items, short reasoning test, letter and number series, matrix reasoning items, verbal reasoning items, three-dimensional rotation items

Measure reasoning with 16 short puzzles of four kinds, letter and number series, picture grids, word problems and turned cubes, all made for this task and scored by kind.

8-12 minUntimed

Create a study with this test

Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.

Papers, 2021 to 2025
17
Evidence grade
C
Registered clinical studies
1
How these are counted
ACEGI?
16 puzzles, 4 kinds% correct by kind
Series, grids, word problems and cubes
  • Overview
  • Evidence
  • Task design
  • Quality checks
  • Settings
  • Cite
  • Questions

What it measures

Measures reasoning with 16 short puzzles of four kinds: letter and number series, picture grids, word problems and cubes turned another way, four of each after a practice puzzle. The score is the percentage answered correctly, overall and for each kind.

Constructs

  • Fluid reasoning
  • Inductive reasoning
  • Verbal reasoning
  • Spatial visualization

Research uses

  • Short reasoning measure in research batteries
  • Individual-differences and cognitive aging research
  • Reasoning as a covariate in cognitive studies
  • Within-study group comparison

How the paradigm works

The Mixed Reasoning Task is a short check of reasoning with puzzles of four kinds. Each puzzle has one right answer among its options, and there is no time limit. The design follows the sample test of the International Cognitive Ability Resource (ICAR; Condon and Revelle 2014), a public-domain set of untimed multiple-choice items of four kinds: letter and number series, matrices, verbal reasoning and three-dimensional rotation.

More about the paradigm

Every puzzle was made for this task; the ICAR's items are not used. The series are rows of letters or numbers that follow a rule our code checks, with six options; under rows of letters the alphabet is shown in order, so knowing it by heart does not matter. The grids are 3 by 3 pictures with one empty square, drawn from fixed seeds by the generator of the Matrix Reasoning Task, needing one, two or three rules, with 4 or 8 options. The word problems, about order, days of the week, a family and ages, are written for each session language, with 4 or 6 options. Each cube has a different symbol on each face; the participant chooses which of six pictures shows the same cube turned another way, and our code checks that exactly one can. Each kind starts with a practice puzzle and its answer, then four puzzles from easier to harder, for 16 puzzles in one order for everyone.

The main score is the percentage of puzzles answered correctly. The same percentage is reported for each kind, with puzzles correct, puzzles answered and the median answer time. Scores support research and make no IQ claim.

Scores

Percent Correct%
Puzzles answered correctly, as a percentage of the puzzles answered.
Higher is better
Series Correct%
The same for the 4 letter and number series.
Higher is better
Grids Correct%
The same for the 4 picture grids.
Higher is better
Word Problems Correct%
The same for the 4 word problems.
Higher is better
Cubes Correct%
The same for the 4 cube puzzles.
Higher is better
Puzzles Correctcount
Puzzles answered correctly, out of 16.
Higher is better
Median Answer Timems
Median time from a puzzle appearing to its answer.
Informational; the task has no time limit
Puzzles Answeredcount
Puzzles with an answer.
Fewer than half the planned puzzles invalidates
Planned Puzzlescount
16: 4 of each kind.
Informational

Use and evidence

17 papers from 2021 to 2025 name this task in their title or abstract, about the same as from 2016 to 2020. That ranks it 622 of 711 test families in our census. See the counts for every test.

2021 to 2025, the years gradedEarlier years
Papers per year naming the Mixed Reasoning Task, 2000 to 2025Bar chart. 2021: 3; 2022: 4; 2023: 5; 2024: 0; 2025: 5 papers. Peak year 2016.02462000: 0 papers2001: 0 papers2002: 0 papers2003: 0 papers2004: 0 papers2005: 0 papers2006: 0 papers2007: 0 papers2008: 0 papers2009: 0 papers2010: 0 papers2011: 0 papers2012: 0 papers2013: 1 papers2014: 2 papers2015: 2 papers2016: 6 papers2017: 0 papers2018: 1 papers2019: 4 papers2020: 6 papers2021: 3 papers2022: 4 papers2023: 5 papers2024: 0 papers2025: 5 papers200020052010201520202025
Papers per year naming the Mixed Reasoning Task, 2000 to 2025Bar chart. 2021: 3; 2022: 4; 2023: 5; 2024: 0; 2025: 5 papers. Peak year 2016.02462000: 0 papers2001: 0 papers2002: 0 papers2003: 0 papers2004: 0 papers2005: 0 papers2006: 0 papers2007: 0 papers2008: 0 papers2009: 0 papers2010: 0 papers2011: 0 papers2012: 0 papers2013: 1 papers2014: 2 papers2015: 2 papers2016: 6 papers2017: 0 papers2018: 1 papers2019: 4 papers2020: 6 papers2021: 3 papers2022: 4 papers2023: 5 papers2024: 0 papers2025: 5 papers200020052010201520202025
Papers per year whose title or abstract names this task (OpenAlex).
Show the numbers
YearPapers
20255
20240
20235
20224
20213
20206
20194
20181
20170
20166
20152
20142
20131
20120
20110
20100
20090
20080
20070
20060
20050
20040
20030
20020
20010
20000
E

Use grade E

Fewer than 30 papers from 2021 to 2025.

C

Evidence grade C

At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.

Papers on test-retest reliability
1
Papers on reliability or validity
33
Registered clinical studies using it as an outcome
1

Measured on ConductCognition

Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.

No pooled figure yet.

How the grades work

Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.

Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

Task design

The trial sequence as the test runs in ConductCognition.

Puzzles
16 made for this task, 4 of each kind, in one order for everyone: letter and number series, picture grids, word problems and cubes. Within each kind they run from easier to harder.
Series
Rows of 5 or 6 letters or numbers that follow a rule: a fixed step, a step that grows, double and add one, or two rows taking turns. 6 options. Under rows of letters the alphabet is shown in order.
Grids
3 by 3 pictures with one empty square, drawn by the Matrix Reasoning Task's generator from fixed seeds, without striped or dotted fills. One, two or three rules over number, size, rotation and color; 4 options, or 8 for the three-rule grid.
Word problems
Order, days of the week, a family and ages, written for each of the eight session languages with names that fit the language. 4 or 6 options.
Cubes
A cube with a different symbol on each face, seen from one corner. Of 6 pictures, exactly one shows the same cube turned another way, checked by our code; each other picture turns a known symbol on its face or swaps two.
Practice
One practice puzzle before each kind, with its answer shown.
Answer
One click or tap on an option, with no time limit. Mouse, touch or keyboard.
Score
The percentage of puzzles answered correctly, overall and for each kind, with puzzles correct and the median answer time.

The puzzles are this library's own; the ICAR's items are not used. The word problems are written in each session language, and the series, grids and cubes need no language. The scores support research and make no IQ claim.

Quality checks

Each session is marked valid, needs review or invalid, with the reason, before you see its scores.

Scored rows: mixed_reasoning_item from the scored run, 16 puzzles (12 in a language without word problems) with 4, 6 or 8 options each and no time limit; chance is 1 over the options of each puzzle. Below chance invalidates and not above chance is flagged. One answer position on 90% of the puzzles invalidates when accuracy is not above chance. Answers under 200 ms on at least half the puzzles invalidate. Fewer than half the puzzles answered invalidates and any other unanswered puzzle is flagged. A hidden tab withholds the percentile.

Why these rules

Accuracy significantly below chance (one-sided exact test, p < .05) cannot come from guessing; it means the response mapping was reversed or the task was not followed (Slick, Sherman and Iverson 1999 treat below-chance forced-choice performance as definite response bias). Chance-level accuracy can be a real result in impaired participants, so it is only flagged. The right answers sit at different positions from puzzle to puzzle. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. Another tab can be used to look up or work out an answer, so a percentile is withheld after a hidden tab.

Running this test

Settings you can change

This test runs with fixed settings.

How test settings work

Need a different version of this test?

Devices and languages

  • Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
  • Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
  • Available on: Every plan, including the free plan.
  • Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.

Cite and describe

Methods text, with the standard settings

Participants completed the Mixed Reasoning Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Condon & Revelle, 2014). The main score was percent correct (puzzles answered correctly, as a percentage of the puzzles answered).

ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.

  • Condon, D. M., & Revelle, W. (2014). The international cognitive ability resource: Development and initial validation of a public-domain measure. Intelligence, 43, 52-64. https://doi.org/10.1016/j.intell.2014.01.004The four kinds of item, letter and number series, matrices, verbal reasoning and three-dimensional rotation, answered by choice with no time limit.
  • Condon, D. M., & Revelle, W. (2016). Selected ICAR data from the SAPA-Project: Development and initial validation of a public-domain measure. Journal of Open Psychology Data, 4(1), e1. https://doi.org/10.5334/jopd.25The ICAR items' untimed multiple-choice format and their public item-level data.

Source papers

  • Condon DM, Revelle W (2014). The international cognitive ability resource: Development and initial validation of a public-domain measure. Intelligence, 43:52-64.Paradigm source, Adults
  • Condon DM, Revelle W (2016). Selected ICAR data from the SAPA-Project: Development and initial validation of a public-domain measure. Journal of Open Psychology Data, 4(1):e1.Paradigm source, Adults

Questions

How long does the Mixed Reasoning Task take?

About 8 to 12 minutes, as listed in the test library.

What device does a participant need?

Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.

What scores does it produce?

Percent Correct, Series Correct, Grids Correct, Word Problems Correct, Cubes Correct, Puzzles Correct, Median Answer Time, Puzzles Answered and Planned Puzzles. Each session is also marked valid, needs review or invalid, with the reason.

How widely is the Mixed Reasoning Task used in research?

17 papers from 2021 to 2025 name it in their title or abstract, about the same as from 2016 to 2020. That ranks it 622 of 711 test families in the ConductCognition test census (use grade E). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

How much reliability evidence does the Mixed Reasoning Task have?

In the published research, 1 paper reports its test-retest reliability and 1 registered clinical study uses it as an outcome (evidence grade C in the ConductCognition test census).

Which languages can participants use?

Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese, with its words in the same language. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.

Is this a clinical test?

No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.

Every test: the full test list.

New tests and features, about once a month. Unsubscribe at any time.

Run this test in your next study

Start free with 10 free participants on any test, then use participant credits or a yearly plan.

Start free

Related tests

Matrix ReasoningNumber Sequence Task3D Mental Rotation Test
ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Big Five personality test
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • ConductScience Fellows
© 2026 ConductScience, Inc. Research use only.