Reasoning
Mixed Reasoning Task
Also called: ICAR-style reasoning items, short reasoning test, letter and number series, matrix reasoning items, verbal reasoning items, three-dimensional rotation items
Measure reasoning with 16 short puzzles of four kinds, letter and number series, picture grids, word problems and turned cubes, all made for this task and scored by kind.
8-12 minUntimed
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 17
- Evidence grade
- C
- Registered clinical studies
- 1
What it measures
Measures reasoning with 16 short puzzles of four kinds: letter and number series, picture grids, word problems and cubes turned another way, four of each after a practice puzzle. The score is the percentage answered correctly, overall and for each kind.
Constructs
- Fluid reasoning
- Inductive reasoning
- Verbal reasoning
- Spatial visualization
Research uses
- Short reasoning measure in research batteries
- Individual-differences and cognitive aging research
- Reasoning as a covariate in cognitive studies
- Within-study group comparison
How the paradigm works
The Mixed Reasoning Task is a short check of reasoning with puzzles of four kinds. Each puzzle has one right answer among its options, and there is no time limit. The design follows the sample test of the International Cognitive Ability Resource (ICAR; Condon and Revelle 2014), a public-domain set of untimed multiple-choice items of four kinds: letter and number series, matrices, verbal reasoning and three-dimensional rotation.
More about the paradigm
Every puzzle was made for this task; the ICAR's items are not used. The series are rows of letters or numbers that follow a rule our code checks, with six options; under rows of letters the alphabet is shown in order, so knowing it by heart does not matter. The grids are 3 by 3 pictures with one empty square, drawn from fixed seeds by the generator of the Matrix Reasoning Task, needing one, two or three rules, with 4 or 8 options. The word problems, about order, days of the week, a family and ages, are written for each session language, with 4 or 6 options. Each cube has a different symbol on each face; the participant chooses which of six pictures shows the same cube turned another way, and our code checks that exactly one can. Each kind starts with a practice puzzle and its answer, then four puzzles from easier to harder, for 16 puzzles in one order for everyone.
The main score is the percentage of puzzles answered correctly. The same percentage is reported for each kind, with puzzles correct, puzzles answered and the median answer time. Scores support research and make no IQ claim.
Scores
- Percent Correct%
- Puzzles answered correctly, as a percentage of the puzzles answered.
- Higher is better
- Series Correct%
- The same for the 4 letter and number series.
- Higher is better
- Grids Correct%
- The same for the 4 picture grids.
- Higher is better
- Word Problems Correct%
- The same for the 4 word problems.
- Higher is better
- Cubes Correct%
- The same for the 4 cube puzzles.
- Higher is better
- Puzzles Correctcount
- Puzzles answered correctly, out of 16.
- Higher is better
- Median Answer Timems
- Median time from a puzzle appearing to its answer.
- Informational; the task has no time limit
- Puzzles Answeredcount
- Puzzles with an answer.
- Fewer than half the planned puzzles invalidates
- Planned Puzzlescount
- 16: 4 of each kind.
- Informational
Use and evidence
17 papers from 2021 to 2025 name this task in their title or abstract, about the same as from 2016 to 2020. That ranks it 622 of 711 test families in our census. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 5 |
| 2024 | 0 |
| 2023 | 5 |
| 2022 | 4 |
| 2021 | 3 |
| 2020 | 6 |
| 2019 | 4 |
| 2018 | 1 |
| 2017 | 0 |
| 2016 | 6 |
| 2015 | 2 |
| 2014 | 2 |
| 2013 | 1 |
| 2012 | 0 |
| 2011 | 0 |
| 2010 | 0 |
| 2009 | 0 |
| 2008 | 0 |
| 2007 | 0 |
| 2006 | 0 |
| 2005 | 0 |
| 2004 | 0 |
| 2003 | 0 |
| 2002 | 0 |
| 2001 | 0 |
| 2000 | 0 |
Use grade E
Fewer than 30 papers from 2021 to 2025.
Evidence grade C
At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.
- Papers on test-retest reliability
- 1
- Papers on reliability or validity
- 33
- Registered clinical studies using it as an outcome
- 1
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.
Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Puzzles
- 16 made for this task, 4 of each kind, in one order for everyone: letter and number series, picture grids, word problems and cubes. Within each kind they run from easier to harder.
- Series
- Rows of 5 or 6 letters or numbers that follow a rule: a fixed step, a step that grows, double and add one, or two rows taking turns. 6 options. Under rows of letters the alphabet is shown in order.
- Grids
- 3 by 3 pictures with one empty square, drawn by the Matrix Reasoning Task's generator from fixed seeds, without striped or dotted fills. One, two or three rules over number, size, rotation and color; 4 options, or 8 for the three-rule grid.
- Word problems
- Order, days of the week, a family and ages, written for each of the eight session languages with names that fit the language. 4 or 6 options.
- Cubes
- A cube with a different symbol on each face, seen from one corner. Of 6 pictures, exactly one shows the same cube turned another way, checked by our code; each other picture turns a known symbol on its face or swaps two.
- Practice
- One practice puzzle before each kind, with its answer shown.
- Answer
- One click or tap on an option, with no time limit. Mouse, touch or keyboard.
- Score
- The percentage of puzzles answered correctly, overall and for each kind, with puzzles correct and the median answer time.
The puzzles are this library's own; the ICAR's items are not used. The word problems are written in each session language, and the series, grids and cubes need no language. The scores support research and make no IQ claim.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: mixed_reasoning_item from the scored run, 16 puzzles (12 in a language without word problems) with 4, 6 or 8 options each and no time limit; chance is 1 over the options of each puzzle. Below chance invalidates and not above chance is flagged. One answer position on 90% of the puzzles invalidates when accuracy is not above chance. Answers under 200 ms on at least half the puzzles invalidate. Fewer than half the puzzles answered invalidates and any other unanswered puzzle is flagged. A hidden tab withholds the percentile.
Why these rules
Accuracy significantly below chance (one-sided exact test, p < .05) cannot come from guessing; it means the response mapping was reversed or the task was not followed (Slick, Sherman and Iverson 1999 treat below-chance forced-choice performance as definite response bias). Chance-level accuracy can be a real result in impaired participants, so it is only flagged. The right answers sit at different positions from puzzle to puzzle. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. Another tab can be used to look up or work out an answer, so a percentile is withheld after a hidden tab.
Running this test
Settings you can change
This test runs with fixed settings.
Need a different version of this test?
Devices and languages
- Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Mixed Reasoning Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Condon & Revelle, 2014). The main score was percent correct (puzzles answered correctly, as a percentage of the puzzles answered).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Condon, D. M., & Revelle, W. (2014). The international cognitive ability resource: Development and initial validation of a public-domain measure. Intelligence, 43, 52-64. https://doi.org/10.1016/j.intell.2014.01.004The four kinds of item, letter and number series, matrices, verbal reasoning and three-dimensional rotation, answered by choice with no time limit.
- Condon, D. M., & Revelle, W. (2016). Selected ICAR data from the SAPA-Project: Development and initial validation of a public-domain measure. Journal of Open Psychology Data, 4(1), e1. https://doi.org/10.5334/jopd.25The ICAR items' untimed multiple-choice format and their public item-level data.
Source papers
- Condon DM, Revelle W (2014). The international cognitive ability resource: Development and initial validation of a public-domain measure. Intelligence, 43:52-64.Paradigm source, Adults
- Condon DM, Revelle W (2016). Selected ICAR data from the SAPA-Project: Development and initial validation of a public-domain measure. Journal of Open Psychology Data, 4(1):e1.Paradigm source, Adults
Questions
How long does the Mixed Reasoning Task take?
About 8 to 12 minutes, as listed in the test library.
What device does a participant need?
Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Percent Correct, Series Correct, Grids Correct, Word Problems Correct, Cubes Correct, Puzzles Correct, Median Answer Time, Puzzles Answered and Planned Puzzles. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Mixed Reasoning Task used in research?
17 papers from 2021 to 2025 name it in their title or abstract, about the same as from 2016 to 2020. That ranks it 622 of 711 test families in the ConductCognition test census (use grade E). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Mixed Reasoning Task have?
In the published research, 1 paper reports its test-retest reliability and 1 registered clinical study uses it as an outcome (evidence grade C in the ConductCognition test census).
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese, with its words in the same language. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.