Reasoning
Conditional Reasoning Task
Also called: conditional inference task, if-then reasoning task, modus ponens and modus tollens problems, suppression task
Measure how people reason from if-then rules: participants judge whether conclusions must follow in the four inference forms, with abstract, believable and unbelievable rules.
7-10 minUntimed
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 63
- Evidence grade
- C
- Registered clinical studies
- 0
What it measures
Measures reasoning from if-then rules and how far belief pulls on it. Participants read a rule, a fact and a conclusion and answer whether the conclusion must be true, on 36 problems: abstract, believable and unbelievable rules, each in the four forms of the conditional inference task. The main score counts the problems answered by their logic. The problems are written in each of the eight languages.
Constructs
- Deductive reasoning
- Conditional inference
- Belief bias
- Analytic thinking
Research uses
- Reasoning and judgment research
- Individual differences in belief bias
- Development of reasoning
- Within-study group comparison
How the paradigm works
The conditional reasoning task measures reasoning from if-then rules and how far belief pulls on it (Cummins, Lubart, Alksnis and Rist 1991; Evans, Handley, Neilens and Over 2010). Each problem shows a rule, "If p, then q", a fact and a conclusion. Participants assume the rule and the fact are true and answer whether the conclusion must be true. Each rule appears in the four forms of the conditional inference task: modus ponens (p, so q) and modus tollens (not q, so not p), which are valid, and affirming the consequent (q, so p) and denying the antecedent (not p, so not q), which are invalid.
More about the paradigm
The 36 standard problems use 3 abstract rules about a letter and a number on a card, 3 believable everyday rules about causes and effects, and 3 unbelievable ones, which state a believable rule's effect in the other direction ("If the brake pedal is pressed, then the car speeds up"). The rules were written for this task in each of the eight languages. The session's random seed deals 12 everyday rules to believable and unbelievable, so a rule is not tied to one condition, and orders the problems; both are recorded. Two practice problems on neutral rules have feedback and teach none of the scored forms. The test has no feedback and no time limit.
With the extra premise setting, a second part of 24 problems adds a second rule to 6 more everyday rules, after Byrne (1989). An additional requirement ("If the brakes work, then the car slows down") leads people to reject modus ponens and modus tollens, and an alternative cause ("If the car runs out of fuel, then the car slows down") leads them to reject affirming the consequent and denying the antecedent. The suppression scores compare these problems with the standard part's believable rules.
The main score is the percent of standard problems answered by their logic. Each form's acceptance rate is its share of Yes answers; people who read a rule as "if and only if" accept all four forms. The belief index is the Yes rate on believable rules minus the rate on unbelievable ones: people draw fewer conclusions from rules they disbelieve, even when told to assume the rules are true (Evans, Handley and Bacon 2009). Scores support research and do not diagnose.
Scores
- Percent Correct%
- Percent of the standard problems answered by their logic: Yes on modus ponens and modus tollens, No on affirming the consequent and denying the antecedent.
- Higher means more problems solved by their logic; 50% is chance, and Yes to every form also gives 50%
- Yes Rate, Modus Ponens%
- Share of the standard modus ponens problems (p, so q) answered Yes.
- Valid form; most people accept it
- Yes Rate, Modus Tollens%
- Share of the standard modus tollens problems (not q, so not p) answered Yes.
- Valid form; usually accepted less often than modus ponens
- Yes Rate, Affirming the Consequent%
- Share of the standard affirming the consequent problems (q, so p) answered Yes.
- Invalid form; higher means this conclusion was accepted more
- Yes Rate, Denying the Antecedent%
- Share of the standard denying the antecedent problems (not p, so not q) answered Yes.
- Invalid form; higher means this conclusion was accepted more
- Belief Indexscore
- Yes rate on believable rules minus the rate on unbelievable rules, all four forms of the standard problems.
- Higher means answers followed believability more
- Yes Rate, Modus Ponens, Abstract%
- Share of modus ponens problems with abstract rules answered Yes.
- Higher means more accepted
- Yes Rate, Modus Tollens, Abstract%
- Share of modus tollens problems with abstract rules answered Yes.
- Higher means more accepted
- Yes Rate, Affirming the Consequent, Abstract%
- Share of affirming the consequent problems with abstract rules answered Yes.
- Higher means more accepted
- Yes Rate, Denying the Antecedent, Abstract%
- Share of denying the antecedent problems with abstract rules answered Yes.
- Higher means more accepted
- Yes Rate, Modus Ponens, Believable%
- Share of modus ponens problems with believable rules answered Yes.
- Higher means more accepted
- Yes Rate, Modus Tollens, Believable%
- Share of modus tollens problems with believable rules answered Yes.
- Higher means more accepted
- Yes Rate, Affirming the Consequent, Believable%
- Share of affirming the consequent problems with believable rules answered Yes.
- Higher means more accepted
- Yes Rate, Denying the Antecedent, Believable%
- Share of denying the antecedent problems with believable rules answered Yes.
- Higher means more accepted
- Yes Rate, Modus Ponens, Unbelievable%
- Share of modus ponens problems with unbelievable rules answered Yes.
- Higher means more accepted
- Yes Rate, Modus Tollens, Unbelievable%
- Share of modus tollens problems with unbelievable rules answered Yes.
- Higher means more accepted
- Yes Rate, Affirming the Consequent, Unbelievable%
- Share of affirming the consequent problems with unbelievable rules answered Yes.
- Higher means more accepted
- Yes Rate, Denying the Antecedent, Unbelievable%
- Share of denying the antecedent problems with unbelievable rules answered Yes.
- Higher means more accepted
- Suppression by an Extra Requirementscore
- Mean Yes rate of modus ponens and modus tollens on the standard believable rules, minus the same with an additional requirement. Empty when the setting is off.
- Positive means the extra requirement suppressed the valid inferences
- Suppression by Another Causescore
- Mean Yes rate of affirming the consequent and denying the antecedent on the standard believable rules, minus the same with an alternative cause. Empty when the setting is off.
- Positive means the other cause suppressed the invalid inferences
- Yes Rate, Modus Ponens, Extra Requirement%
- Share of modus ponens problems with an additional requirement answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Modus Tollens, Extra Requirement%
- Share of modus tollens problems with an additional requirement answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Affirming the Consequent, Extra Requirement%
- Share of affirming the consequent problems with an additional requirement answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Denying the Antecedent, Extra Requirement%
- Share of denying the antecedent problems with an additional requirement answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Modus Ponens, Another Cause%
- Share of modus ponens problems with an alternative cause answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Modus Tollens, Another Cause%
- Share of modus tollens problems with an alternative cause answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Affirming the Consequent, Another Cause%
- Share of affirming the consequent problems with an alternative cause answered Yes. Empty when the setting is off.
- Higher means more accepted
- Yes Rate, Denying the Antecedent, Another Cause%
- Share of denying the antecedent problems with an alternative cause answered Yes. Empty when the setting is off.
- Higher means more accepted
- Median Response Timems
- Median time from a problem's appearance to its answer, leaving out answers under 100 ms.
- Describes pace; the test has no time limit
- Answers Under 100 mscount
- Problems answered within 100 ms.
- Expected to be 0
- Problems Completedtrials
- Problems answered in the scored run.
- A session with fewer than 27 is invalid
- Longest Same Answer Runtrials
- The longest run of one answer.
- 12 or more is flagged for review
Use and evidence
63 papers from 2021 to 2025 name this task in their title or abstract, down 37% compared with 2016 to 2020. That ranks it 405 of 711 test families in our census. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 16 |
| 2024 | 16 |
| 2023 | 7 |
| 2022 | 11 |
| 2021 | 13 |
| 2020 | 11 |
| 2019 | 26 |
| 2018 | 17 |
| 2017 | 22 |
| 2016 | 24 |
| 2015 | 16 |
| 2014 | 14 |
| 2013 | 26 |
| 2012 | 15 |
| 2011 | 24 |
| 2010 | 19 |
| 2009 | 14 |
| 2008 | 16 |
| 2007 | 12 |
| 2006 | 10 |
| 2005 | 9 |
| 2004 | 18 |
| 2003 | 5 |
| 2002 | 7 |
| 2001 | 2 |
| 2000 | 3 |
Use grade D
30 to 99 papers from 2021 to 2025.
Evidence grade C
At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.
- Papers on test-retest reliability
- 2
- Papers on reliability or validity
- 78
- Registered clinical studies using it as an outcome
- 0
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
Note on the counts: Original rules in each language; believability judged by the author, not rated; no population norms..
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.
Source: ConductCognition test census 0.58.0, counted 12 November 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Problems
- 36 problems: 3 abstract rules about a letter and a number on a card, 3 believable everyday rules and 3 unbelievable ones, each in the 4 forms.
- Forms
- Modus ponens (p, so q) and modus tollens (not q, so not p) are valid; affirming the consequent (q, so p) and denying the antecedent (not p, so not q) are invalid. Each rule appears in all 4 forms, and negations say "not".
- Contents
- Everyday rules about causes and effects, written for this task in each of the eight languages, with no person named and nothing about politics, religion, health or groups. An unbelievable rule states a believable rule's effect in the other direction: "If the brake pedal is pressed, then the car speeds up."
- Assignment
- The session's seed deals 12 everyday rules to believable and unbelievable, so a rule is not tied to one condition, and orders the problems with no more than 4 of one correct answer in a row and never one rule twice in a row. All of it is saved.
- Answer
- Yes or No to whether the conclusion must be true when the rule and the fact are true, with no time limit and no feedback. The side of each button is drawn from the seed and saved.
- Practice
- 2 problems on neutral rules outside the set, each followed by feedback: a modus ponens, and a conclusion the rule and the fact do not give.
- Extra premise
- Off by default. As a setting, a second part of 24 problems adds a second rule to 6 more everyday rules: an additional requirement or an alternative cause. Gives each form's acceptance with each second rule and two suppression scores.
The rules and sentences were written for this task in each language; no published problem set is used.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: conditional_reasoning_problem from the scored run, one Yes or No answer per problem, half of them valid, so chance is 50%. Accuracy below chance and one answer on at least 90% of problems are flagged for review and never invalidate. Answers under 200 ms on at least half of 4 or more problems invalidate. Fewer than 27 problems completed invalidates. A run of 12 or more of one answer is flagged for review. A hidden tab is flagged.
Why these rules
People who read an if-then rule as "if and only if" accept all four forms, and many also reject modus tollens, so a real reasoner can answer Yes on nearly every problem or score below chance; both flag and never exclude. An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. The forms and contents need most of the 36 standard problems for their rates to mean the same thing across sessions, so fewer than three quarters invalidates. Correct answers never run longer than 4 in a row, so a much longer run of one answer is flagged. Nothing runs while the tab is hidden, so a hidden tab is flagged.
Running this test
Settings you can change
| Setting | Standard | Allowed |
|---|---|---|
| Extra premise | Off | On or off |
Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.
Need a setting this test does not have?
Devices and languages
- Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Conditional Reasoning Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Cummins, Lubart, Alksnis & Rist, 1991; Byrne, 1989), with the standard settings (extra premise: Off). The main score was percent correct (percent of the standard problems answered by their logic: Yes on modus ponens and modus tollens, No on affirming the consequent and denying the antecedent).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Cummins, D. D., Lubart, T., Alksnis, O., & Rist, R. (1991). Conditional reasoning and causation. Memory & Cognition, 19(3), 274-282. https://doi.org/10.3758/BF03211151
- Byrne, R. M. J. (1989). Suppressing valid inferences with conditionals. Cognition, 31(1), 61-83. https://doi.org/10.1016/0010-0277(89)90018-8Additional requirements and alternative causes, the extra premise setting.
- Evans, J. St. B. T., Handley, S. J., & Bacon, A. M. (2009). Reasoning under time pressure: A study of causal conditional inference. Experimental Psychology, 56(2), 77-83. https://doi.org/10.1027/1618-3169.56.2.77Fewer conclusions drawn from disbelieved rules, even under instructions to assume them true.
- Evans, J. St. B. T., Handley, S. J., Neilens, H., & Over, D. (2010). The influence of cognitive ability and instructional set on causal conditional inference. Quarterly Journal of Experimental Psychology, 63(5), 892-909. https://doi.org/10.1080/17470210903111821Believable and unbelievable causal conditionals.
Source papers
- Cummins DD, Lubart T, Alksnis O, Rist R (1991). Conditional reasoning and causation. Memory & Cognition, 19(3):274-282.Paradigm source, Adults
- Byrne RMJ (1989). Suppressing valid inferences with conditionals. Cognition, 31(1):61-83.Paradigm source, Adults
- Evans JStBT, Handley SJ, Neilens H, Over D (2010). The influence of cognitive ability and instructional set on causal conditional inference. Quarterly Journal of Experimental Psychology, 63(5):892-909.Paradigm source, Adults
Questions
How long does the Conditional Reasoning Task take?
About 7 to 10 minutes, as listed in the test library.
What device does a participant need?
Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Percent Correct, Yes Rate, Modus Ponens, Yes Rate, Modus Tollens, Yes Rate, Affirming the Consequent, Yes Rate, Denying the Antecedent, Belief Index, Yes Rate, Modus Ponens, Abstract, Yes Rate, Modus Tollens, Abstract, Yes Rate, Affirming the Consequent, Abstract, Yes Rate, Denying the Antecedent, Abstract, Yes Rate, Modus Ponens, Believable, Yes Rate, Modus Tollens, Believable, Yes Rate, Affirming the Consequent, Believable, Yes Rate, Denying the Antecedent, Believable, Yes Rate, Modus Ponens, Unbelievable, Yes Rate, Modus Tollens, Unbelievable, Yes Rate, Affirming the Consequent, Unbelievable, Yes Rate, Denying the Antecedent, Unbelievable, Suppression by an Extra Requirement, Suppression by Another Cause, Yes Rate, Modus Ponens, Extra Requirement, Yes Rate, Modus Tollens, Extra Requirement, Yes Rate, Affirming the Consequent, Extra Requirement, Yes Rate, Denying the Antecedent, Extra Requirement, Yes Rate, Modus Ponens, Another Cause, Yes Rate, Modus Tollens, Another Cause, Yes Rate, Affirming the Consequent, Another Cause, Yes Rate, Denying the Antecedent, Another Cause, Median Response Time, Answers Under 100 ms, Problems Completed and Longest Same Answer Run. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Conditional Reasoning Task used in research?
63 papers from 2021 to 2025 name it in their title or abstract, down 37% compared with 2016 to 2020. That ranks it 405 of 711 test families in the ConductCognition test census (use grade D). Source: ConductCognition test census 0.58.0, counted 12 November 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Conditional Reasoning Task have?
In the published research, 2 papers report its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade C in the ConductCognition test census).
Which settings can a researcher change?
Extra premise (On or off). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings.
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese, with its words in the same language. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.