Reasoning
Both Sides Task
Also called: myside bias, my-side bias, myside thinking, argument evaluation, evaluation bias, prior belief effect in argument evaluation
Measure the myside bias: participants say how much they agree with everyday claims, then rate the strength of arguments for and against each claim, matched in quality by design.
6-8 minUntimed
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 73
- Evidence grade
- D
- Registered clinical studies
- 0
What it measures
Measures the myside bias. Participants say how much they agree with 8 everyday claims, such as that a town should close its main street to cars on Sundays, then rate the strength of 4 arguments about each claim, two for it and two against it, matched in quality by design. The main score is how much stronger the arguments on the participant's own side are rated.
Constructs
- Myside bias
- Argument evaluation
- Belief-consistent reasoning
- Actively open-minded thinking
Research uses
- Reasoning and critical thinking research
- Judgment and decision-making research
- Education research
- Within-study group comparison
How the paradigm works
The both sides task measures the myside bias: people rate arguments that support their own view as stronger than equally good arguments against it. Stanovich and West (1997) built an argument evaluation test in which 349 students rated arguments about real-life issues, and a regression for each student separated the weight of the arguments' objective quality from the weight of the student's prior belief. In three experiments with over 1,200 participants, Stanovich and West (2008) found higher ratings for arguments that supported people's opinions than for arguments that refuted them, and the strength of the prior opinion predicted the size of the difference. Across these studies the myside bias was nearly unrelated to cognitive ability (Stanovich, West and Toplak, 2013), unlike belief bias in syllogisms, where people are told to set their beliefs aside; Stanovich and West (2007) call the bias natural when nothing tells people to avoid it. McCrudden and colleagues (2017) crossed strong and weak arguments with whether they fit a person's belief, and taking an expert's perspective removed the bias for weak arguments but not for strong ones.
More about the paradigm
Here, 8 everyday claims written for this task, such as that a town should close its main street to cars on Sundays, are first rated for agreement from 1 (strongly disagree) to 6 (strongly agree), with no middle point. Then each claim comes back with four arguments, a strong and a weak one for it and against it, matched in quality by design, each rated from 1 (very weak) to 7 (very strong). The main score is the mean rating of the arguments on the participant's own side minus that of the arguments on the other side.
Scores
- Myside Advantagescore
- Over the claims with an agreement and all four arguments rated, the mean strength rating of the arguments on the participant's side minus that of the arguments on the other side, from -6 to 6.
- Positive means arguments on one's own side were rated stronger than arguments of the same quality against it, the myside bias
- Myside Advantage on Strong Argumentsscore
- The same difference between the two strong arguments of each claim.
- Informational
- Myside Advantage on Weak Argumentsscore
- The same difference between the two weak arguments of each claim.
- Informational
- Quality Sensitivityscore
- Mean rating of the strong arguments minus that of the weak ones, over all claims.
- Higher means strong and weak arguments were told apart more
- Advantage for Arguments in Favorscore
- Mean rating of the arguments for the claims minus that of the arguments against them, whatever the participant's view.
- Informational; read with the share of claims agreed with
- Myside Advantage With Strong Viewsscore
- The myside advantage over the claims rated 1 or 6.
- Informational
- Myside Advantage With Weaker Viewsscore
- The myside advantage over the claims rated 2 to 5.
- Informational
- Rating of Own-Side Argumentsscore
- Mean strength rating of the arguments on the participant's side, from 1 to 7.
- Informational
- Rating of Other-Side Argumentsscore
- Mean strength rating of the arguments on the other side, from 1 to 7.
- Informational
- Claims Agreed With%
- The share of claims rated 4 to 6 for agreement.
- Informational
- Median Rating Timems
- Median time from a rating screen appearing to a rating, in both parts, over ratings at or after 100 ms.
- Informational
- Ratings Under 100 mscount
- Ratings made less than 100 ms after their screen appeared, in both parts.
- 0 expected
- Arguments Ratedcount
- Arguments rated, four for each claim.
- Informational
Use and evidence
73 papers from 2021 to 2025 name this task in their title or abstract, up 92% compared with 2016 to 2020. That ranks it 355 of 711 test families in our census. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 17 |
| 2024 | 19 |
| 2023 | 13 |
| 2022 | 14 |
| 2021 | 10 |
| 2020 | 14 |
| 2019 | 4 |
| 2018 | 7 |
| 2017 | 7 |
| 2016 | 6 |
| 2015 | 5 |
| 2014 | 3 |
| 2013 | 3 |
| 2012 | 4 |
| 2011 | 3 |
| 2010 | 3 |
| 2009 | 5 |
| 2008 | 4 |
| 2007 | 2 |
| 2006 | 1 |
| 2005 | 0 |
| 2004 | 1 |
| 2003 | 1 |
| 2002 | 0 |
| 2001 | 0 |
| 2000 | 1 |
Use grade D
30 to 99 papers from 2021 to 2025.
Evidence grade D
Little published measurement evidence found.
- Papers on test-retest reliability
- 0
- Papers on reliability or validity
- 9
- Registered clinical studies using it as an outcome
- 0
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.
Source: ConductCognition test census 0.58.0, counted 13 November 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Claims
- 8 everyday claims written for this task, such as that a town should close its main street to cars on Sundays, or the first 6 in the short form. None has political, religious, group, health or real-person content. They are shown in the session's language.
- Arguments
- 4 for each claim, matched in quality by design: a strong argument for it and a strong one against it, each a relevant reason with its consequence written in parallel, and a weak one on each side sharing one flaw, such as an anecdote or what people online say. None is a published item.
- Ratings
- Part 1: agreement with each claim from 1 (strongly disagree) to 6 (strongly agree), with no middle number. Part 2, after a check with feedback: each argument with its claim and its side, rated from 1 (very weak) to 7 (very strong). The claims come in a new order, each with its four arguments together; both orders are drawn from the session's seed.
- Own view
- As standard nothing asks participants to set their own view aside, as in natural myside bias studies. A study can add one sentence before the arguments asking them to judge each argument only by how good a reason it gives.
- Scores
- The myside advantage: over the claims, the mean rating of the arguments on the participant's side minus that of the arguments on the other side, from -6 to 6, with the arguments' quality balanced within each claim. Also the same difference for strong and for weak arguments, the gap between strong and weak arguments, the lean toward arguments in favor of the claims, and the advantage for claims held strongly or less strongly.
Stanovich and West (2008) found people rate arguments on their own side as stronger, and this myside bias is nearly unrelated to cognitive ability (Stanovich, West and Toplak, 2013). This task uses that method with claims and arguments of its own, none from their tests, and balances argument quality by design rather than by expert ratings. Scores describe how much a person's view moves their ratings and are best compared between groups; they do not show how well a person reasons and do not diagnose.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: the scored run's ratings of the arguments, with the agreement ratings of the same run. No rating is correct, so accuracy is not judged against chance. A run with no claim that has an agreement and all four arguments rated, or with fewer than half the arguments rated, is invalid, and any other shortfall is flagged; one number chosen for at least 90% of the argument ratings is flagged. Ratings under 200 ms on at least half the screens invalidate.
Why these rules
There is no correct option to compare with chance, so accuracy is not judged against chance. The scores describe how much a person's own view moves the rated strength of arguments matched in quality, so any rating is a possible answer, and so is rating every argument the same. The myside bias needs each claim's view and its four arguments. One number for nearly every rating suggests the scale was not used; it is flagged for review because it can also be a real answer. An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast.
No percentile. Scores and quality flags only.
Running this test
Settings you can change
| Setting | Standard | Allowed |
|---|---|---|
| Claims | 8 claims (standard) | 6 claims, 8 claims (standard) |
| Own view | No instruction about one's own view (standard) | No instruction about one's own view (standard), Ask participants to set their own view aside |
Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.
Need a setting this test does not have?
Devices and languages
- Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- No percentile. Scores and quality flags only. How norms work
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Both Sides Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Stanovich KE, West RF, 2007, 2008; Stanovich KE, West RF, Toplak ME, 2013), with the standard settings (claims: 8 claims; own view: No instruction about one's own view). The main score was myside advantage (over the claims with an agreement and all four arguments rated, the mean strength rating of the arguments on the participant's side minus that of the arguments on the other side, from -6 to 6).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Stanovich, K. E., & West, R. F. (2007). Natural myside bias is independent of cognitive ability. Thinking & Reasoning, 13(3), 225-247. https://doi.org/10.1080/13546780600780796
- Stanovich, K. E., & West, R. F. (2008). On the failure of cognitive ability to predict myside and one-sided thinking biases. Thinking & Reasoning, 14(2), 129-167. https://doi.org/10.1080/13546780701679764Higher ratings for arguments that supported people's opinions in three experiments with over 1,200 participants.
- Stanovich, K. E., West, R. F., & Toplak, M. E. (2013). Myside bias, rational thinking, and intelligence. Current Directions in Psychological Science, 22(4), 259-264. https://doi.org/10.1177/0963721413480174
- Stanovich, K. E., & West, R. F. (1997). Reasoning independently of prior belief and individual differences in actively open-minded thinking. Journal of Educational Psychology, 89(2), 342-357. https://doi.org/10.1037/0022-0663.89.2.342Argument quality separated from prior belief by a regression for each person.
- McCrudden, M. T., Barnes, A., McTigue, E. M., Welch, C., & MacDonald, E. (2017). The effect of perspective-taking on reasoning about strong and weak belief-relevant arguments. Thinking & Reasoning, 23(2), 115-133. https://doi.org/10.1080/13546783.2016.1234411Strong and weak arguments crossed with whether they fit a person's belief.
Source papers
Questions
How long does the Both Sides Task take?
About 6 to 8 minutes, as listed in the test library.
What device does a participant need?
Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Myside Advantage, Myside Advantage on Strong Arguments, Myside Advantage on Weak Arguments, Quality Sensitivity, Advantage for Arguments in Favor, Myside Advantage With Strong Views, Myside Advantage With Weaker Views, Rating of Own-Side Arguments, Rating of Other-Side Arguments, Claims Agreed With, Median Rating Time, Ratings Under 100 ms and Arguments Rated. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Both Sides Task used in research?
73 papers from 2021 to 2025 name it in their title or abstract, up 92% compared with 2016 to 2020. That ranks it 355 of 711 test families in the ConductCognition test census (use grade D). Source: ConductCognition test census 0.58.0, counted 13 November 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Both Sides Task have?
In the published research, 0 papers report its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade D in the ConductCognition test census).
Does it report a percentile?
No. Scores and quality flags only.
Which settings can a researcher change?
Claims (6 claims, 8 claims (standard)) and own view (No instruction about one's own view (standard), Ask participants to set their own view aside). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings.
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese, with its words in the same language. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.