Reasoning
Proportional Reasoning Task
Also called: orange juice task, ratio comparison task, missing-value problems, mixture problems, rate problems, additive strategy task
Measure proportional reasoning: participants judge which drawn juice jug tastes more of orange and which runner was faster, and solve missing-value word problems, scored as accuracy and the share of additive answers on items built to draw them.
6-10 minUntimed
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 362
- Evidence grade
- C
- Registered clinical studies
- 0
What it measures
Measures proportional reasoning. Participants judge which of two drawn juice jugs tastes more of orange and which of two runners was faster, then solve short word problems such as what 6 pencils cost if 2 cost 5 points. Many items tempt an additive answer. The main score is accuracy; the share of additive answers is scored too.
Constructs
- Proportional reasoning
- Multiplicative reasoning
- Additive strategy
- Rational number understanding
Research uses
- Mathematics education research
- Numerical cognition research
- Scientific reasoning research
- Comparing kinds of proportion problems within a study
How the paradigm works
The proportional reasoning task measures whether people compare and scale quantities by their ratios or by their differences (Noelting, 1980; Tourniaire and Pulos, 1985). In three parts, people judge which of two jugs, mixed from drawn glasses of orange juice and of water, tastes more of orange; which of two runners, drawn with their laps and minutes, was faster; and solve word problems written for this task in each language, such as what 6 pencils cost if 2 cost 5 points. Each comparison has three answers: A, B or the same. Of the 16 comparisons, 12 give a different answer when the counts are subtracted than when their ratios are compared: equal ratios at two sizes, equal differences with unequal ratios, and differences that favor the other side. The 8 word problems scale an amount by a whole factor or by a factor that is not whole, and their additive answer adds the change in the count. Each part starts with one practice question with feedback; the 24 test questions have no time limit and no feedback.
Scores
- Accuracy%
- Right answers over the questions shown, 24 in a complete run.
- Higher is better
- Juice Jugs Accuracy%
- Accuracy on the 8 juice jug comparisons.
- Higher is better
- Runners Accuracy%
- Accuracy on the 8 runner comparisons.
- Higher is better
- Word Problems Accuracy%
- Accuracy on the 8 word problems.
- Higher is better
- Accuracy by Kind of Item%
- Accuracy on the control, same ratio, same difference and conflict comparisons, and on the word problems with a whole or a part scale factor.
- Lower on the lure kinds than on control items means the lures worked
- Additive Answers%
- Share of the 20 questions whose additive answer differs from the right one that got the additive answer: the side with the larger difference, or the amount plus the change in the count.
- Higher means more additive reasoning
- Additive Answers, Comparisons%
- Additive answers on the 12 lure comparisons.
- Higher means more additive reasoning
- Additive Answers, Word Problems%
- Additive answers on the 8 word problems.
- Higher means more additive reasoning
- Median Answer Timems
- Median time from a question appearing to its answer, for answers of at least 100 ms.
- Informational; the task has no time limit
- Answers Under 100 mscount
- Answers given less than 100 ms after their question appeared.
- 0 expected
- Unanswered Word Problemscount
- Word problems left blank or without a number that can be read.
- Quality check
- Questions Answeredcount
- Comparisons answered and word problems with a readable number.
- Informational
- Questionscount
- Questions shown in the scored run.
- Compare with planned questions
- Planned Questionscount
- 24: 8 juice jugs, 8 runners and 8 word problems.
- Informational
Use and evidence
362 papers from 2021 to 2025 name this task in their title or abstract, down 5% compared with 2016 to 2020. That ranks it 84 of 711 test families in our census. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 104 |
| 2024 | 73 |
| 2023 | 61 |
| 2022 | 64 |
| 2021 | 60 |
| 2020 | 78 |
| 2019 | 73 |
| 2018 | 76 |
| 2017 | 74 |
| 2016 | 80 |
| 2015 | 69 |
| 2014 | 47 |
| 2013 | 64 |
| 2012 | 52 |
| 2011 | 45 |
| 2010 | 34 |
| 2009 | 38 |
| 2008 | 28 |
| 2007 | 31 |
| 2006 | 17 |
| 2005 | 23 |
| 2004 | 20 |
| 2003 | 25 |
| 2002 | 8 |
| 2001 | 12 |
| 2000 | 11 |
Use grade B
300 to 999 papers from 2021 to 2025.
Evidence grade C
At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.
- Papers on test-retest reliability
- 0
- Papers on reliability or validity
- 81
- Registered clinical studies using it as an outcome
- 0
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
Note on the counts: includes classroom studies of teaching proportions.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.
Source: ConductCognition test census 0.58.0, counted 13 November 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Parts
- Three parts in a fixed order, each after one practice question with feedback: 8 juice jug comparisons, 8 runner comparisons and 8 word problems, 24 test questions in all.
- Comparisons
- Two sides drawn as glasses of orange juice and of water, or as laps and minutes, with 1 to 6 of each and their counts written below. The answers are A, B or the same.
- Items
- In each part, 2 control comparisons, where one side has more of the first thing and no more of the second, and 2 each with equal ratios at two sizes, equal differences and unequal ratios, and the larger difference on the side with the smaller ratio.
- Word problems
- Written for this library in each language, such as what 6 pencils cost if 2 cost 5 points, with prices in points. 4 scale by a whole factor and 4 by a factor that is not whole. Answers are typed numbers.
- Order
- The questions of each part in an order drawn from the session's seed. No time limit, and no feedback after the practice questions.
- Scores
- Accuracy (the main score), accuracy by part and by kind of item, and the share of additive answers: the side with the larger difference, or the amount plus the change in the count.
The drawings, numbers and problems are this library's own. The scores describe answers to these items, support research and make no school-readiness or diagnostic claim.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: proportional_reasoning_item from the run with the most of them, latest on ties; the chance and repeated-answer checks read the 16 comparisons (three buttons each), and the word problems are typed numbers. Accuracy is not judged against chance. One button on at least 90% of the comparisons invalidates when their accuracy is not above chance. Fewer than half the control comparisons right is flagged, and so is an incomplete run. Answers under 200 ms on at least half of the comparisons invalidate. A hidden tab is flagged.
Why these rules
Answers that follow the additive rule are what the test measures, and they are wrong on 12 of the 16 comparisons, so accuracy below chance is a result and is not judged against chance. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). On the control comparisons both rules give the right answer, so missing most of them means the pictures were not followed. An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. The questions stay on screen until they are answered, so a hidden tab does not change what was shown, but it can mean a calculator or help was used; it is flagged.
Running this test
Settings you can change
This test runs with fixed settings.
Need a different version of this test?
Devices and languages
- Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Proportional Reasoning Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Noelting, 1980; Tourniaire & Pulos, 1985; Boyer, Levine & Huttenlocher, 2008). The main score was accuracy (right answers over the questions shown, 24 in a complete run).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Noelting, G. (1980). The development of proportional reasoning and the ratio concept Part I: Differentiation of stages. Educational Studies in Mathematics, 11(2), 217-253. https://doi.org/10.1007/BF00304357The orange juice task: which mixture of glasses of orange juice and of water tastes more of orange.
- Karplus, R., Pulos, S., & Stage, E. K. (1983). Early adolescents' proportional reasoning on 'rate' problems. Educational Studies in Mathematics, 14(3), 219-233. https://doi.org/10.1007/BF00410539Rate problems, where the strategies used depended on the numbers and the context.
- Tourniaire, F., & Pulos, S. (1985). Proportional reasoning: A review of the literature. Educational Studies in Mathematics, 16(2), 181-204. https://doi.org/10.1007/BF02400937Proportion problems, the strategies used on them, erroneous ones included, and the task factors that affect performance.
- Boyer, T. W., Levine, S. C., & Huttenlocher, J. (2008). Development of proportional reasoning: Where young children go wrong. Developmental Psychology, 44(5), 1478-1490. https://doi.org/10.1037/a0013110Juice mixtures in countable units, where children chose a match in number over a match in proportion.
Source papers
Questions
How long does the Proportional Reasoning Task take?
About 6 to 10 minutes, as listed in the test library.
What device does a participant need?
Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Accuracy, Juice Jugs Accuracy, Runners Accuracy, Word Problems Accuracy, Accuracy by Kind of Item, Additive Answers, Additive Answers, Comparisons, Additive Answers, Word Problems, Median Answer Time, Answers Under 100 ms, Unanswered Word Problems, Questions Answered, Questions and Planned Questions. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Proportional Reasoning Task used in research?
362 papers from 2021 to 2025 name it in their title or abstract, down 5% compared with 2016 to 2020. That ranks it 84 of 711 test families in the ConductCognition test census (use grade B). Source: ConductCognition test census 0.58.0, counted 13 November 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Proportional Reasoning Task have?
In the published research, 0 papers report its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade C in the ConductCognition test census).
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese, with its words in the same language. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.