Reasoning
Equal Sign Task
Also called: mathematical equivalence task, equivalence problems, equal sign understanding, open number sentences, equal sign definition task
Measure understanding of mathematical equivalence: participants find the missing number with the blank on either side of the equal sign, judge equations true or false and choose what the equal sign means, scored as accuracy by equation form with wrong answers sorted by strategy.
4-8 minUntimed
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 57
- Evidence grade
- D
- Registered clinical studies
- 0
What it measures
Measures understanding of the equal sign. Participants type the number that makes an equation true, with the blank on either side of the equal sign (such as 7 + 5 = _ + 4), judge whether equations are true or false and choose the best definition of the equal sign. The main score is accuracy; wrong answers are sorted into adding the numbers before the equal sign, adding every number and copying a number.
Constructs
- Mathematical equivalence
- Relational understanding of the equal sign
- Operational patterns in arithmetic
- Early algebra
Research uses
- Mathematics education research
- Numerical cognition research
- Research on strategy use and errors
- Comparing equation forms within a study
How the paradigm works
The equal sign task measures mathematical equivalence: whether people read the equal sign as a statement that both sides have the same value or as a signal that the answer comes next. Many children solve equations such as 7 + 4 + 5 = 7 + _ by adding every number shown or the numbers before the equal sign, strategies coded since Perry, Church and Goldin-Meadow (1988) (Alibali, 1999; McNeil and Alibali, 2005), and undergraduates make the same errors after their arithmetic habits are primed (McNeil and Alibali, 2005). In three parts, people type the number that makes 12 equations true, with the blank on either side of the equal sign; judge 16 equations true or false, from the standard a + b = c to equations with no operation or with operations on both sides (Rittle-Johnson, Matthews, Taylor and McEldoon, 2011); and choose the best of four definitions of the equal sign.
Scores
- Accuracy%
- Right answers over the questions shown, 29 in a complete run.
- Higher is better
- Missing Numbers Accuracy%
- Accuracy on the 12 equations with a missing number.
- Higher is better
- True or False Accuracy%
- Accuracy on the 16 equations judged true or false.
- Higher is better
- Equivalence Problems Accuracy%
- Accuracy on the 8 missing numbers in equations with operations on both sides of the equal sign.
- Higher is better
- Accuracy by Equation Form%
- Accuracy on each form of missing number, such as solve-blankRight, and on each structure judged, such as judge-noOperations.
- Lower on the nonstandard forms means an operational reading
- Relational Definition0/1
- 1 when the definition chosen is that both sides have the same value, otherwise 0.
- 1 is the relational definition
- Operational Errors%
- Share of the wrong typed numbers that add the numbers before the equal sign or add every number shown.
- Higher means more operational strategies
- Operational Judgments%
- Judgments that follow the answer-comes-next reading, over the 8 equations where it gives the wrong judgment: true equations with operations on the right, no operation or operations on both sides judged false, and a + b = (a + b) + c judged true.
- Higher means more operational judgments
- Add to Equal Sign Errorscount
- Missing numbers answered with the sum of the numbers before the equal sign.
- Informational
- Add All Errorscount
- Missing numbers answered with the sum of every number shown.
- Informational
- Copied Numberscount
- Missing numbers answered with a number copied from the equation.
- Informational
- Other Errorscount
- Wrong typed numbers that match no named error.
- Informational
- Unanswered Missing Numberscount
- Missing numbers left blank or without a number that can be read.
- Quality check
- Median Answer Timems
- Median time from a question appearing to its answer, for answers of at least 100 ms.
- Informational; the task has no time limit
- Answers Under 100 mscount
- Answers given less than 100 ms after their question appeared.
- 0 expected
- Questions Answeredcount
- Judgments, the definition, and missing numbers with a typed number that can be read.
- Informational
- Questionscount
- Questions shown in the scored run.
- Compare with planned questions
- Planned Questionscount
- 29: 12 missing numbers, 16 judgments and 1 definition.
- Informational
- Most Repeated Answercount
- The largest number of missing numbers given one identical number.
- Half the missing numbers or more is flagged
Use and evidence
57 papers from 2021 to 2025 name this task in their title or abstract, up 10% compared with 2016 to 2020. That ranks it 430 of 711 test families in our census. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 10 |
| 2024 | 10 |
| 2023 | 13 |
| 2022 | 18 |
| 2021 | 6 |
| 2020 | 8 |
| 2019 | 13 |
| 2018 | 11 |
| 2017 | 10 |
| 2016 | 10 |
| 2015 | 6 |
| 2014 | 11 |
| 2013 | 9 |
| 2012 | 9 |
| 2011 | 2 |
| 2010 | 3 |
| 2009 | 2 |
| 2008 | 6 |
| 2007 | 7 |
| 2006 | 4 |
| 2005 | 1 |
| 2004 | 3 |
| 2003 | 0 |
| 2002 | 0 |
| 2001 | 0 |
| 2000 | 1 |
Use grade D
30 to 99 papers from 2021 to 2025.
Evidence grade D
Little published measurement evidence found.
- Papers on test-retest reliability
- 0
- Papers on reliability or validity
- 0
- Registered clinical studies using it as an outcome
- 0
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
Note on the counts: mostly classroom studies of children.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.
Source: ConductCognition test census 0.58.0, counted 14 November 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Parts
- Three parts in a fixed order: 12 equations with a missing number, 16 equations to judge true or false and the best of 4 definitions of the equal sign, 29 questions in all. The first two parts start with one practice question with feedback.
- Missing numbers
- Addition equations with the blank after the operations (6 + 7 = _) or before them (_ = 8 + 6), and with operations on both sides, the blank on the right (7 + 5 = _ + 4, 3 + 5 + 6 = 3 + _) or on the left (_ + 5 = 6 + 8). The answer is typed in a box in the blank's place.
- True or false
- Four structures, each true twice and false twice: a + b = c, c = a + b, a = a and a + b = c + d, whose false ones read a + b = (a + b) + c.
- Definitions
- Both sides have the same value, the answer comes next, the total of all the numbers, and the end of the problem, in an order drawn from the session's seed.
- Order
- The questions of each part in an order drawn from the session's seed. No time limit, and no feedback after the practice questions.
- Scores
- Accuracy (the main score), by part and by equation form, the relational definition, and the share of wrong answers that add the numbers before the equal sign or add every number shown. Copied numbers are counted too.
The equations and definitions are this library's own. The scores describe answers to these items, support research and make no grade-level, school-readiness or diagnostic claim.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: equal_sign_item from the run with the most of them, latest on ties; the chance and repeated-answer checks read the 16 true-or-false judgments (two buttons, 8 true and 8 false), and the missing numbers are typed. Accuracy is not judged against chance. One button on at least 90% of the judgments invalidates when their accuracy is not above chance. Fewer than half the missing numbers answered invalidates. An incomplete run is flagged, and so is one number typed for half the missing numbers or more, and fewer than half the standard questions right. Answers under 200 ms on at least half of the judgments invalidate. A hidden tab is flagged.
Why these rules
Judgments that follow the "answer comes next" reading of the equal sign are what the test measures, and they are wrong on 8 of the 16 judgments, so accuracy at chance is a result and is not judged against chance. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). A score over fewer than half the missing numbers cannot be compared with a score over all of them, so it invalidates; the missing numbers have different answers, so one number typed for half of them cannot follow them. Every reading of the equal sign gets the standard questions right, so missing most of them means the equations were not followed. An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. The questions stay on screen until they are answered, so a hidden tab does not change what was shown, but it can mean a calculator or help was used; it is flagged.
Running this test
Settings you can change
This test runs with fixed settings.
Need a different version of this test?
Devices and languages
- Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Equal Sign Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Perry, Church & Goldin-Meadow, 1988; McNeil & Alibali, 2005; Rittle-Johnson et al., 2011). The main score was accuracy (right answers over the questions shown, 29 in a complete run).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Perry, M., Church, R. B., & Goldin-Meadow, S. (1988). Transitional knowledge in the acquisition of concepts. Cognitive Development, 3(4), 359-400. https://doi.org/10.1016/0885-2014(88)90021-4The coding of strategies on equivalence problems that later studies use, adding every number and adding to the equal sign among them.
- Alibali, M. W. (1999). How children change their minds: Strategy change can be gradual or abrupt. Developmental Psychology, 35(1), 127-145. https://doi.org/10.1037/0012-1649.35.1.127Equivalence problems with the blank right after the equal sign or in final position, and the incorrect add-all strategy many children use.
- McNeil, N. M., & Alibali, M. W. (2005). Why won't you change your mind? Knowledge of operational patterns hinders learning and performance on equations. Child Development, 76(4), 883-899. https://doi.org/10.1111/j.1467-8624.2005.00884.xChildren's add-all and add-to-equal-sign answers, and undergraduates who made the same errors after their arithmetic habits were primed.
- McNeil, N. M., & Alibali, M. W. (2005). Knowledge change as a function of mathematics experience: All contexts are not created equal. Journal of Cognition and Development, 6(2), 285-306. https://doi.org/10.1207/s15327647jcd0602_6Definitions of the equal sign, from the answer and the total to two amounts are the same, rated by students from elementary school to graduate school.
- Rittle-Johnson, B., Matthews, P. G., Taylor, R. S., & McEldoon, K. L. (2011). Assessing knowledge of mathematical equivalence: A construct-modeling approach. Journal of Educational Psychology, 103(1), 85-104. https://doi.org/10.1037/a0021334Equation structures from a + b = c to operations on both sides, true-or-false judgments and the best definition of the equal sign, ordered from operational to relational knowledge.
Source papers
Questions
How long does the Equal Sign Task take?
About 4 to 8 minutes, as listed in the test library.
What device does a participant need?
Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Accuracy, Missing Numbers Accuracy, True or False Accuracy, Equivalence Problems Accuracy, Accuracy by Equation Form, Relational Definition, Operational Errors, Operational Judgments, Add to Equal Sign Errors, Add All Errors, Copied Numbers, Other Errors, Unanswered Missing Numbers, Median Answer Time, Answers Under 100 ms, Questions Answered, Questions, Planned Questions and Most Repeated Answer. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Equal Sign Task used in research?
57 papers from 2021 to 2025 name it in their title or abstract, up 10% compared with 2016 to 2020. That ranks it 430 of 711 test families in the ConductCognition test census (use grade D). Source: ConductCognition test census 0.58.0, counted 14 November 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Equal Sign Task have?
In the published research, 0 papers report its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade D in the ConductCognition test census).
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese, with its words in the same language. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.