Episodic Memory
Effort Check Task
Also called: Rey 15-item test, Rey 15-item memorization test, dot counting test, Rey dot counting test, effort test, performance validity test, 15-item memory test
A research check of effort within a session: participants recall symbols from a card that looks harder than it is, then count grouped and scattered dots. Scored as symbols recalled and counting times.
4-6 minTimed: desktop or laptop with a mouse or trackpad
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 58
- Evidence grade
- C
- Registered clinical studies
- 5
What it measures
A research check of effort within a session, in two easy parts. A card of 15 symbols in five easy rows shows for 10 seconds, and participants choose the symbols they saw from 30. Then they count the dots on 12 cards, six with dots in groups and six with dots scattered, typing each count. The scores are the symbols recalled and the counting time for grouped and for scattered dots.
Constructs
- Effort within a session
- Visual memory for symbols
- Counting speed for grouped and scattered dots
Research uses
- Checking within a study that participants engaged with the session
- Research on how effort relates to other test scores
- Within-study group comparison
How the paradigm works
The Effort Check Task is a research check of effort within a session, in two parts that are easy for almost everyone who tries. It follows the ideas of the Rey 15-item test and the Dot Counting Test with cards our code draws. First, a card of 15 symbols shows for 10 seconds (standard; 5 to 20): five rows of three, each row one family in an easy order (arrows that turn, dice faces of one to three dots, squares that grow, the plus, minus and times signs, and a moon, a star and a sun), so the card looks harder to remember than it is. Participants then choose the symbols that were on the card from 30, the card's 15 and 15 others from the same five families, in a seeded order: up to 15, by click or keyboard, with no time limit.
More about the paradigm
Second, after one practice card with feedback, participants count the dots on 12 cards and type each count, then press Enter. Six counts, 9, 12, 15, 16, 20 and 24, are each drawn once in equal groups and once scattered, so the two kinds are matched; the cards come in a seeded order with three of each kind in each half. The counting time runs from a card's onset to the first digit typed. Desktop and laptop only.
The main score is the number of the card's symbols recalled, with false picks. The counting scores are the mean counting time for grouped and for scattered dots, their ratio, the time grouping saves, and count errors. Grouped dots are normally counted faster, because a group can be taken in at a glance. The scores are research measures of one session: no score is a cutoff, and no result classifies a participant or diagnoses anything.
No norms are applied to this task.
Scores
- Symbols Recalleditems
- Symbols chosen that were on the card, of its 15, with up to 15 choices.
- Higher is better
- False Pickscount
- Symbols chosen that were not on the card.
- Lower is better
- Choice Timeseconds
- Seconds from the choice screen to Done.
- Informational; the choice has no time limit
- Grouped Counting Timeseconds
- Mean seconds from a grouped card's onset to the first digit typed.
- Lower is faster
- Scattered Counting Timeseconds
- Mean seconds from a scattered card's onset to the first digit typed.
- Lower is faster
- Grouped to Scattered Ratioscore
- Grouped counting time over scattered counting time, for the same six counts.
- Under 1 means grouped dots were counted faster, as expected
- Time Saved by Groupingseconds
- Scattered counting time minus grouped counting time.
- Above 0 means grouped dots were counted faster
- Count Errorscount
- Dot cards whose typed count was wrong.
- Lower is better
- Cards Countedtrials
- Dot cards with a count typed in the scored run.
- Fewer than planned is flagged for review
- Planned Cardstrials
- Dot cards the session planned to show.
- Informational
Use and evidence
58 papers from 2021 to 2025 name this task in their title or abstract, up 4% compared with 2016 to 2020. That ranks it 426 of 711 test families in our census. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 8 |
| 2024 | 10 |
| 2023 | 15 |
| 2022 | 11 |
| 2021 | 14 |
| 2020 | 14 |
| 2019 | 15 |
| 2018 | 11 |
| 2017 | 11 |
| 2016 | 5 |
| 2015 | 11 |
| 2014 | 7 |
| 2013 | 10 |
| 2012 | 10 |
| 2011 | 4 |
| 2010 | 5 |
| 2009 | 2 |
| 2008 | 7 |
| 2007 | 4 |
| 2006 | 5 |
| 2005 | 3 |
| 2004 | 1 |
| 2003 | 11 |
| 2002 | 4 |
| 2001 | 7 |
| 2000 | 7 |
Use grade D
30 to 99 papers from 2021 to 2025.
Evidence grade C
At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.
- Papers on test-retest reliability
- 0
- Papers on reliability or validity
- 162
- Registered clinical studies using it as an outcome
- 5
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.
Source: ConductCognition test census 0.58.0, counted 17 November 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Symbol card
- 15 symbols drawn in code, in five rows of three, each row one family in an easy order: arrows that turn, dice faces of one to three dots, squares that grow, the plus, minus and times signs, and a moon, a star and a sun. The card shows for 10 seconds (standard; 5 to 20).
- Choice
- The card's 15 symbols and 15 others from the same five families, 30 in a seeded order. Participants choose up to 15 by click or keyboard, then Done, with no time limit. Choosing a symbol again takes it back.
- Dot cards
- Six counts, 9, 12, 15, 16, 20 and 24, each drawn once in equal groups of three to six dots and once scattered: 12 cards, three of each kind in each half, in a seeded order. Every participant sees the same cards.
- Answer
- Type the count with the number keys and press Enter. A card stays until its count is typed, for up to 60 s. The counting time runs from the card's onset to the first digit.
- Practice
- One card of 7 scattered dots, followed by its count and the count typed.
- Scores
- Symbols recalled and false picks; the mean counting time for grouped and for scattered cards, their ratio and the time grouping saves; and count errors.
The symbol card and the dot cards are drawn in code for this task, after the ideas of the Rey 15-item test and the Dot Counting Test; neither test's cards or forms are used. It is a research check of effort within a session: no score is a cutoff, and no result classifies a participant. The scores support research and do not diagnose.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: effort_check_pick (the choice of symbols) and effort_check_count (the dot cards) from the scored run. The scores are research measures of effort within a session, so no score is a cutoff and no finding judges a participant's effort: typed counts have no chance level, so accuracy is not judged against chance, and the same count on many cards is not checked. A run with no dot card rows is invalid; a missing choice of symbols or dot cards left without a count are flagged for review.
Why these rules
There is no correct option to compare with chance, so accuracy is not judged against chance. The Rey 15-item test and the Dot Counting Test, whose ideas this task follows with its own cards, are easy enough that almost every patient who tries does well (Boone and colleagues, 2002), and studies set their own cutoffs for their own samples, with false positives that rise with age and lower ability (Poynter and colleagues, 2019). This rule therefore checks only that the run is complete, and leaves every interpretation of effort to the researcher. A hidden tab during the card or a count changes what was measured, so a percentile is withheld after one.
No percentile. Scores and quality flags only.
Running this test
Settings you can change
| Setting | Standard | Allowed |
|---|---|---|
| Time the symbol card is shown (seconds) | 10 | 5 to 20 |
Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.
Need a setting this test does not have?
Devices and languages
- Timed test: participants need a desktop or laptop with a mouse or trackpad. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- No percentile. Scores and quality flags only. How norms work
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Effort Check Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Boone, Salazar, Lu, Warner-Chacon and Razani, 2002; Boone, Lu, Back and colleagues, 2002), with the standard settings (time the symbol card is shown (seconds): 10). The main score was symbols recalled (symbols chosen that were on the card, of its 15, with up to 15 choices).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Boone, K. B., Salazar, X., Lu, P., Warner-Chacon, K., & Razani, J. (2002). The Rey 15-Item Recognition Trial: A technique to enhance sensitivity of the Rey 15-Item Memorization Test. Journal of Clinical and Experimental Neuropsychology, 24(5), 561-573. https://doi.org/10.1076/jcen.24.5.561.1004A card of 15 items to remember, followed by a choice of the items from a larger set.
- Boone, K. B., Lu, P., Back, C., King, C., Lee, A., Philpott, L., Shamieh, E., & Warner-Chacon, K. (2002). Sensitivity and specificity of the Rey Dot Counting Test in patients with suspect effort and various clinical samples. Archives of Clinical Neuropsychology, 17(7), 625-642. https://doi.org/10.1093/arclin/17.7.625Counting grouped and ungrouped dots, scored by the mean grouped time, the ratio of grouped to ungrouped time and errors.
- Crișan, I., & Sava, F. A. (2025). Validity assessment in Eastern Europe: cross-validation of the Dot Counting Test and MODEMM against the TOMM-1 and Rey-15 in a Romanian mixed clinical sample. Archives of Clinical Neuropsychology, 40(3), 614-625. https://doi.org/10.1093/arclin/acad085Both procedures in a recent clinical sample: 15 symbols shown for 10 s, and 12 dot cards, six grouped and six ungrouped, timed card by card.
- Ciccione, L., & Dehaene, S. (2020). Grouping mechanisms in numerosity perception. Open Mind, 4, 102-118. https://doi.org/10.1162/opmi_a_00037Grouping helps people enumerate dots when the groups hold equal numbers.
- Poynter, K., Boone, K. B., Ermshar, A., Miora, D., Cottingham, M., Victor, T. L., Ziegler, E., Zeller, M. A., & Wright, M. (2019). Wait, there's a baby in this bath water! Update on quantitative and qualitative cut-offs for Rey 15-Item Recall and Recognition. Archives of Clinical Neuropsychology, 34(8), 1367-1380. https://doi.org/10.1093/arclin/acy087Cutoffs revised on a larger sample, with false positives that rose with older age and lower IQ; this task sets no cutoff.
Source papers
- Boone KB, Salazar X, Lu P, Warner-Chacon K, Razani J (2002). The Rey 15-Item Recognition Trial: A technique to enhance sensitivity of the Rey 15-Item Memorization Test. Journal of Clinical and Experimental Neuropsychology, 24(5):561-573.Paradigm source, Adults
Questions
How long does the Effort Check Task take?
About 4 to 6 minutes, as listed in the test library.
What device does a participant need?
Timed test: participants need a desktop or laptop with a mouse or trackpad. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Symbols Recalled, False Picks, Choice Time, Grouped Counting Time, Scattered Counting Time, Grouped to Scattered Ratio, Time Saved by Grouping, Count Errors, Cards Counted and Planned Cards. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Effort Check Task used in research?
58 papers from 2021 to 2025 name it in their title or abstract, up 4% compared with 2016 to 2020. That ranks it 426 of 711 test families in the ConductCognition test census (use grade D). Source: ConductCognition test census 0.58.0, counted 17 November 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Effort Check Task have?
In the published research, 0 papers report its test-retest reliability and 5 registered clinical studies use it as an outcome (evidence grade C in the ConductCognition test census).
Does it report a percentile?
No. Scores and quality flags only.
Which settings can a researcher change?
Time the symbol card is shown (seconds) (5 to 20). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings.
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.