ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention143
    • Working memory51
    • Executive function191
    • Episodic memory84
    • Response inhibition10
    • Social cognition97
    • Language50

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 681 tests

    Browse by

    • Phone380
    • Tablet415
    • Untimed419
    • Up to 5 minutes81
    • Evidence grade A48
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 681 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,848 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia202
    • Decisions and reward136
    • Child development and education114
    • Social behavior87
    • Language and bilingualism80
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma28
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue17
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Tests
  3. /Paint Pot Game

Executive Function

Paint Pot Game

Also called: colour conflict game for children, touch interference game, reach Stroop game

Measure how much an object's usual colour slows a reach to the right pot: a drawn object comes up painted in a colour, and the person holds a spot, lets go and touches the pot with the same paint.

12-16 minTimed: desktop or laptop with a mouse or trackpad

Create a study with this test

Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.

Papers, 2021 to 2025
4,956
Evidence grade
A
Registered clinical studies
1,929

Figures for the Stroop Color-Word Test, the published test this game is compared with.

How these are counted
Touch the pot with the same paint
Practice: the right pot glows
Response-time cost2 alternate formsFor research with ages 5 and over
Hold the spot, then touch the pot with the same paint
  • Overview
  • Evidence
  • Task design
  • Quality checks
  • Settings
  • Cite
  • Questions

What it measures

A timed paint game for research on interference control in people aged 5 and over, with an adult reading the screens aloud to children under 8. A drawn object comes up painted in a colour. The person holds a spot, lets go and touches the pot with the same paint. The score is the extra time a touch takes when the paint is not the object's usual colour, with the start and the move of the reach beside it. A short colour check comes first. Costs are compared within one input type. It is a raw research measure with no percentile.

Constructs

  • Interference control
  • Response conflict
  • Speed of a reach to a target

Research uses

  • Research on interference control and response conflict in children and adults

How the paradigm works

The Paint Pot Game is a timed paint game for research on interference control in people aged 5 and over. A drawn object comes up painted in a colour: some objects are painted in their usual colour and some in another. The person holds a start spot, lets go when the picture shows and touches the pot that holds the same paint, among four. The picture stays on screen until the touch, and the score is how much longer a touch takes when the paint is not the object's usual colour (the response-time cost), with the start and the move of the reach reported beside it. A short colour check comes first, and a person who cannot tell the four paints apart is not scored. The counts on its page are those of the Stroop Color-Word Test, the published test the game is compared with. The game is not that test with new pictures: it has no word on any screen, the conflict is between an object's usual colour and its paint, and the answer is a reach to a pot, not a key press. The validation plan also compares it with its own plain look and, at ages 5 and 6, with Day-Night, and expects the flanker's effect to correlate less. A study runs 8 blocks of 32 trials as standard, from 2 to 8: use 4 blocks for children aged 5 to 8 and 8 for adults who need the cost for individual differences. It needs a mouse, a finger or a pen, which is one input at every visit, on one device class: costs are compared within one input type, since a mouse, a finger and a pen do not move alike, and the first desktop data are the first mouse data. For a child under 8, an adult sits beside the child, reads each screen aloud and neither points nor answers. For a retest, add a visit of the same study 7 to 28 days later. The plain Stroop Color-Word Test serves people who use a keyboard only. The matching response may pull less than naming does, so a small cost is possible; its reliability and norms come from use.

Scores

Response-Time Costms
The mean response time of correct incongruent trials (an object painted in a colour that is not its usual one) minus that of correct congruent trials, from the first frame that shows the picture to the touch on the pot. Empty below 20 scored trials in either condition. Trials leave out the first of each block, errors, the trial after an error, anticipations (a lift under 100 ms), trials with an extra contact, a stray touch, a hidden tab or a resize, trials stamped by the handler, and trials more than 3 SD from the person's mean in their condition.
Primary: lower is a smaller cost. Compare within one input type
Initiation Costms
The same cost in the time from the picture to the lift off the start spot.
Secondary: the start of the reach
Movement Costms
The same cost in the time from the lift to the touch on the pot. The initiation and movement costs sum to the response-time cost.
Secondary: the move of the reach
Initiation Cost, Liftedms
The initiation cost over the trials that left the spot by a release. Empty below 20 trials in either condition.
Secondary: read beside the moved-off cost
Initiation Cost, Movedms
The initiation cost over the trials that left the spot by moving more than 8 px from where the contact was when the flags showed. Empty below 20 trials in either condition.
Secondary: read beside the lifted cost
Error Cost%
The share of incongruent trials answered wrong less the share of congruent trials answered wrong, in percentage points.
Secondary: positive means more errors when the paint is not the object's usual colour
Mean Response, Congruentms
The mean response time of the scored congruent trials.
Informational
Mean Response, Incongruentms
The mean response time of the scored incongruent trials.
Informational
Median Response Timems
The median response time of all scored trials.
Quality check: a person who waits until sure shows a small cost
Median Initiation Timems
The median time from the picture to the lift of all scored trials.
Quality check: above 1,500 ms is flagged
Accuracy, Congruent%
Share of congruent trials that were answered with the right pot.
Quality check
Accuracy, Incongruent%
Share of incongruent trials that were answered with the right pot.
Quality check
Accuracy%
Share of the answered test trials that were right. Chance is one in four.
Quality check: under 0.60 invalidates the run
Scored Trialscount
The trials that entered the costs.
Quality check
Early Startscount
Times the contact left the start spot before the picture showed, in test trials.
Quality check
Lifts Under 100 mscount
Test trials in which the contact left the spot less than 100 ms after the picture showed. They are left out and never repeated.
Quality check
Timed-Out Trialscount
Test trials with no lift within 4,000 ms or no touch within 4,000 ms of the lift.
Quality check
Share Left by Moving%
Share of scored trials in which the contact left the spot by moving more than 8 px and not by a release.
Informational: read the initiation cost beside it
Stray Touchescount
First touches that landed on no spot and no pot.
Quality check
Trials with an Extra Contactcount
Test trials with a second finger, a palm or another mouse button, which are left out of every cost.
Quality check: a share above 10% is flagged
Trials Stamped by the Handlercount
Trials in which the browser gave no event time, so the page's own time (which includes any queue delay) was used. They are left out of the costs.
Quality check
Share of Lifts at a Fixed Delay%
Share of scored trials in which the lift came within 40 ms of the person's median initiation time.
Quality check: a person who lifts at a constant delay keeps the cost in the response time but not the initiation cost; above 0.60 is flagged
Share on One Pot%
Share of the answers that went to the most chosen pot.
Quality check: 60% or more with accuracy under 80% is flagged
Share of Touch Answers%
Share of the answered test trials in which the pointer was a finger.
Informational: costs are compared within one input type
Colour Check0/1
1 when a round of the colour check was all right (four swatches, four right pots), 0 when neither round was. Decided from the touches in the rows, never from a recorded flag. A 0 leaves every other measure empty.
Quality check: a person who fails it is not scored
Colour Check Roundscount
The rounds of the colour check the person took, 1 or 2.
Informational

Use and evidence

4,956 papers from 2021 to 2025 name this task in their title or abstract, up 14% compared with 2016 to 2020. That ranks it 4 of 711 test families in our census. These counts belong to the Stroop Color-Word Test, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. See the counts for every test.

2021 to 2025, the years gradedEarlier years
Papers per year naming the Stroop color-word task, 2000 to 2025Bar chart. 2021: 854; 2022: 811; 2023: 911; 2024: 1,041; 2025: 1,339 papers. Peak year 2025.05001,0001,5002000: 177 papers2001: 160 papers2002: 214 papers2003: 205 papers2004: 253 papers2005: 301 papers2006: 357 papers2007: 357 papers2008: 373 papers2009: 456 papers2010: 550 papers2011: 598 papers2012: 676 papers2013: 745 papers2014: 728 papers2015: 803 papers2016: 829 papers2017: 825 papers2018: 855 papers2019: 950 papers2020: 878 papers2021: 854 papers2022: 811 papers2023: 911 papers2024: 1,041 papers2025: 1,339 papers200020052010201520202025
Papers per year naming the Stroop color-word task, 2000 to 2025Bar chart. 2021: 854; 2022: 811; 2023: 911; 2024: 1,041; 2025: 1,339 papers. Peak year 2025.05001,0001,5002000: 177 papers2001: 160 papers2002: 214 papers2003: 205 papers2004: 253 papers2005: 301 papers2006: 357 papers2007: 357 papers2008: 373 papers2009: 456 papers2010: 550 papers2011: 598 papers2012: 676 papers2013: 745 papers2014: 728 papers2015: 803 papers2016: 829 papers2017: 825 papers2018: 855 papers2019: 950 papers2020: 878 papers2021: 854 papers2022: 811 papers2023: 911 papers2024: 1,041 papers2025: 1,339 papers200020052010201520202025
Papers per year whose title or abstract names this task (OpenAlex).
Show the numbers
YearPapers
20251,339
20241,041
2023911
2022811
2021854
2020878
2019950
2018855
2017825
2016829
2015803
2014728
2013745
2012676
2011598
2010550
2009456
2008373
2007357
2006357
2005301
2004253
2003205
2002214
2001160
2000177
A

Use grade A

1,000 or more papers from 2021 to 2025.

A

Evidence grade A

At least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome.

Papers on test-retest reliability
151
Papers on reliability or validity
1,204
Registered clinical studies using it as an outcome
1,929

See which registered studies use it

Measured on ConductCognition

Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.

No pooled figure yet.

How the grades work

Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on the Stroop Color-Word Test, the published test this game is compared with, not the game's own.

Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

Task design

The trial sequence as the test runs in ConductCognition.

Objects
Eight objects drawn in code, two for each of four usual colours: a strawberry and a tomato (red), a banana and a lemon (yellow), a broccoli and a cactus (green), a blueberry and a wave (blue). Blue is the weakest pair: a blueberry can look blue-violet and a wave blue and white. No object is orange or a creature, and no screen names an object or a paint.
Paints and pots
Four paints on a white ground, the same in both looks: red, yellow, green and blue, each found inside a window of its own colour. Each is at least 20 apart from the others and from the ground in CIEDE2000, in normal vision and under protan, deutan and tritan simulation (the smallest is 20.95 between paints and 20.23 from the ground). Four pots stand in a row at the top, each at least 104 px across, one for each paint, in the same order on every trial. The game look adds a pale shelf behind the pots, the same for every trial; the plain look shows the same pots on white. Both looks draw every object and pot the same way.
Trial
A start spot 80 px across sits at the bottom centre. The person holds it for 600, 900 or 1,200 ms, each equally often in each condition, then a drawn object comes up in a window in the middle, painted in one of the four paints. The person lets go and touches the pot with the same paint. The picture stays up until the touch, with up to 4,000 ms to lift and 4,000 ms to touch, and the stage is empty for 400 ms before the next trial. A demonstration with an animated hand, a practice of 12 trials and a rest between blocks come with it. In the practice the first 4 trials are in the object's usual colour, the right pot glows for 800 ms after each answer, an early start says to wait and a drag let go over a pot says to let go first and then touch; the practice runs once more when fewer than 9 are right. Nothing moves in a timed trial and no mark follows an answer.
Items
A block is 32 trials: each of the 8 objects twice in its usual colour and twice in another, each pot right 8 times, 4 of them in a usual colour. No object and no paint comes twice in a row, no condition runs more than 3 trials and the first trial of a block is in a usual colour. Each object's three other paints take turns, so each unusual pair comes the floor or the ceiling of two times the blocks over three, whatever number of blocks a study runs. A study runs 8 blocks as standard (256 trials), from 2 to 8.
Answers
The reach is defined on event times, the same for a mouse, a finger and a pen. The holding contact is the first that starts on the spot; it leaves when it is released or moves more than 8 px from where it was when the picture showed. Initiation time runs from the frame that shows the picture to the leave, and a leave under 100 ms is an anticipation: the trial is left out and never repeated. The touch is a new contact that starts on a pot, so a person who drags to a pot and lets go there must touch again. A second finger, a palm or another mouse button is an extra contact, and a hidden tab or a window that changed size ends the trial: both are left out of every score.
Colour check
Before the demonstration, four plain swatches of paint come in turn, each against the four pots, with no clock. A round is all right when each touch is the pot with the swatch's paint. A person gets up to 2 rounds, in a different order each time. A person who passes neither round is not scored, and the share who fail is reported. The score reads the check from the touches in the rows, never from a recorded flag.
Forms
2 alternate forms for studies and a third for Try it now, each a committed list from its own seed. Each participant gets the forms in an order drawn once for them, and each session takes the next form. Three shortcuts are bounded by construction: always one pot is right on a quarter of the trials, answering by the object's usual colour is right on every usual trial and none of the others (half in all), and never taking the usual colour is right on a sixth. All three are invalid.
Scores
The extra response time of a correct unusual-colour trial over a correct usual-colour one, from the frame that shows the picture to the touch (the main score; lower is a smaller cost). The first trial of a block, errors, the trial after an error and trials more than 3 SD from the person's mean in a condition are left out. The initiation cost (the start of the reach) and the movement cost (the move) come beside it and sum to it, with the error cost, accuracy, early starts, anticipations, time-outs, extra contacts, lifts at a fixed delay and the share of touches by a finger. A person who lifts at a constant delay or waits until sure moves cost between initiation and movement and never out of the response time, and the flags say when. A run with fewer than 20 scored trials in a condition has no cost.
Devices
Computers and touch-screen computers at release; a touch-screen computer counts as a computer and records touch. Tablets open once two filmed tablets pass the device timing check, and phones do not run the game. It needs a mouse, a finger or a pen; the plain Stroop test serves people who use a keyboard only. Costs are compared within one input type, and the first desktop data are the first mouse data, so keep each person on one device class and one input at every visit. Use 4 blocks for ages 5 to 8 and 8 for adults who need the cost for individual differences. For a child under 8, an adult sits beside the child, reads each screen aloud and neither points nor answers. A window under 520 by 480 px holds the game with a line asking for a taller window.

The design takes its interference from the Stroop paradigm (Stroop 1935) and its reach response, with the start and the move of the reach, from touch-screen congruency tasks (Erb and colleagues 2025: a word Stroop answered by touch gave a response-time cost of 59 ms and a split-half of .84 or higher over 480 trials). The conflict is between an object's usual colour and its paint, and each wrong paint has its own pot, as in a two-button colour-object Stroop that found a time cost in children and adults (Jongen and Jonkman 2008). The trial counts follow those split-halves, and a calibrated Stroop needed 199 trials for r = .9 (Kucina and colleagues 2023). The matching response may give a smaller cost than naming does, so a small cost is possible. The objects, the four paints, the pots, the committed lists, the hold times, the colour check, the words and the looks are our own. This is a new measure for research with ages 5 and over: its reliability and norms come from use, the figures published in those studies are not its own, and it computes no percentiles. Costs of conflict tasks retest poorly (Hedge and colleagues 2018), so read the plain look and the other measures beside it. The timing of a touch screen, a pen and a mouse differs between devices, so read each person's cost within one input type. For a retest 7 to 28 days later, add a second visit to the same study.

Quality checks

Each session is marked valid, needs review or invalid, with the reason, before you see its scores.

Scored rows: paint_pot_game test trials of a run whose colour check was passed (a round of four swatches matched to the four pots, read from the touches), one touch among four pots, with the right pot taken from the form's table. No passed round invalidates (the run is not scored). Fewer than 60% of the planned test trials answered cleanly invalidates, and so does accuracy under 60% (chance is 25%). One pot on 60% of 20 or more touches with accuracy under 80% is flagged. Early starts and lifts under 100 ms on more than 15% of the trials are flagged, and above 30% invalidate. Lifts under 200 ms on more than 20% of the answered trials, a median lift above 1,500 ms, more than 60% of the lifts within 40 ms of one delay, and extra contacts on more than 10% of the trials are flagged. Responses under 100 ms follow the timed-test rule.

Why these rules

Each trial has one right pot among four, so guessing gives a quarter; under 60% right is far above that and means the paint was not matched, which is a ConductScience choice, not a published limit. The cost is the response time of an incongruent trial less a congruent one, so a person who answers by the object's usual colour scores 1.0 on congruent and 0.0 on incongruent trials (50% in all) and one who never takes the usual colour 17%, and both are invalid. The response time carries the cost whenever the person lifts, so a lift in the air or at a constant delay moves cost between initiation and movement and never out of the response time (Ruling W7-3); the flags say when the initiation cost reads the lift and not the decision. A person who waits until sure shows a small cost in every difference score, the plain Stroop test included, which the checks cannot tell from a slow person. A person who cannot tell the four paints apart cannot do the task, so the colour check comes first and a run without a passed round is not scored. Missed responses and responses under 100 ms keep the platform's timed-test rule: more than max(3, 25%) missed responses or more than max(2, 20%) responses under 100 ms invalidate, and any is flagged. A response under 100 ms cannot be a reaction to the stimulus. The limits are ours.

No percentile. Scores and quality flags only.

Running this test

Settings you can change

SettingStandardAllowed
LookGameGame, Plain
Blocks82 to 8

Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.

Every plan can change the look, which never changes how a result is scored.

How test settings work

Need a setting this test does not have?

Devices and languages

  • Timed test: participants need a desktop or laptop with a mouse or trackpad. Participant devices
  • Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
  • Available on: Every plan, including the free plan.
  • No percentile. Scores and quality flags only. How norms work
  • Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.

Cite and describe

Methods text, with the standard settings

Participants completed the Paint Pot Game in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Stroop, 1935), with the standard settings (look: Game; blocks: 8). The main score was response-time cost (the mean response time of correct incongruent trials (an object painted in a colour that is not its usual one) minus that of correct congruent trials, from the first frame that shows the picture to the touch on the pot).

ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.

  • Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643-662. https://doi.org/10.1037/h0054651The interference of a conflicting word with naming an ink, the paradigm the game is compared with (abstract read). The game takes the interference between an object's usual colour and its paint, with no word on any screen.
  • Erb, C. D., Morrison, S., & Nicholson-Brown, A. (2025). Moving beyond button presses to enhance the reliability of congruency tasks. Behavior Research Methods, 57(8), 215. https://doi.org/10.3758/s13428-025-02740-0Reach responses on a touch screen, with a hold, an initiation time and a movement time, gave response-time split-halves of .78 to .95 in 7 of 10 flanker datasets, and a word Stroop answered by touch gave .84 or higher and a cost of 59 ms (Study 2's method and Tables 3 and 5 read). The game takes the hold, the three times, the display that stays up and the trimming.
  • Kucina, T., Wells, L., Lewis, I., de Salas, K., Kohl, A., Palmer, M. A., Sauer, J. D., Matzke, D., Aidman, E., & Heathcote, A. (2023). Calibration of cognitive tests to address the reliability paradox for decision-conflict tasks. Nature Communications, 14(1), 2234. https://doi.org/10.1038/s41467-023-37777-2A calibrated Stroop needed 199 trials for a reliability of .9 by model (full text read). The game takes the trial counts as a guide to the blocks setting.
  • Jongen, E. M. M., & Jonkman, L. M. (2008). The developmental pattern of stimulus and response interference in a color-object Stroop task: an ERP study. BMC Neuroscience, 9(1), 82. https://doi.org/10.1186/1471-2202-9-82In a two-button colour-object task, children aged 6 to 12 and adults were slower when the wrong colour belonged to the other button (full text read). Each trial of the game with an unusual colour is of that kind, since each wrong paint has its own pot.
  • Hedge, C., Powell, G., & Sumner, P. (2018). The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behavior Research Methods, 50(3), 1166-1186. https://doi.org/10.3758/s13428-017-0935-1Robust conflict effects retested poorly, at about .6 for the Stroop cost (full text read). The game reports its own plain look and the other measures beside the cost.

Source papers

    Questions

    How long does the Paint Pot Game take?

    About 12 to 16 minutes, as listed in the test library.

    What device does a participant need?

    Timed test: participants need a desktop or laptop with a mouse or trackpad. The browser must be Chrome, Edge, Firefox or Safari.

    What scores does it produce?

    Response-Time Cost, Initiation Cost, Movement Cost, Initiation Cost, Lifted, Initiation Cost, Moved, Error Cost, Mean Response, Congruent, Mean Response, Incongruent, Median Response Time, Median Initiation Time, Accuracy, Congruent, Accuracy, Incongruent, Accuracy, Scored Trials, Early Starts, Lifts Under 100 ms, Timed-Out Trials, Share Left by Moving, Stray Touches, Trials with an Extra Contact, Trials Stamped by the Handler, Share of Lifts at a Fixed Delay, Share on One Pot, Share of Touch Answers, Colour Check and Colour Check Rounds. Each session is also marked valid, needs review or invalid, with the reason.

    How widely is the Stroop Color-Word Test used in research?

    These counts belong to the Stroop Color-Word Test, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. 4,956 papers from 2021 to 2025 name the task in their title or abstract, up 14% compared with 2016 to 2020. That ranks it 4 of 711 test families in the ConductCognition test census (use grade A). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

    How much reliability evidence does the Stroop Color-Word Test have?

    These counts belong to the Stroop Color-Word Test, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. In the published research, 151 papers report the task's test-retest reliability and 1,929 registered clinical studies use it as an outcome (evidence grade A in the ConductCognition test census).

    Does it report a percentile?

    No. Scores and quality flags only.

    Which settings can a researcher change?

    Look (Game, Plain) and blocks (2 to 8). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings. Every plan can change the look, which never changes how a result is scored.

    Which languages can participants use?

    Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.

    Is this a clinical test?

    No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.

    Every test: the full test list.

    New tests and features, about once a month. Unsubscribe at any time.

    Run this test in your next study

    Start free with 10 free participants on any test, then use participant credits or a yearly plan.

    Start free

    Related tests

    Stroop Color-Word TestDay-Night Task
    ConductCognition

    Hosted browser-native cognitive testing for academic and commercial research workflows.

    A product of ConductScience, Inc.

    Tests

    • All cognitive tests
    • Test batteries
    • Use and evidence
    • Test norms
    • Trail Making Test
    • N-Back Task
    • Big Five personality test
    • Automated scoring
    • Study design
    • New tests by email

    Guides

    • Methods and questions
    • Blog
    • Recruitment setup
    • Participant devices
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics

    Use cases

    • Student participant pools
    • Aging and dementia research
    • Clinical trials
    • US clinical research
    • Remote testing

    Compare and buy

    • Pricing
    • Compare platforms
    • Offline edition
    • FAQ

    Trust

    • Study Quality Monitor
    • HIPAA-ready testing
    • Data export
    • Privacy Policy
    • Terms of Use
    • Data Policy

    Company

    • ConductScience
    • ConductScience Fellows
    © 2026 ConductScience, Inc. Research use only.