Executive Function
Paint Pot Game
Also called: colour conflict game for children, touch interference game, reach Stroop game
Measure how much an object's usual colour slows a reach to the right pot: a drawn object comes up painted in a colour, and the person holds a spot, lets go and touches the pot with the same paint.
12-16 minTimed: desktop or laptop with a mouse or trackpad
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 4,956
- Evidence grade
- A
- Registered clinical studies
- 1,929
Figures for the Stroop Color-Word Test, the published test this game is compared with.
How these are countedWhat it measures
A timed paint game for research on interference control in people aged 5 and over, with an adult reading the screens aloud to children under 8. A drawn object comes up painted in a colour. The person holds a spot, lets go and touches the pot with the same paint. The score is the extra time a touch takes when the paint is not the object's usual colour, with the start and the move of the reach beside it. A short colour check comes first. Costs are compared within one input type. It is a raw research measure with no percentile.
Constructs
- Interference control
- Response conflict
- Speed of a reach to a target
Research uses
- Research on interference control and response conflict in children and adults
How the paradigm works
The Paint Pot Game is a timed paint game for research on interference control in people aged 5 and over. A drawn object comes up painted in a colour: some objects are painted in their usual colour and some in another. The person holds a start spot, lets go when the picture shows and touches the pot that holds the same paint, among four. The picture stays on screen until the touch, and the score is how much longer a touch takes when the paint is not the object's usual colour (the response-time cost), with the start and the move of the reach reported beside it. A short colour check comes first, and a person who cannot tell the four paints apart is not scored. The counts on its page are those of the Stroop Color-Word Test, the published test the game is compared with. The game is not that test with new pictures: it has no word on any screen, the conflict is between an object's usual colour and its paint, and the answer is a reach to a pot, not a key press. The validation plan also compares it with its own plain look and, at ages 5 and 6, with Day-Night, and expects the flanker's effect to correlate less. A study runs 8 blocks of 32 trials as standard, from 2 to 8: use 4 blocks for children aged 5 to 8 and 8 for adults who need the cost for individual differences. It needs a mouse, a finger or a pen, which is one input at every visit, on one device class: costs are compared within one input type, since a mouse, a finger and a pen do not move alike, and the first desktop data are the first mouse data. For a child under 8, an adult sits beside the child, reads each screen aloud and neither points nor answers. For a retest, add a visit of the same study 7 to 28 days later. The plain Stroop Color-Word Test serves people who use a keyboard only. The matching response may pull less than naming does, so a small cost is possible; its reliability and norms come from use.
Scores
- Response-Time Costms
- The mean response time of correct incongruent trials (an object painted in a colour that is not its usual one) minus that of correct congruent trials, from the first frame that shows the picture to the touch on the pot. Empty below 20 scored trials in either condition. Trials leave out the first of each block, errors, the trial after an error, anticipations (a lift under 100 ms), trials with an extra contact, a stray touch, a hidden tab or a resize, trials stamped by the handler, and trials more than 3 SD from the person's mean in their condition.
- Primary: lower is a smaller cost. Compare within one input type
- Initiation Costms
- The same cost in the time from the picture to the lift off the start spot.
- Secondary: the start of the reach
- Movement Costms
- The same cost in the time from the lift to the touch on the pot. The initiation and movement costs sum to the response-time cost.
- Secondary: the move of the reach
- Initiation Cost, Liftedms
- The initiation cost over the trials that left the spot by a release. Empty below 20 trials in either condition.
- Secondary: read beside the moved-off cost
- Initiation Cost, Movedms
- The initiation cost over the trials that left the spot by moving more than 8 px from where the contact was when the flags showed. Empty below 20 trials in either condition.
- Secondary: read beside the lifted cost
- Error Cost%
- The share of incongruent trials answered wrong less the share of congruent trials answered wrong, in percentage points.
- Secondary: positive means more errors when the paint is not the object's usual colour
- Mean Response, Congruentms
- The mean response time of the scored congruent trials.
- Informational
- Mean Response, Incongruentms
- The mean response time of the scored incongruent trials.
- Informational
- Median Response Timems
- The median response time of all scored trials.
- Quality check: a person who waits until sure shows a small cost
- Median Initiation Timems
- The median time from the picture to the lift of all scored trials.
- Quality check: above 1,500 ms is flagged
- Accuracy, Congruent%
- Share of congruent trials that were answered with the right pot.
- Quality check
- Accuracy, Incongruent%
- Share of incongruent trials that were answered with the right pot.
- Quality check
- Accuracy%
- Share of the answered test trials that were right. Chance is one in four.
- Quality check: under 0.60 invalidates the run
- Scored Trialscount
- The trials that entered the costs.
- Quality check
- Early Startscount
- Times the contact left the start spot before the picture showed, in test trials.
- Quality check
- Lifts Under 100 mscount
- Test trials in which the contact left the spot less than 100 ms after the picture showed. They are left out and never repeated.
- Quality check
- Timed-Out Trialscount
- Test trials with no lift within 4,000 ms or no touch within 4,000 ms of the lift.
- Quality check
- Share Left by Moving%
- Share of scored trials in which the contact left the spot by moving more than 8 px and not by a release.
- Informational: read the initiation cost beside it
- Stray Touchescount
- First touches that landed on no spot and no pot.
- Quality check
- Trials with an Extra Contactcount
- Test trials with a second finger, a palm or another mouse button, which are left out of every cost.
- Quality check: a share above 10% is flagged
- Trials Stamped by the Handlercount
- Trials in which the browser gave no event time, so the page's own time (which includes any queue delay) was used. They are left out of the costs.
- Quality check
- Share of Lifts at a Fixed Delay%
- Share of scored trials in which the lift came within 40 ms of the person's median initiation time.
- Quality check: a person who lifts at a constant delay keeps the cost in the response time but not the initiation cost; above 0.60 is flagged
- Share on One Pot%
- Share of the answers that went to the most chosen pot.
- Quality check: 60% or more with accuracy under 80% is flagged
- Share of Touch Answers%
- Share of the answered test trials in which the pointer was a finger.
- Informational: costs are compared within one input type
- Colour Check0/1
- 1 when a round of the colour check was all right (four swatches, four right pots), 0 when neither round was. Decided from the touches in the rows, never from a recorded flag. A 0 leaves every other measure empty.
- Quality check: a person who fails it is not scored
- Colour Check Roundscount
- The rounds of the colour check the person took, 1 or 2.
- Informational
Use and evidence
4,956 papers from 2021 to 2025 name this task in their title or abstract, up 14% compared with 2016 to 2020. That ranks it 4 of 711 test families in our census. These counts belong to the Stroop Color-Word Test, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 1,339 |
| 2024 | 1,041 |
| 2023 | 911 |
| 2022 | 811 |
| 2021 | 854 |
| 2020 | 878 |
| 2019 | 950 |
| 2018 | 855 |
| 2017 | 825 |
| 2016 | 829 |
| 2015 | 803 |
| 2014 | 728 |
| 2013 | 745 |
| 2012 | 676 |
| 2011 | 598 |
| 2010 | 550 |
| 2009 | 456 |
| 2008 | 373 |
| 2007 | 357 |
| 2006 | 357 |
| 2005 | 301 |
| 2004 | 253 |
| 2003 | 205 |
| 2002 | 214 |
| 2001 | 160 |
| 2000 | 177 |
Use grade A
1,000 or more papers from 2021 to 2025.
Evidence grade A
At least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome.
- Papers on test-retest reliability
- 151
- Papers on reliability or validity
- 1,204
- Registered clinical studies using it as an outcome
- 1,929
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on the Stroop Color-Word Test, the published test this game is compared with, not the game's own.
Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Objects
- Eight objects drawn in code, two for each of four usual colours: a strawberry and a tomato (red), a banana and a lemon (yellow), a broccoli and a cactus (green), a blueberry and a wave (blue). Blue is the weakest pair: a blueberry can look blue-violet and a wave blue and white. No object is orange or a creature, and no screen names an object or a paint.
- Paints and pots
- Four paints on a white ground, the same in both looks: red, yellow, green and blue, each found inside a window of its own colour. Each is at least 20 apart from the others and from the ground in CIEDE2000, in normal vision and under protan, deutan and tritan simulation (the smallest is 20.95 between paints and 20.23 from the ground). Four pots stand in a row at the top, each at least 104 px across, one for each paint, in the same order on every trial. The game look adds a pale shelf behind the pots, the same for every trial; the plain look shows the same pots on white. Both looks draw every object and pot the same way.
- Trial
- A start spot 80 px across sits at the bottom centre. The person holds it for 600, 900 or 1,200 ms, each equally often in each condition, then a drawn object comes up in a window in the middle, painted in one of the four paints. The person lets go and touches the pot with the same paint. The picture stays up until the touch, with up to 4,000 ms to lift and 4,000 ms to touch, and the stage is empty for 400 ms before the next trial. A demonstration with an animated hand, a practice of 12 trials and a rest between blocks come with it. In the practice the first 4 trials are in the object's usual colour, the right pot glows for 800 ms after each answer, an early start says to wait and a drag let go over a pot says to let go first and then touch; the practice runs once more when fewer than 9 are right. Nothing moves in a timed trial and no mark follows an answer.
- Items
- A block is 32 trials: each of the 8 objects twice in its usual colour and twice in another, each pot right 8 times, 4 of them in a usual colour. No object and no paint comes twice in a row, no condition runs more than 3 trials and the first trial of a block is in a usual colour. Each object's three other paints take turns, so each unusual pair comes the floor or the ceiling of two times the blocks over three, whatever number of blocks a study runs. A study runs 8 blocks as standard (256 trials), from 2 to 8.
- Answers
- The reach is defined on event times, the same for a mouse, a finger and a pen. The holding contact is the first that starts on the spot; it leaves when it is released or moves more than 8 px from where it was when the picture showed. Initiation time runs from the frame that shows the picture to the leave, and a leave under 100 ms is an anticipation: the trial is left out and never repeated. The touch is a new contact that starts on a pot, so a person who drags to a pot and lets go there must touch again. A second finger, a palm or another mouse button is an extra contact, and a hidden tab or a window that changed size ends the trial: both are left out of every score.
- Colour check
- Before the demonstration, four plain swatches of paint come in turn, each against the four pots, with no clock. A round is all right when each touch is the pot with the swatch's paint. A person gets up to 2 rounds, in a different order each time. A person who passes neither round is not scored, and the share who fail is reported. The score reads the check from the touches in the rows, never from a recorded flag.
- Forms
- 2 alternate forms for studies and a third for Try it now, each a committed list from its own seed. Each participant gets the forms in an order drawn once for them, and each session takes the next form. Three shortcuts are bounded by construction: always one pot is right on a quarter of the trials, answering by the object's usual colour is right on every usual trial and none of the others (half in all), and never taking the usual colour is right on a sixth. All three are invalid.
- Scores
- The extra response time of a correct unusual-colour trial over a correct usual-colour one, from the frame that shows the picture to the touch (the main score; lower is a smaller cost). The first trial of a block, errors, the trial after an error and trials more than 3 SD from the person's mean in a condition are left out. The initiation cost (the start of the reach) and the movement cost (the move) come beside it and sum to it, with the error cost, accuracy, early starts, anticipations, time-outs, extra contacts, lifts at a fixed delay and the share of touches by a finger. A person who lifts at a constant delay or waits until sure moves cost between initiation and movement and never out of the response time, and the flags say when. A run with fewer than 20 scored trials in a condition has no cost.
- Devices
- Computers and touch-screen computers at release; a touch-screen computer counts as a computer and records touch. Tablets open once two filmed tablets pass the device timing check, and phones do not run the game. It needs a mouse, a finger or a pen; the plain Stroop test serves people who use a keyboard only. Costs are compared within one input type, and the first desktop data are the first mouse data, so keep each person on one device class and one input at every visit. Use 4 blocks for ages 5 to 8 and 8 for adults who need the cost for individual differences. For a child under 8, an adult sits beside the child, reads each screen aloud and neither points nor answers. A window under 520 by 480 px holds the game with a line asking for a taller window.
The design takes its interference from the Stroop paradigm (Stroop 1935) and its reach response, with the start and the move of the reach, from touch-screen congruency tasks (Erb and colleagues 2025: a word Stroop answered by touch gave a response-time cost of 59 ms and a split-half of .84 or higher over 480 trials). The conflict is between an object's usual colour and its paint, and each wrong paint has its own pot, as in a two-button colour-object Stroop that found a time cost in children and adults (Jongen and Jonkman 2008). The trial counts follow those split-halves, and a calibrated Stroop needed 199 trials for r = .9 (Kucina and colleagues 2023). The matching response may give a smaller cost than naming does, so a small cost is possible. The objects, the four paints, the pots, the committed lists, the hold times, the colour check, the words and the looks are our own. This is a new measure for research with ages 5 and over: its reliability and norms come from use, the figures published in those studies are not its own, and it computes no percentiles. Costs of conflict tasks retest poorly (Hedge and colleagues 2018), so read the plain look and the other measures beside it. The timing of a touch screen, a pen and a mouse differs between devices, so read each person's cost within one input type. For a retest 7 to 28 days later, add a second visit to the same study.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: paint_pot_game test trials of a run whose colour check was passed (a round of four swatches matched to the four pots, read from the touches), one touch among four pots, with the right pot taken from the form's table. No passed round invalidates (the run is not scored). Fewer than 60% of the planned test trials answered cleanly invalidates, and so does accuracy under 60% (chance is 25%). One pot on 60% of 20 or more touches with accuracy under 80% is flagged. Early starts and lifts under 100 ms on more than 15% of the trials are flagged, and above 30% invalidate. Lifts under 200 ms on more than 20% of the answered trials, a median lift above 1,500 ms, more than 60% of the lifts within 40 ms of one delay, and extra contacts on more than 10% of the trials are flagged. Responses under 100 ms follow the timed-test rule.
Why these rules
Each trial has one right pot among four, so guessing gives a quarter; under 60% right is far above that and means the paint was not matched, which is a ConductScience choice, not a published limit. The cost is the response time of an incongruent trial less a congruent one, so a person who answers by the object's usual colour scores 1.0 on congruent and 0.0 on incongruent trials (50% in all) and one who never takes the usual colour 17%, and both are invalid. The response time carries the cost whenever the person lifts, so a lift in the air or at a constant delay moves cost between initiation and movement and never out of the response time (Ruling W7-3); the flags say when the initiation cost reads the lift and not the decision. A person who waits until sure shows a small cost in every difference score, the plain Stroop test included, which the checks cannot tell from a slow person. A person who cannot tell the four paints apart cannot do the task, so the colour check comes first and a run without a passed round is not scored. Missed responses and responses under 100 ms keep the platform's timed-test rule: more than max(3, 25%) missed responses or more than max(2, 20%) responses under 100 ms invalidate, and any is flagged. A response under 100 ms cannot be a reaction to the stimulus. The limits are ours.
No percentile. Scores and quality flags only.
Running this test
Settings you can change
| Setting | Standard | Allowed |
|---|---|---|
| Look | Game | Game, Plain |
| Blocks | 8 | 2 to 8 |
Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.
Every plan can change the look, which never changes how a result is scored.
Need a setting this test does not have?
Devices and languages
- Timed test: participants need a desktop or laptop with a mouse or trackpad. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- No percentile. Scores and quality flags only. How norms work
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Paint Pot Game in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Stroop, 1935), with the standard settings (look: Game; blocks: 8). The main score was response-time cost (the mean response time of correct incongruent trials (an object painted in a colour that is not its usual one) minus that of correct congruent trials, from the first frame that shows the picture to the touch on the pot).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Stroop, J. R. (1935). Studies of interference in serial verbal reactions. Journal of Experimental Psychology, 18(6), 643-662. https://doi.org/10.1037/h0054651The interference of a conflicting word with naming an ink, the paradigm the game is compared with (abstract read). The game takes the interference between an object's usual colour and its paint, with no word on any screen.
- Erb, C. D., Morrison, S., & Nicholson-Brown, A. (2025). Moving beyond button presses to enhance the reliability of congruency tasks. Behavior Research Methods, 57(8), 215. https://doi.org/10.3758/s13428-025-02740-0Reach responses on a touch screen, with a hold, an initiation time and a movement time, gave response-time split-halves of .78 to .95 in 7 of 10 flanker datasets, and a word Stroop answered by touch gave .84 or higher and a cost of 59 ms (Study 2's method and Tables 3 and 5 read). The game takes the hold, the three times, the display that stays up and the trimming.
- Kucina, T., Wells, L., Lewis, I., de Salas, K., Kohl, A., Palmer, M. A., Sauer, J. D., Matzke, D., Aidman, E., & Heathcote, A. (2023). Calibration of cognitive tests to address the reliability paradox for decision-conflict tasks. Nature Communications, 14(1), 2234. https://doi.org/10.1038/s41467-023-37777-2A calibrated Stroop needed 199 trials for a reliability of .9 by model (full text read). The game takes the trial counts as a guide to the blocks setting.
- Jongen, E. M. M., & Jonkman, L. M. (2008). The developmental pattern of stimulus and response interference in a color-object Stroop task: an ERP study. BMC Neuroscience, 9(1), 82. https://doi.org/10.1186/1471-2202-9-82In a two-button colour-object task, children aged 6 to 12 and adults were slower when the wrong colour belonged to the other button (full text read). Each trial of the game with an unusual colour is of that kind, since each wrong paint has its own pot.
- Hedge, C., Powell, G., & Sumner, P. (2018). The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences. Behavior Research Methods, 50(3), 1166-1186. https://doi.org/10.3758/s13428-017-0935-1Robust conflict effects retested poorly, at about .6 for the Stroop cost (full text read). The game reports its own plain look and the other measures beside the cost.
Source papers
Questions
How long does the Paint Pot Game take?
About 12 to 16 minutes, as listed in the test library.
What device does a participant need?
Timed test: participants need a desktop or laptop with a mouse or trackpad. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Response-Time Cost, Initiation Cost, Movement Cost, Initiation Cost, Lifted, Initiation Cost, Moved, Error Cost, Mean Response, Congruent, Mean Response, Incongruent, Median Response Time, Median Initiation Time, Accuracy, Congruent, Accuracy, Incongruent, Accuracy, Scored Trials, Early Starts, Lifts Under 100 ms, Timed-Out Trials, Share Left by Moving, Stray Touches, Trials with an Extra Contact, Trials Stamped by the Handler, Share of Lifts at a Fixed Delay, Share on One Pot, Share of Touch Answers, Colour Check and Colour Check Rounds. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Stroop Color-Word Test used in research?
These counts belong to the Stroop Color-Word Test, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. 4,956 papers from 2021 to 2025 name the task in their title or abstract, up 14% compared with 2016 to 2020. That ranks it 4 of 711 test families in the ConductCognition test census (use grade A). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Stroop Color-Word Test have?
These counts belong to the Stroop Color-Word Test, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. In the published research, 151 papers report the task's test-retest reliability and 1,929 registered clinical studies use it as an outcome (evidence grade A in the ConductCognition test census).
Does it report a percentile?
No. Scores and quality flags only.
Which settings can a researcher change?
Look (Game, Plain) and blocks (2 to 8). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings. Every plan can change the look, which never changes how a result is scored.
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.
Related tests