Executive Function
Puddle Stones Game
Also called: number and shape switching game for children, connect the numbers game for children, stone connecting game
Measure how long children take to finish Part B, where numbered stones are touched in order and the shape of the stone alternates between round and square.
4-6 minTimed: desktop or laptop with a mouse or trackpad
Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.
- Papers, 2021 to 2025
- 3,944
- Evidence grade
- A
- Registered clinical studies
- 2,293
Figures for the Trail Making Test B, the published test this game is compared with.
How these are countedWhat it measures
A timed game for research on cognitive flexibility in children aged 6 to 12, with an adult reading the screens aloud to children under 8. Stones with numbers lie in a puddle. In Part A the child touches the stones from 1 to 15 in order. In Part B each number is on a round and a square stone, and the child alternates the two kinds. The score is the time to finish Part B, read with the errors. It is a raw research measure with no percentile.
Constructs
- Cognitive flexibility
- Switching between two kinds of stone
- Visual search and sequencing
- Processing speed
Research uses
- Research on cognitive flexibility and processing speed in children
How the paradigm works
The Puddle Stones Game is a timed game for research on cognitive flexibility in children aged 6 to 12, with an adult reading the screens aloud to children under 8. Stones with numbers lie in a puddle, drawn in code, and no stone carries a letter. In Part A the child touches 15 stones in number order, 1 to 15. In Part B the numbers 1 to 8 are on round stones and the numbers 1 to 7 are on square stones, and the child touches 1 on the round stone, 1 on the square stone, 2 on the round stone, 2 on the square stone, and on, to 8 on the round stone. Every stone is a target, and there are no copies. The main score is the time to finish Part B, in seconds, with Part A as its control and the wrong touches beside it. The time is read with the errors, because a child who ignores the shapes can finish Part B with a few wrong touches and little loss of time. The form follows a published child version of a trail making task with numbers and shapes, whose Part A and Part B have 15 shapes each (Chan and Morgan 2018). A hand shows each part on a few stones before its practice. Each practice has 5 or 6 stones, with a ring on the right stone after a wrong touch, and the practice runs once more after more than 2 wrong touches. A touch counts only if it starts on a stone, so a palm or a miss is counted and never blocks the next touch, and a touch within 250 ms of the last one is ignored and counted. The stones, the layouts and the words here are our own.
More about the paradigm
The paper counts and grades on this page are those of the Trail Making Test B, the published test the game is compared with, not the game's own. The validation plan also compares the game with the Trail Making Test A, against which Part A's time is checked. The game has six alternate forms whose path length, step lengths and crossings are equal by construction, and they are not pooled until a check on first sessions shows them equally difficult. Try it now shows a seventh form that no study uses.
Scores
- Part B Timeseconds
- Seconds from Part B's first frame to its 15th connection, to 0.1 s. Empty unless Part A and Part B were both finished within 180 seconds and scored.
- Main score: lower is faster. Read with the wrong touches, within an input type and within an age year
- Part A Timeseconds
- Seconds from Part A's first frame to its 15th connection. Empty when Part A was not finished within 180 seconds.
- Control: the speed of touching stones in order, with no switch between kinds
- Switch Differenceseconds
- Part B's time less Part A's time, when both parts were finished.
- Informational: a larger difference means Part B took longer compared with Part A. It keeps little reliable variance of its own, so it is not the main score
- Switch Ratioscore
- Part B's time over Part A's time, when both parts were finished.
- Informational: a larger ratio means Part B took longer compared with Part A
- Part A Wrong Touchescount
- Touches on a stone that was not the next one in Part A.
- Quality check
- Part B Wrong Touchescount
- Touches on a stone that was not the next one in Part B, of either kind of mistake.
- Quality check: the time is read with this count
- Part B Wrong-Shape Touchescount
- Touches in Part B on the right number on the other shape of stone.
- Secondary: the switch between round and square shows here, and three or more in a Part B are flagged for review
- Part B Wrong-Number Touchescount
- Touches in Part B on any other stone than the next one and the same number on the other shape.
- Secondary
- Part A Finished0/1
- 1 when Part A reached its 15th connection; empty, with every other measure, when it did not.
- Quality check: a child who does not finish Part A has no Part B time, because Part A is the control and the numerals may not be known
- Part B Finished0/1
- 1 when Part B reached its 15th connection within 180 seconds, 0 when it did not.
- Quality check
- Repeat Touchescount
- Touches within 250 ms of the last accepted touch, which are ignored.
- Quality check: a double touch lands here
- Extra Contactscount
- Second contacts on a stone while one was held, and mouse buttons other than the main one, which are ignored.
- Quality check
- Touches off the Stonescount
- Contacts that started on no stone, such as a palm or a miss, and touches within 100 ms of a part's first frame, which are ignored.
- Quality check
- Share of Touch Parts%
- Share of the scored parts whose first accepted touch was a finger, not a mouse or a pen.
- Informational: times are compared within an input type
Use and evidence
3,944 papers from 2021 to 2025 name this task in their title or abstract, up 22% compared with 2016 to 2020. That ranks it 5 of 711 test families in our census. These counts belong to the Trail Making Test B, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. See the counts for every test.
Show the numbers
| Year | Papers |
|---|---|
| 2025 | 944 |
| 2024 | 803 |
| 2023 | 841 |
| 2022 | 648 |
| 2021 | 708 |
| 2020 | 720 |
| 2019 | 667 |
| 2018 | 646 |
| 2017 | 627 |
| 2016 | 576 |
| 2015 | 595 |
| 2014 | 496 |
| 2013 | 449 |
| 2012 | 421 |
| 2011 | 389 |
| 2010 | 330 |
| 2009 | 273 |
| 2008 | 274 |
| 2007 | 199 |
| 2006 | 208 |
| 2005 | 138 |
| 2004 | 98 |
| 2003 | 102 |
| 2002 | 90 |
| 2001 | 85 |
| 2000 | 92 |
Use grade A
1,000 or more papers from 2021 to 2025.
Evidence grade A
At least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome.
- Papers on test-retest reliability
- 161
- Papers on reliability or validity
- 1,323
- Registered clinical studies using it as an outcome
- 2,293
Measured on ConductCognition
Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.
No pooled figure yet.
How the grades work
Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on the Trail Making Test B, the published test this game is compared with, not the game's own.
Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.
Task design
The trial sequence as the test runs in ConductCognition.
- Stones
- Round and square stones drawn in code, each with a number from 1 to 15 and no letter. A round stone is a circle with a smooth face, and a square stone is a rounded square with two ridges. Both have one sand fill, one dark edge and one dark number, so colour tells nothing and no colour vision is needed. The game look adds puddles behind the stones, the same for every part; the plain look has a flat ground. Both looks draw every stone the same way.
- Part A and Part B
- Part A has 15 round stones, touched in number order. Part B has 15 stones, and every stone is a target: the numbers 1 to 8 are on round stones and the numbers 1 to 7 are on square stones, and the child touches 1 on the round stone, 1 on the square stone, 2 on the round stone, 2 on the square stone, and on, to 8 on the round stone. There are no copies, so the only choice at a step is between the two stones of one number. Stone 1 carries a small flag, and no other stone is marked.
- Demonstrations and practice
- An animated hand shows each part before its practice: it touches 1, 2 and 3 on three stones, and then 1 on the round stone, 1 on the square stone, 2 on the round stone and 2 on the square stone. A stone fills as the hand touches it and a line follows, and under reduced motion the same scenes play as fades with the same timing. Each part then has a practice of 5 stones (6 in Part B), with a ring on the right stone after a wrong touch. The practice runs once more after more than 2 wrong touches.
- Layouts and forms
- Six alternate forms and a seventh for Try it now, each with its own layouts for both parts. The layouts are equal in path length, in the length of the steps from a round stone to its square partner and of the steps from a square stone to the next number, and in crossings, by construction. Part B's path is within 3% of its own Part A's, so the difference between the parts reads the shapes and not the distance. No two forms are turns of one another, and no path sweeps across the puddle. Each child gets the forms in an order drawn once for them, and each session takes the next form after the sessions they began before it. The forms are not pooled until a check on first sessions shows them equally difficult.
- Touches
- A touch counts only if it starts on a stone, so a palm, a knuckle or a miss is counted and never blocks the next touch. A second finger on a stone while one is held is counted and ignored, and so is a touch within 250 ms of the last one; a touch on a stone already connected is ignored. A wrong stone is counted as an error, the same number on the other shape as a wrong-shape error and any other stone as a wrong-number error. A part with a hidden tab or a resized window is left out.
- Marks
- A connected stone fills in, and a line joins it to the one before. A wrong stone is outlined for 300 ms. Nothing else moves in a timed part, no line runs ahead, and no count, time or score shows. A part ends at its last stone or 180 seconds after it opens.
- Scores
- The time to finish Part B in seconds (the main score, lower is faster, empty unless Part A and Part B were both finished), Part A's time (its control), the difference and the ratio of the two, the wrong touches (Part B's by shape and by number), whether each part was finished, and the counts of repeat, extra and stray touches. The time is read with the errors, because a child who ignores the shapes can finish Part B with a few wrong touches. The split-half is the 14 steps of Part B, each the seconds from one connection to the next, in two random halves within the steps from a round stone to its partner and the steps to the next number.
- Window and devices
- The puddle scales from 1.5 down to 0.85 and turns a quarter on an upright tablet, so every form keeps its layout on every device. A stone is 76 px at scale 1 and 64.6 px at the smallest, and older-adult mode changes the words and the buttons, never the stones. A stage (the window less the progress bar) under 714 by 510 px (510 by 714 upright) is held with a line until it fits. The game runs on desktops, laptops and touch-screen computers at release, with the input recorded. Tablets open once two filmed tablets pass the device timing check, and phones do not run the game. It takes a mouse, a finger or a pen and has no keyboard route.
- Age and use
- For children aged 6 to 12. An adult reads each screen aloud to a child under 8, sits beside them, lets the child touch the stones and never points or gives the answer. Results under 18 are raw scores with no percentile, counted within one study. Times are compared within an input type, since a mouse, a finger and a pen do not move alike. Keep each child on one device class and one input at every visit.
- Schedule
- Built for repeated visits: a run-in session before the baseline, one session at each visit, and for a retest a second visit of the same study 7 to 28 days after the baseline. The six forms come in each child's own order. The evidence plan reports the split-half and the retest of the time, the practice curve over the first sessions, and whether each form is within 0.3 standard deviations of the others.
The game takes the paradigm of touching numbered targets in order and, in Part B, alternating two shapes, as the trail making task does and as a published child version does that has two parts of 15 shapes (Chan and Morgan 2018). The stones, the layouts, the touch rules, the words and the looks are our own, and no letter is used. This is a new measure for research with children, built for repeated visits: its reliability and norms come from use, the figures published in that study are not its own, and it computes no percentiles. Use a mouse, a finger or a pen for the whole study, and compare times within one input type.
Quality checks
Each session is marked valid, needs review or invalid, with the reason, before you see its scores.
Scored rows: puddle_stones_game test parts A and B, each once, from its first row (a part with a hidden tab, a resized window or a row of the wrong shape is left out, and so is a run holding two forms). A Part A not finished within 180 seconds invalidates the run (the numerals may not be known), and so does a part with at least 12 touches of which under a third were right. A part not finished, 3 or more wrong-shape touches in Part B, a Part B under 7 seconds or a Part A under 5, extra contacts and stray taps on over 10% of the touches or over 20 repeat touches, and a practice of Part B not passed after its second round are flagged. No response time is scored, so the fast-response rule is not used.
Why these rules
A touch on a random stone is the next stone about 1 time in 15, and a random tapper who still finishes a part is right on about 1 touch in 5, so a child who was connecting the stones is right on far more than a third of the touches, and a run that is not is touching without following the numbers; the line is ours. A child who cannot finish Part A within the cap has not shown the numerals Part B needs, and Part A is the control the main score is read against, so nothing else is read. A connection's time is a stamp from the part's first frame, so no response time is scored and a response under 100 ms cannot enter a score. A part during which the tab was hidden or the window changed size was not played as the others were, so it is left out. A Part B not finished at the 180 second cap has no time and is flagged for review. The plain form scores time alone and counts no errors, so a child who ignores the shapes does not pay for it in time: three or more touches on the right number and the wrong shape in Part B flag that, by chance in about two thirds of the Part Bs of a child who ignores the shapes and in a few in a thousand of those of a child who follows the rule, and the time is read with the errors. A part finished faster than a child can look for each stone is flagged. A palm or a second finger on the screen, or a double touch, can change which stones were touched, so a high share of them is flagged for a person to read beside the time.
No percentile. Scores and quality flags only.
Running this test
Settings you can change
| Setting | Standard | Allowed |
|---|---|---|
| Look | Game | Game, Plain |
Every plan can change the look, which never changes how a result is scored.
Need a setting this test does not have?
Devices and languages
- Timed test: participants need a desktop or laptop with a mouse or trackpad. Participant devices
- Languages: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese.
- Available on: Every plan, including the free plan.
- No percentile. Scores and quality flags only. How norms work
- Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.
Cite and describe
Participants completed the Puddle Stones Game in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Chan and Morgan, 2018), with the standard settings (look: Game). The main score was part B time (seconds from Part B's first frame to its 15th connection, to 0.1 s).
ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.
- Chan, A. Y. C., & Morgan, S.-J. (2018). Assessing children's cognitive flexibility with the Shape Trail Test. PLOS ONE, 13(5), e0198254. https://doi.org/10.1371/journal.pone.0198254The paradigm: two parts of 15 shapes, Part A the numbers in circles in order and Part B the numbers in circles and in squares, alternating the two shapes (full text read). The game takes the paradigm and the two parts of 15 stones, not the paper's shapes, its figures or its scoring.
Source papers
Questions
How long does the Puddle Stones Game take?
About 4 to 6 minutes, as listed in the test library.
What device does a participant need?
Timed test: participants need a desktop or laptop with a mouse or trackpad. The browser must be Chrome, Edge, Firefox or Safari.
What scores does it produce?
Part B Time, Part A Time, Switch Difference, Switch Ratio, Part A Wrong Touches, Part B Wrong Touches, Part B Wrong-Shape Touches, Part B Wrong-Number Touches, Part A Finished, Part B Finished, Repeat Touches, Extra Contacts, Touches off the Stones and Share of Touch Parts. Each session is also marked valid, needs review or invalid, with the reason.
How widely is the Trail Making Test B used in research?
These counts belong to the Trail Making Test B, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. 3,944 papers from 2021 to 2025 name the task in their title or abstract, up 22% compared with 2016 to 2020. That ranks it 5 of 711 test families in the ConductCognition test census (use grade A). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.
How much reliability evidence does the Trail Making Test B have?
These counts belong to the Trail Making Test B, the published test this game is compared with. This game is a new measure, so its own reliability and norms come from use. In the published research, 161 papers report the task's test-retest reliability and 2,293 registered clinical studies use it as an outcome (evidence grade A in the ConductCognition test census).
Does it report a percentile?
No. Scores and quality flags only.
Which settings can a researcher change?
Look (Game, Plain). Every plan can change the look, which never changes how a result is scored.
Which languages can participants use?
Participants can take this test in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.
Is this a clinical test?
No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.
Every test: the full test list.
Run this test in your next study
Start free with 10 free participants on any test, then use participant credits or a yearly plan.
Related tests