Can I change the number of trials?
Yes, in 389 of the 681 tests. Their settings include the number of trials, blocks, items or span lengths, each within a set range. Pick a test in the settings explorer on this page to see its ranges.
Test settings and custom tests
Change trial counts, timing and test parts yourself, within the limits each test allows. If your study needs a test we do not have, or a version of one of ours, we build it for you.
Change the settings yourself
Trial counts, timing and test parts, within each test's limits, on yearly plans. Preview the exact test before participants see it.
Have a test built for your study
Tell us what you study and what participants should do. We reply with an estimate of the cost and the time to build it.
Step 1
Tell us what you study
Describe what participants should see and do, and what you need to measure. Name the paper if you are replicating one.
Step 2
Get an estimate
We reply by email with an estimate of the cost and the time to build it.
Step 3
Preview and refine
When you approve the estimate, we build the test. You try it as a participant and ask for changes.
Step 4
Run it in your studies
It runs like any other test, in the same study flow and the same data export.
Your categories and word lists in the Implicit Association Test, for the attitudes your field studies.
Your own pictures in a memory test
Faces, objects or scenes from your lab in place of the standard images.
A task from a paper you want to replicate
A published paradigm we do not offer yet, built to the paper's timing and scoring.
614 tests with settings
Percentiles against a published norm, on paid plans and pay-as-you-go studies.
| Setting | Standard | Allowed range |
|---|---|---|
| Practice trials | 16 | 8 to 40 |
| Single-task trials | 32 | 16 to 120 |
| Mixed-task trials | 72 | 32 to 200 |
| Switch probability | 0.5 | 0.25 to 0.75 |
Standard value: 16
Standard value: 32
Standard value: 72
Standard value: 0.5
The values you try here are not carried over. Set them in the study builder on a paid plan.
67 tests have no settings and always run as designed: Quick Circles Game, Pick the Same Game, Two Lamps Game, Symbol Key Game, Swap Spotter Game, Card Sort Game, Bus Window Game, Week Later Game, Twin or New Game, Go/No-Go Game, Star Places Game, Two Jars Game, Town Errands Game, Talk Bubbles Game, Glow Squares Game, Tile Row Game, Two Gardens Game, Hat Stand Game, Trail Making Test A, Trail Making Test B, Pond Stones Game, Puddle Stones Game, Paired Associate Learning, Picture Partners Game, Mixed Reasoning Task, Attitude Attribution Task, False Consensus Task, Self-Estimate Task, Phoneme Monitoring Task, Property Induction Task, Reasoning Biases Problems, Wason Selection Task, Diagram Rule Task, Numeracy Problems Test, Moses Illusion Task, Pronoun Resolution Task, Sunk Cost Task, Vocal Emotion Task, Thatcher Illusion Task, Two-Tone Pictures Task, Color Feelings Task, Decide Later Task, Decoy Choice Task, Endowment Effect Task, Built It Myself Task, Preference Change Task, Yes-No Vocabulary Task, Rhyme Judgment Task, Proportional Reasoning Task, Arithmetic Stories Task, Equal Sign Task, Place Value Task, Food-Picture Dot-Probe, Emotional Stroop Task, Implicit Association Test (IAT), Extrinsic Affective Simon Task, Function Acquisition Speed Task, Convex Time Budget Task, Plea Decision Task, Cue Blocking Task, Wayfinding Game, Which-Way-Back Game, Grocery Trip Game, Operation Span, Word Parts Task, Word Partners Task and Body Postures Task.
| Column | What it holds |
|---|---|
| test_version | The version of the test the session ran. |
| config_version | The test version its settings were checked against. |
| scoring_version | The scoring version used for the session. |
| customization_status | standard, or scored_modified when a setting was changed. A setting that only changes how a test looks, such as a game's Look setting (the game_look trial column), keeps it standard. |
| configuration_normative_eligible | true when the session could show a percentile. |
| configuration_json | Every setting the session ran with, as JSON. |
Every column and file: research data export. How percentiles work: test norms.
| Kind | What it changes | Settings | Tests | Example |
|---|---|---|---|---|
| Length | Trials, blocks, items and spans | 470 | 389 | Navon Global-Local Task: Trials per block, 24 to 96 |
| Timing | Display times, delays, response windows, time limits and lapse thresholds | 212 | 157 | Stop-Signal Task: Initial stop-signal delay (ms), 100 to 600 |
| Rates | How often targets or switches come up | 5 | 5 | Task Switching Test: Switch probability, 0.25 to 0.75 |
| Parts | Parts of a test to include or leave out | 69 | 64 | Digit Span Test: Include backward span, on or off |
| Choices | A version of the test | 459 | 335 | Semantic Priming Task: Prime-to-target interval, 200 ms (standard) or 1,200 ms |
Write your own consent text or turn the consent screen off, offer participants a choice of eight languages, use larger text for older adults, and choose whether to ask demographic questions.
Languages other than English and setting changes come with yearly plans.
Use presets for Prolific, Sona Systems, CloudResearch Connect and Qualtrics, save up to 10 extra link parameters with each participant, and send people back with a completion code. Recruitment setup guides
Save your own protocol as a template on paid plans. The tests in each template
Each test's stimuli, instructions, keys, scoring and device rules are fixed for its version, so results stay comparable across studies and over time.
Need different stimuli, instructions or a new task? We build custom versions.
Yes, in 389 of the 681 tests. Their settings include the number of trials, blocks, items or span lengths, each within a set range. Pick a test in the settings explorer on this page to see its ranges.
In 157 tests: Hard-to-Read Words Task, Living Things Memory Task, Sentence Copy Speed Task, Psychomotor Vigilance Task, Rapid Visual Information Processing, Continuous Performance Test, Stop-Signal Task, Stop-Change Task, Recognition Memory Test, Delayed Recall Module, Visual Search Test, Affective Go/No-Go, Spatial Working Memory, Intra/Extra Dimensional Set Shift, Symbol Coding, Hidden Path Learning, Delayed Match-to-Sample, One-Touch Tower Planning, Short Story Recall, Verbal Learning, Squared Attention Tasks, Size Order Memory Test, Picture Order Memory Test, Mnemonic Similarity Task, Word Pair Learning, List Interference Task, Study Choices Task, Pattern and Letter Comparison, Symbol Scan Task, Design Fluency Test, Water Jars Task, Sternberg Memory Scanning, Recent Probes Task, Evaluative Priming, Scrambled Sentences Test, Emotion Regulation Task, Intentional or Accidental Task, False Belief Stories, Gaze and Expression Theory of Mind Task, Masked Priming Task, Picture Naming Test, Verb Generation Task, Tip-of-the-Tongue Task, Complex Figure Copy and Recall, Oddball Target Detection, Zeigarnik Effect Task, Fading Spot Task, Bistable Figures Task, Auditory Streaming Task, Inspection Time Task, Motion-Induced Blindness Task, Remote Associates Test, Worked Examples Task, Number Sequence Task, Insight Problems Test, Sentence Completion Inhibition Test, Letter Pair Reasoning Task, Token Commands Task, Scalar Implicature Task, Anagram Task, Tournament Choice Task, Real-Effort Slider Task, Reward and Interest Task, Teaching Expectancy Task, Trivia Curiosity Task, Drawing Memory Task, Imagined Events Task, Transposed Words Task, Agreement Attraction Task, Translation Recognition Task, Guess First Task, Mixed Practice Task, Choice Blindness Task, Evaluative Conditioning Task, Mere Exposure Task, Effort Check Task, Food Cue Reactivity Task, Levels of Processing Task, Free Recall Task, Selective Reminding Task, Process Dissociation Task, Survival Processing Task, Spacing Effect Task, Production Effect Task, Generation Effect Task, Encoding Specificity Task, Word Values Task, Category Lists Task, Memory Route Task, Why Questions Task, Part-List Cueing Task, Bizarreness Effect Task, Directed Forgetting Task, Attentional Boost Task, Word Valence Memory Task, Picture Superiority Task, Boundary Extension Task, Associative Recognition Test, Relational and Item Encoding Task, Reading Span Task, Listening Span Task, Symmetry Span Task, Letter-Number Sequencing Task, Running Span, Memory Updating Task, Emotional Face Matching Task, Composite Face Task, Lineup Memory Task, Face-name Memory Task, Object Location Memory Task, Remember and Know Test, Source Memory Task, Face Memory Test, Automation Aid Task, Second Estimate Task, Income Reporting Task, Judgments of Learning Task, DRM False Memory Task, Misinformation Effect Task, Memory Conformity Task, Hypercorrection Task, Instructed Lying Task, Illusory Truth Task, Continued Influence Task, Brief Letter Report Task, Grid Pattern Span Task, Feeling Forecast Task, Wait for Two Task, Pursuit Tracking Test, Motor Sequence Task, Vocabulary Test, Artificial Grammar Learning, Statistical Learning Task, Novel Word Learning Task, Self-Paced Reading Task, Temporal Bisection Task, Anticipatory Inhibition Task, Change Blindness Task, Arithmetic Fluency Task, Retrieval Practice Task, Word Stem Completion Task, Retrieval-Induced Forgetting Task, Implicit Relational Assessment Task, Go/No-Go Association Task, Self-Referential Encoding Task, Experiential Discounting Task, Information Seeking Task, Director Task, Maze Tracing Test, Ordered Number Search Task, Virtual Maze Navigation, Mirror Tracing Task, Fortress Flight Game, Verbal Fluency, Category Fluency, Rotation Span Task and Clock Drawing Task. Their settings include display times, delays, response windows or time limits. The other tests keep their standard timing.
Not by yourself yet: each test's stimuli are fixed for its version. We can build a version with your words, pictures or categories. Tell us what you need, and we reply with an estimate of the cost and the time.
It depends on what the test needs. Most custom tests run on the engine behind our 681 tests, so they are quick and low-cost to build. Tell us what you need, and we reply with an estimate of the cost and the time before any work starts.
Yes. A session with any changed setting is scored as usual and marked modified, and it shows no percentile, because published norms apply to the standard settings. A session with standard settings shows a percentile when the test has a published norm, on paid plans and pay-as-you-go studies.
Participant pages and test instructions come in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. English is on every plan, and the other languages come with yearly plans. A study can offer several languages, and participants choose on their first page. 61 of the 681 tests keep their words and sentences in English, and each test's page lists its languages. Have a native speaker read the machine-translated text before launch.
Yes, on every plan. Put tests in sections, and give each section one order rule: Fixed order, Random order or Latin square. Whole sections can be counterbalanced too.
Every yearly plan: Academic Research, Academic Department, Academic Institution, Commercial Research, Commercial Team and Enterprise / CRO. Studies on the free plan, including pay-as-you-go studies, run the standard settings.
Yes. Every session saves the settings it ran with, and the score and trial exports add 6 columns for them: test_version, config_version, scoring_version, customization_status, configuration_normative_eligible and configuration_json.
Plans and prices: pricing.
Preview every test free, change settings on a paid plan, or have a test built for your study.