ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention143
    • Working memory51
    • Executive function191
    • Episodic memory84
    • Response inhibition10
    • Social cognition97
    • Language50

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 681 tests

    Browse by

    • Phone380
    • Tablet415
    • Untimed419
    • Up to 5 minutes81
    • Evidence grade A48
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 681 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,848 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia202
    • Decisions and reward136
    • Child development and education114
    • Social behavior87
    • Language and bilingualism80
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma28
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue17
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Tests
  3. /Word Partners Task

Language

Word Partners Task

Also called: collocation task, collocation test, collocational knowledge task, collocation judgment task, phrase acceptability task

Measure collocation knowledge. Participants choose the word that usually goes with another, then judge frequent, rare and unused English word pairs against the clock.

7-9 minTimed: desktop or laptop with a mouse or trackpad

Create a study with this test

Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.

Papers, 2021 to 2025
215
Evidence grade
C
Registered clinical studies
0
How these are counted
Which word usually goes in the gap?____ interest
brightkeensmart
deep voiceF: usual · J: not usual
Frequent pairs recognized faster than rare ones
Choose the word that usually goes with another, then judge pairs against the clock
  • Overview
  • Evidence
  • Task design
  • Quality checks
  • Settings
  • Cite
  • Questions

What it measures

Measures collocation knowledge, knowing which words usually go together. Participants pick the word that usually goes with another, such as keen interest, then press F or J to judge whether word pairs are usual in English, with frequent pairs, rare pairs and pairs that are not used. Scores accuracy, and how much faster frequent pairs are recognized than rare ones. The words are English in every session.

Constructs

  • Collocation knowledge
  • Vocabulary depth
  • Lexical processing

Research uses

  • Second-language research
  • Vocabulary research
  • Psycholinguistics

How the paradigm works

Knowing which words usually go together, such as heavy rain rather than strong rain, marks fluent use of a language and is a frequent difficulty for second-language learners. This collocation task has two parts, with English items in every session. In part 1, a word with a gap appears with three words, and participants choose the one that usually goes in the gap, with no deadline: ten adjectives for nouns and ten verbs for nouns, the other two options near-synonyms or the verbs learners use instead, the kinds of error Nesselhauf found in learners' writing. In part 2, after a cross for 250 ms and a blank for 50 ms, an adjective and a noun appear together, and participants press F or J within 4 seconds to say whether the pair is a usual one in English, as in the acceptability judgments of Wolter and Gyllstad and of Öksüz, Brezina and Rebuschat. Twenty adjectives each make one frequent pair and one rare pair, and each of their forty nouns appears again with another adjective in a pair that is not used, so no single word gives the answer away; the frequencies come from Google Books. Which key means usual is balanced across sessions. Two practice items and four practice pairs come first, with feedback.

Scores

Usual Partners Chosen%
Percentage of part 1 items answered with the usual partner.
Higher means more correct
Adjective Partners Chosen%
The same for the ten adjective + noun items.
Higher means more correct
Verb Partners Chosen%
The same for the ten verb + noun items.
Higher means more correct
Frequency Effectms
Median time to accept rare pairs minus median time to accept frequent pairs, over right answers.
Positive means frequent pairs were recognized faster
Pairs Judged Correctly%
Right answers in part 2, as a percentage of right and wrong answers.
Higher means more correct
Frequent Pairs Accepted%
Frequent pairs answered usual.
Higher means more correct
Rare Pairs Accepted%
Rare pairs answered usual.
Higher means more correct
Wrong Pairs Rejected%
Pairs that are not used, answered not usual.
Higher means more correct
Median Time, Frequent Pairsms
Median time of right answers to frequent pairs.
Lower means faster
Median Time, Rare Pairsms
Median time of right answers to rare pairs.
Lower means faster
Median Time, Wrong Pairsms
Median time of right answers to pairs that are not used.
Lower means faster
Missed Pairscount
Part 2 pairs left unanswered for 4 seconds.
0 expected
Answers Under 100 mscount
Answers given within 100 ms in either part.
0 expected
Part 1 Items Answeredcount
Part 1 items answered in the most complete run.
20 standard
Part 1 Items Plannedcount
Part 1 items in the run.
20 standard
Part 2 Pairs Showncount
Part 2 pairs recorded in the most complete run, answered or missed.
80 standard
Part 2 Pairs Plannedcount
Part 2 pairs in the run.
80 standard
Other Instruction Languageflag
1 when the English items were shown with instructions in another language.
Review English comprehension

Use and evidence

215 papers from 2021 to 2025 name this task in their title or abstract, up 5% compared with 2016 to 2020. That ranks it 160 of 711 test families in our census. See the counts for every test.

2021 to 2025, the years gradedEarlier years
Papers per year naming the Word Partners Task, 2000 to 2025Bar chart. 2021: 34; 2022: 33; 2023: 43; 2024: 50; 2025: 55 papers. Peak year 2025.02040602000: 2 papers2001: 0 papers2002: 2 papers2003: 3 papers2004: 2 papers2005: 5 papers2006: 5 papers2007: 8 papers2008: 7 papers2009: 16 papers2010: 19 papers2011: 16 papers2012: 23 papers2013: 29 papers2014: 40 papers2015: 36 papers2016: 46 papers2017: 43 papers2018: 35 papers2019: 40 papers2020: 40 papers2021: 34 papers2022: 33 papers2023: 43 papers2024: 50 papers2025: 55 papers200020052010201520202025
Papers per year naming the Word Partners Task, 2000 to 2025Bar chart. 2021: 34; 2022: 33; 2023: 43; 2024: 50; 2025: 55 papers. Peak year 2025.02040602000: 2 papers2001: 0 papers2002: 2 papers2003: 3 papers2004: 2 papers2005: 5 papers2006: 5 papers2007: 8 papers2008: 7 papers2009: 16 papers2010: 19 papers2011: 16 papers2012: 23 papers2013: 29 papers2014: 40 papers2015: 36 papers2016: 46 papers2017: 43 papers2018: 35 papers2019: 40 papers2020: 40 papers2021: 34 papers2022: 33 papers2023: 43 papers2024: 50 papers2025: 55 papers200020052010201520202025
Papers per year whose title or abstract names this task (OpenAlex).
Show the numbers
YearPapers
202555
202450
202343
202233
202134
202040
201940
201835
201743
201646
201536
201440
201329
201223
201116
201019
200916
20087
20078
20065
20055
20042
20033
20022
20010
20002
C

Use grade C

100 to 299 papers from 2021 to 2025.

C

Evidence grade C

At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.

Papers on test-retest reliability
2
Papers on reliability or validity
34
Registered clinical studies using it as an outcome
0

Measured on ConductCognition

Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.

No pooled figure yet.

Note on the counts: mostly second-language learning studies.

How the grades work

Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.

Source: ConductCognition test census 0.58.0, counted 13 November 2026 from OpenAlex and ClinicalTrials.gov.

Task design

The trial sequence as the test runs in ConductCognition.

Part 1
20 English items with no deadline: a word with a gap and 3 options, 10 adjectives for nouns and 10 verbs for nouns. The usual partner is at least 20 times as frequent with the word as the other 2.
Part 2
80 adjective + noun pairs after a cross for 250 ms and a blank for 50 ms, each judged usual or not with F or J within 4 seconds.
Pairs
20 adjectives each make 1 frequent and 1 rare pair; each of their 40 nouns appears again in a pair that is not used, with 1 of 20 other adjectives, so no single word gives the answer away.
Frequencies
From Google Books (English, 2010 to 2019): frequent pairs at least 0.4 per million, rare pairs 0.02 to 0.15, unused pairs at most 0.003. Nouns of frequent and rare pairs are matched on word frequency and length.
Practice
2 items and 4 pairs with feedback. Which key means usual is balanced across sessions.
Scores
Percentage of usual partners chosen in part 1, and the frequency effect: the median time to accept rare pairs minus frequent pairs. Acceptance, rejection and median times by kind of pair, missed pairs and answers under 100 ms.

The items are our own, chosen with open frequency lists, and they are English in every session, as in second-language collocation studies. Scores support research and do not diagnose. No percentile output.

Quality checks

Each session is marked valid, needs review or invalid, with the reason, before you see its scores.

Scored rows: word_partners_choice and word_partners_judgment from the most complete run, checked against the canonical items: one of three words in part 1, F or J for usual or not within 4 seconds in part 2 (half the pairs are usual). Below chance invalidates and not above chance is flagged, and one option on 90% of answers invalidates when accuracy is not above chance. Missed responses and responses under 100 ms follow the timed-test rule. Fewer than half the items of a part invalidates and any shortfall is flagged. A session in a language other than English is flagged for review. A hidden tab withholds the percentile.

Why these rules

Accuracy significantly below chance (one-sided exact test, p < .05) cannot come from guessing; it means the response mapping was reversed or the task was not followed (Slick, Sherman and Iverson 1999 treat below-chance forced-choice performance as definite response bias). Chance-level accuracy can be a real result in impaired participants, so it is only flagged. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). The usual partner is in each of the three positions equally often, and half the pairs are usual. Missed responses and responses under 100 ms keep the platform's timed-test rule: more than max(3, 25%) missed responses or more than max(2, 20%) responses under 100 ms invalidate, and any is flagged. A response under 100 ms cannot be a reaction to the stimulus. The two parts measure different things, so an incomplete part changes the scores' meaning. The word lists are English. A session run in another language shows English words to a participant who may not read English fluently, so it is flagged for review. Another tab can be used to look a phrase up, so a percentile is withheld after a hidden tab.

No percentile. Scores and quality flags only.

Running this test

Settings you can change

This test runs with fixed settings.

How test settings work

Need a different version of this test?

Devices and languages

  • Timed test: participants need a desktop or laptop with a mouse or trackpad. Participant devices
  • Instructions and screens: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. Words and sentences: English.
  • Available on: Every plan, including the free plan.
  • No percentile. Scores and quality flags only. How norms work
  • Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.

Cite and describe

Methods text, with the standard settings

Participants completed the Word Partners Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Nesselhauf N, 2003; Wolter B, Gyllstad H, 2011, 2013; Öksüz D, Brezina V, Rebuschat P, 2021). The main score was usual partners chosen (percentage of part 1 items answered with the usual partner).

ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.

  • Nesselhauf, N. (2003). The use of collocations by advanced learners of English and some implications for teaching. Applied Linguistics, 24(2), 223–242. https://doi.org/10.1093/applin/24.2.223Verb + noun collocations in advanced German-speaking learners' free writing: the first language shaped their errors far more than earlier studies predicted.
  • Wolter, B., & Gyllstad, H. (2011). Collocational links in the L2 mental lexicon and the influence of L1 intralexical knowledge. Applied Linguistics, 32(4), 430–449. https://doi.org/10.1093/applin/amr011A primed lexical decision task and a receptive collocation test: learners responded faster to collocations that have a translation in their first language.
  • Wolter, B., & Gyllstad, H. (2013). Frequency of input and L2 collocational processing: A comparison of congruent and incongruent collocations. Studies in Second Language Acquisition, 35(3), 451–482. https://doi.org/10.1017/S0272263113000107An acceptability judgment task with collocations and matched unrelated pairs: native and advanced learners were highly sensitive to collocation frequency.
  • Öksüz, D., Brezina, V., & Rebuschat, P. (2021). Collocational processing in L1 and L2: The effects of word frequency, collocational frequency, and association. Language Learning, 71(1), 55–98. https://doi.org/10.1111/lang.12427Judgments of whether adjective + noun pairs are commonly used, with high- and low-frequency collocations and baseline pairs that reuse their nouns: both groups were faster for frequent collocations.

Source papers

  • Wolter and Gyllstad (2013); Öksüz, Brezina and Rebuschat (2021): collocation acceptability judgments.Paradigm source, Adults who read English

Questions

How long does the Word Partners Task take?

About 7 to 9 minutes, as listed in the test library.

What device does a participant need?

Timed test: participants need a desktop or laptop with a mouse or trackpad. The browser must be Chrome, Edge, Firefox or Safari.

What scores does it produce?

Usual Partners Chosen, Adjective Partners Chosen, Verb Partners Chosen, Frequency Effect, Pairs Judged Correctly, Frequent Pairs Accepted, Rare Pairs Accepted, Wrong Pairs Rejected, Median Time, Frequent Pairs, Median Time, Rare Pairs, Median Time, Wrong Pairs, Missed Pairs, Answers Under 100 ms, Part 1 Items Answered, Part 1 Items Planned, Part 2 Pairs Shown, Part 2 Pairs Planned and Other Instruction Language. Each session is also marked valid, needs review or invalid, with the reason.

How widely is the Word Partners Task used in research?

215 papers from 2021 to 2025 name it in their title or abstract, up 5% compared with 2016 to 2020. That ranks it 160 of 711 test families in the ConductCognition test census (use grade C). Source: ConductCognition test census 0.58.0, counted 13 November 2026 from OpenAlex and ClinicalTrials.gov.

How much reliability evidence does the Word Partners Task have?

In the published research, 2 papers report its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade C in the ConductCognition test census).

Does it report a percentile?

No. Scores and quality flags only.

Which languages can participants use?

The instructions and screens are in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. The words and sentences stay in English, so sessions in other languages are flagged for review. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.

Is this a clinical test?

No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.

Every test: the full test list.

New tests and features, about once a month. Unsubscribe at any time.

Run this test in your next study

Start free with 10 free participants on any test, then use participant credits or a yearly plan.

Start free

Related tests

Vocabulary TestLexical Decision TaskTranslation Recognition Task
ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Big Five personality test
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • ConductScience Fellows
© 2026 ConductScience, Inc. Research use only.