ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention143
    • Working memory51
    • Executive function191
    • Episodic memory84
    • Response inhibition10
    • Social cognition97
    • Language50

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 681 tests

    Browse by

    • Phone380
    • Tablet415
    • Untimed419
    • Up to 5 minutes81
    • Evidence grade A48
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 681 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,848 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia202
    • Decisions and reward136
    • Child development and education114
    • Social behavior87
    • Language and bilingualism80
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma28
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue17
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Tests
  3. /Yes-No Vocabulary Task

Language

Yes-No Vocabulary Task

Also called: yes/no vocabulary test, LexTALE-style vocabulary test, vocabulary checklist with made-up words, lexical test for advanced learners

Check English vocabulary in a few minutes: participants say which of 60 letter strings are English words, with 20 made-up words among them, scored as LexTALE scores it.

3-5 minUntimed

Create a study with this test

Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.

Papers, 2021 to 2025
73
Evidence grade
D
Registered clinical studies
0
How these are counted
confirm
burver
YesNo
40 words, 20 made upAveraged % correct
Say which letter strings are English words
  • Overview
  • Evidence
  • Task design
  • Quality checks
  • Settings
  • Cite
  • Questions

What it measures

Measures English vocabulary with a yes or no check. Participants see 60 letter strings, 40 English words from four frequency bands and 20 made-up words, and say which are English words. The score is the mean of the percentages correct for words and for made-up words.

Constructs

  • English vocabulary knowledge
  • Word recognition
  • Second-language proficiency

Research uses

  • Second-language and bilingualism research
  • English vocabulary as a covariate in cognitive studies
  • Screening of English knowledge before an English-language task
  • Within-study group comparison

How the paradigm works

The Yes-No Vocabulary Task is a quick check of English vocabulary. Each screen shows one string of letters and the participant says whether it is an English word. Some strings are made up, so answering Yes to everything does not help. The yes/no format with made-up words comes from Meara and Buxton (1987), and the design follows LexTALE (Lemhöfer and Broersma 2012), a short test of English vocabulary for research with advanced learners: 40 words and 20 made-up words, no time limit, and No when in doubt.

More about the paradigm

The 60 items were made for this task; LexTALE's items are not used. The 40 words come from four frequency bands of 10, by their Zipf value in English film and television subtitles (the Zipf scale of van Heuven and colleagues 2014), and native readers rate every one as familiar in the Glasgow Norms. No word is spelled like a common word in German, Spanish, French, Italian or Portuguese, so a reader of those languages cannot answer from their own language. Our code made the 20 made-up words from other familiar words by changing one or two letters and checked them against English dictionaries and word lists, so that none is a word or sounds like a common one; their lengths follow those of the words. Every participant sees the items in one fixed order, with no more than five of one kind in a row, after three practice items with feedback. The items are English in every session, and the instructions are in the session's language.

The main score, as in LexTALE, is the mean of the percentage of words answered Yes and the percentage of made-up words answered No, so Yes to everything, or No to everything, scores 50. Both percentages and the percentage of words known in each frequency band are also reported. Scores support research and make no claim about a proficiency level.

Scores

Averaged Percent Correct%
The mean of the percentage of words answered Yes and the percentage of made-up words answered No, as in LexTALE; Yes to everything scores 50.
Higher is better
Words Known%
Words answered Yes, as a percentage of the 40 words.
Higher is better
Made-Up Words Rejected%
Made-up words answered No, as a percentage of the 20 made-up words.
Higher is better
Words Known, Band 1%
Words answered Yes among the 10 most frequent words (Zipf 3.5 to 4.2).
Higher is better
Words Known, Band 2%
Words answered Yes among the 10 words of Zipf 3.0 to 3.5.
Higher is better
Words Known, Band 3%
Words answered Yes among the 10 words of Zipf 2.5 to 3.0.
Higher is better
Words Known, Band 4%
Words answered Yes among the 10 least frequent words (Zipf 1.8 to 2.5).
Higher is better
Median Answer Timems
Median time from an item appearing to its answer, for answers of at least 100 ms.
Informational; the task has no time limit
Answers Under 100 mscount
Answers given less than 100 ms after their item appeared.
0 expected
Items Answeredcount
Items with a Yes or No answer.
Fewer than half the planned items invalidates
Planned Itemscount
60: 40 words and 20 made-up words.
Informational

Use and evidence

73 papers from 2021 to 2025 name this task in their title or abstract, up 356% compared with 2016 to 2020. That ranks it 354 of 711 test families in our census. See the counts for every test.

2021 to 2025, the years gradedEarlier years
Papers per year naming the Yes-No Vocabulary Task, 2000 to 2025Bar chart. 2021: 9; 2022: 6; 2023: 8; 2024: 14; 2025: 36 papers. Peak year 2025.0102030402000: 0 papers2001: 0 papers2002: 0 papers2003: 0 papers2004: 0 papers2005: 0 papers2006: 0 papers2007: 0 papers2008: 0 papers2009: 1 papers2010: 0 papers2011: 1 papers2012: 0 papers2013: 1 papers2014: 0 papers2015: 2 papers2016: 7 papers2017: 1 papers2018: 3 papers2019: 0 papers2020: 5 papers2021: 9 papers2022: 6 papers2023: 8 papers2024: 14 papers2025: 36 papers200020052010201520202025
Papers per year naming the Yes-No Vocabulary Task, 2000 to 2025Bar chart. 2021: 9; 2022: 6; 2023: 8; 2024: 14; 2025: 36 papers. Peak year 2025.0102030402000: 0 papers2001: 0 papers2002: 0 papers2003: 0 papers2004: 0 papers2005: 0 papers2006: 0 papers2007: 0 papers2008: 0 papers2009: 1 papers2010: 0 papers2011: 1 papers2012: 0 papers2013: 1 papers2014: 0 papers2015: 2 papers2016: 7 papers2017: 1 papers2018: 3 papers2019: 0 papers2020: 5 papers2021: 9 papers2022: 6 papers2023: 8 papers2024: 14 papers2025: 36 papers200020052010201520202025
Papers per year whose title or abstract names this task (OpenAlex).
Show the numbers
YearPapers
202536
202414
20238
20226
20219
20205
20190
20183
20171
20167
20152
20140
20131
20120
20111
20100
20091
20080
20070
20060
20050
20040
20030
20020
20010
20000
D

Use grade D

30 to 99 papers from 2021 to 2025.

D

Evidence grade D

Little published measurement evidence found.

Papers on test-retest reliability
1
Papers on reliability or validity
25
Registered clinical studies using it as an outcome
0

Measured on ConductCognition

Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.

No pooled figure yet.

How the grades work

Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.

Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

Task design

The trial sequence as the test runs in ConductCognition.

Items
60 letter strings: 40 English words, 10 in each of four frequency bands by Zipf value in English film and television subtitles (3.5 to 4.2, 3.0 to 3.5, 2.5 to 3.0 and 1.8 to 2.5), and 20 made-up words.
Words
4 to 12 letters, rated familiar by native readers in the Glasgow Norms, and spelled like no common word in German, Spanish, French, Italian or Portuguese.
Made-up words
Made by our code from other familiar words by changing one letter, or two in words of six letters or more, and checked against English dictionaries and word lists so that none is a word or sounds like a common one. Their lengths follow the words' lengths band by band.
Answer
A Yes and a No button under each string, with no time limit. The instructions say to answer No when unsure, as LexTALE's do.
Order
One fixed order for everyone, with no more than five words or five made-up words in a row.
Practice
3 items, a word, a made-up word and a word, with feedback for 2,000 ms.
Score
The mean of the percentage of words answered Yes and the percentage of made-up words answered No, LexTALE's averaged score, so Yes to everything scores 50. Both percentages and the words known in each band are reported too.

The items are this library's own; LexTALE's items are not used. The words are English in every session and the instructions follow the session's language. The scores support research and make no proficiency-level claim.

Quality checks

Each session is marked valid, needs review or invalid, with the reason, before you see its scores.

Scored rows: yes_no_vocabulary_test from the scored run, a yes or no for each of 60 strings with no time limit, 40 of them English words and 20 made up. Accuracy over all items is not judged against chance, because two thirds of the items are words; the averaged score already puts Yes to everything at 50. Made-up words answered Yes significantly more often than words (one-sided Fisher exact test, p < .05) invalidate, and words not answered Yes more often than made-up words beyond chance are flagged. Yes on 90% of at least 12 answers invalidates and No on every one is flagged. Answers under 200 ms on at least half of 4 or more items invalidate. Fewer than half the items answered invalidates and any other unanswered item is flagged. A hidden tab withholds the percentile.

Why these rules

Two thirds of the items are words, so answering Yes to everything gets most items right; words against made-up words separate knowing the words from a tendency to say Yes: Responses concentrated on trials that needed none (one-sided Fisher exact test, p < .05) mean the instructions were reversed and invalidate; responses that do not separate the two trial types are flagged. Yes for nearly every item means the made-up words were accepted as words, which a careful reader does not do, while No for every item can come from a person who knows few English words, so it is only flagged. An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. Another tab can be used to look up a word, so a percentile is withheld after a hidden tab.

Running this test

Settings you can change

This test runs with fixed settings.

How test settings work

Need a different version of this test?

Devices and languages

  • Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
  • Instructions and screens: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. Words and sentences: English.
  • Available on: Every plan, including the free plan.
  • Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.

Cite and describe

Methods text, with the standard settings

Participants completed the Yes-No Vocabulary Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Meara & Buxton, 1987; Lemhöfer & Broersma, 2012). The main score was averaged percent correct (the mean of the percentage of words answered Yes and the percentage of made-up words answered No, as in LexTALE; Yes to everything scores 50).

ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.

  • Lemhöfer, K., & Broersma, M. (2012). Introducing LexTALE: A quick and valid Lexical Test for Advanced Learners of English. Behavior Research Methods, 44(2), 325-343. https://doi.org/10.3758/s13428-011-0146-0The method: 40 words and 20 made-up words, no time limit, No when in doubt, and a score averaged over words and made-up words.
  • Meara, P., & Buxton, B. (1987). An alternative to multiple choice vocabulary tests. Language Testing, 4(2), 142-154. https://doi.org/10.1177/026553228700400202The yes/no vocabulary format, with made-up words as a check on guessing.
  • van Heuven, W. J. B., Mandera, P., Keuleers, E., & Brysbaert, M. (2014). SUBTLEX-UK: A new and improved word frequency database for British English. Quarterly Journal of Experimental Psychology, 67(6), 1176-1190. https://doi.org/10.1080/17470218.2013.850521The Zipf scale of word frequency that sets the four bands.
  • Scott, G. G., Keitel, A., Becirspahic, M., Yao, B., & Sereno, S. C. (2019). The Glasgow Norms: Ratings of 5,500 words on nine scales. Behavior Research Methods, 51(3), 1258-1270. https://doi.org/10.3758/s13428-018-1099-3The familiarity ratings that keep every word one native readers know.

Source papers

  • Lemhöfer K, Broersma M (2012). Introducing LexTALE: A quick and valid Lexical Test for Advanced Learners of English. Behavior Research Methods, 44(2):325-343.Paradigm source, Adults
  • Meara P, Buxton B (1987). An alternative to multiple choice vocabulary tests. Language Testing, 4(2):142-154.Paradigm source, Adults

Questions

How long does the Yes-No Vocabulary Task take?

About 3 to 5 minutes, as listed in the test library.

What device does a participant need?

Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.

What scores does it produce?

Averaged Percent Correct, Words Known, Made-Up Words Rejected, Words Known, Band 1, Words Known, Band 2, Words Known, Band 3, Words Known, Band 4, Median Answer Time, Answers Under 100 ms, Items Answered and Planned Items. Each session is also marked valid, needs review or invalid, with the reason.

How widely is the Yes-No Vocabulary Task used in research?

73 papers from 2021 to 2025 name it in their title or abstract, up 356% compared with 2016 to 2020. That ranks it 354 of 711 test families in the ConductCognition test census (use grade D). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

How much reliability evidence does the Yes-No Vocabulary Task have?

In the published research, 1 paper reports its test-retest reliability and 0 registered clinical studies use it as an outcome (evidence grade D in the ConductCognition test census).

Which languages can participants use?

The instructions and screens are in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. The words and sentences stay in English, so sessions in other languages are flagged for review. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.

Is this a clinical test?

No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.

Every test: the full test list.

New tests and features, about once a month. Unsubscribe at any time.

Run this test in your next study

Start free with 10 free participants on any test, then use participant credits or a yearly plan.

Start free

Related tests

Vocabulary TestLexical Decision TaskSpelling Choice Task
ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Big Five personality test
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • ConductScience Fellows
© 2026 ConductScience, Inc. Research use only.