ConductCognition
  • Domains

    Tests

    • Processing speed55
    • Attention142
    • Working memory51
    • Executive function186
    • Episodic memory81
    • Response inhibition10
    • Social cognition96
    • Language49

    Most used

    Evidence

    1. Verbal Fluency TestGradeA
    2. Stroop Color-Word TestGradeA
    3. Trail Making TestGradeA
    4. N-Back TaskGradeA
    5. Go/No-Go TaskGradeA
    6. Digit Span TestGradeA
    7. Symbol Coding TestGradeA
    8. Verbal Learning TestGradeA
    REDTry it nowStroop Color-Word Test
    All 670 tests

    Browse by

    • Phone374
    • Tablet408
    • Untimed412
    • Up to 5 minutes80
    • Evidence grade A47
  • First studies

    Grade, length

    • Reaction Time StudyGradeA7 min
    • Pilot ScreeningGradeA15 min
    • Medication StudiesGradeA−26 min
    • Language-Minimized ScreeningGradeA−30 min

    Age groups

    • Older Adult Executive SpeedGradeA20 min
    • School-AgeGradeA−33 min

    Memory

    • At-Home MemoryGradeA26 min
    • Working Memory and LearningGradeA−19 min
    • Associative MemoryGradeB32 min
    • Working Memory CapacityGradeB34 min

    Language and perception

    • LanguageGradeA−33 min
    • Visual PerceptionGradeB27 min
    • Listening and Auditory ProcessingGradeB31 min

    Executive function and attention

    • Executive ControlGradeA18 min
    • Attention and ImpulsivityGradeA−26 min
    • Visual AttentionGradeB27 min
    • Creativity and Flexible ThinkingGradeB30 min
    • Reasoning and SpatialGradeB32 min

    Movement

    • Motor and AttentionGradeA−29 min
    • Motor LearningGradeB34 min

    Behavior, mood and choice

    • Food Choice and Self-ControlGradeA−29 min
    • Sleep and FatigueGradeB23 min
    • Social CognitionGradeB23 min
    • Impulsivity and Substance UseGradeB26 min
    • Emotion and MoodGradeB28 min
    • Decisions and RewardGradeB29 min
    All 26 batteries

    Find one

    Up to 15 minutes2Up to 30 minutes19Phone8
    Test order labBattery gradesHow batteries work
  • Use and evidence

    • Overview
    • Compare all 670 tests
    • Test-retest
    • Reliability and validity
    • Battery grades26
    • Download and cite

    Clinical trials

    • Overview
    • By condition25
    • By test103
    • Trial design benchmark
    • Cognitive outcomes, 2026

    Conditions

    Registered studies

    • Dementia and Alzheimer's1,673
    • Aging, frailty and exercise1,400
    • Depression and bipolar disorder1,249
    • Stroke1,237
    • Substance use and addiction904
    • Parkinson's disease894
    • Cancer762
    All 25 conditions
    16,526Registered studies name a cognitive test in an outcome measure11,841 name a test you can run hereExplore the studies
  • 1

    Build

    • Study design
    • Customize tests
    • Repeat visits
    • Study cost calculator
    2

    Recruit

    • Recruitment setup
    • Prolific
    • Sona Systems
    • CloudResearch Connect
    • Qualtrics
    3

    Run

    • Remote testing
    • Participant devices
    • Phone timing check
    • Offline edition
    4

    Results

    • Automated scoring
    • Test norms
    • Study Quality Monitor
    • Data export
    Platform overview

    Compliance

    • HIPAA-ready testing
    • US clinical research
    • Data Policy
    • Privacy Policy
    • Terms of Use
  • Research areas

    Tests used in each

    • Aging and dementia201
    • Decisions and reward134
    • Child development and education114
    • Social behavior86
    • Language and bilingualism77
    • Psychiatric groups35
    • Training and intervention31
    • Mood, anxiety and trauma27
    • Substance use and impulsivity26
    • Neurological and movement research21
    • Sleep and fatigue16
    • Brain injury and concussion14
    • ADHD11
    • Eating and obesity11
    • Medication and drug trials8

    Research settings

    • Student participant pools
    • Teaching a class
    • Clinical trials
    • US clinical research
    • Sites without internet
    Planning a study?
  • Methods

    • How evidence grades work
    • How test batteries work
    • How test order works
    Methods and questions

    Help

    • FAQ
    • Recruitment guides
    • Compare platforms

    Updates

    • Blog
    • New tests by email
    Latest post10 November 2026What you can do in ConductCognition todayA short tour of ConductCognition as it stands on 10 November. After this, we'll post when something changes how you run a study.Read the post
  • Pricing
Start Free
Log In
Log InStart Free
  1. Home
  2. /Tests
  3. /Grammaticality Judgment Task

Language

Grammaticality Judgment Task

Also called: GJT, acceptability judgment task, grammaticality judgement task

Measure sensitivity to grammatical errors with matched correct and incorrect English sentences in six error types.

4-6 minUntimed

Create a study with this test

Free to start: 10 free participants per account, then $0.99 per participant for academic research, or any yearly plan. Try it here first, with no account.

Papers, 2021 to 2025
1,140
Evidence grade
C
Registered clinical studies
4
How these are counted
The sun rises in the east.
My friends is coming to dinner.
F
J
Correct or errord-prime
Read each sentence and press a key: correct, or it has an error
  • Overview
  • Evidence
  • Task design
  • Quality checks
  • Settings
  • Cite
  • Questions

What it measures

Measures sensitivity to grammatical errors in English. Participants read 60 sentences one at a time and press one key when a sentence is correct and another when it has an error. Half the sentences have one error in agreement, tense, plural, word order, verb structure or pronoun case.

Constructs

  • Grammatical knowledge
  • Syntax and morphology
  • Language comprehension

Research uses

  • Second-language and bilingualism research
  • Language development and aphasia research
  • Within-study group comparison

How the paradigm works

The grammaticality judgment task measures how well people tell correct English sentences from sentences with a grammatical error. Participants read one sentence at a time and press one key if it is correct English and the other key if it has an error. Judgments like these are a standard measure of grammatical knowledge in second-language research (Johnson and Newport 1989) and aphasia research (Linebarger, Schwartz and Saffran 1983).

More about the paradigm

The 60 sentence frames were written for this task; no published sentence set is used. Each frame has a correct version and a version with one error, in six error types: subject-verb agreement, verb tense or form, noun plural, word order, verb argument structure and pronoun case. Two lists, drawn from the session's random seed, show every participant each frame once: 30 correct sentences and 30 with an error, 5 and 5 of each type, in a seeded order with no more than 3 correct or 3 incorrect sentences in a row. Which key means correct is also drawn from the seed and recorded. Sentences stay on screen until a key press, with no time limit, after 4 practice sentences with feedback. The sentences are English.

The main score is d-prime: how well judgments separate correct sentences from sentences with an error, from signal detection theory with the log-linear correction, so 0 is chance. The response criterion c, accuracy, hit and false-alarm rates, accuracy for each error type and the median time of correct judgments are also reported. Scores support research and do not diagnose.

Scores

d-Primed'
Z(hit rate) minus Z(false-alarm rate), log-linear corrected, where a hit is an incorrect sentence judged to have an error.
Higher is better; 0 is chance
Criterion cz
Minus the mean of the two z scores.
Positive values mean a tendency to accept sentences as correct
Accuracy%
Share of sentences judged correctly.
Higher is better
Hit Rate%
Share of sentences with an error that were judged to have one.
Higher is better
False-Alarm Rate%
Share of correct sentences judged to have an error.
Lower is better
Accuracy, Agreement%
Share of subject-verb agreement sentences judged correctly, both versions.
Higher is better
Accuracy, Tense%
Share of verb tense or form sentences judged correctly, both versions.
Higher is better
Accuracy, Plural%
Share of noun plural sentences judged correctly, both versions.
Higher is better
Accuracy, Word Order%
Share of word order sentences judged correctly, both versions.
Higher is better
Accuracy, Argument Structure%
Share of verb argument structure sentences judged correctly, both versions.
Higher is better
Accuracy, Pronoun Case%
Share of pronoun case sentences judged correctly, both versions.
Higher is better
Median Correct Timems
Median time of correct judgments; answers under 100 ms are left out.
Lower is faster

Use and evidence

1,140 papers from 2021 to 2025 name this task in their title or abstract, up 4% compared with 2016 to 2020. That ranks it 22 of 711 test families in our census. See the counts for every test.

2021 to 2025, the years gradedEarlier years
Papers per year naming the Grammaticality Judgment Task, 2000 to 2025Bar chart. 2021: 238; 2022: 203; 2023: 212; 2024: 245; 2025: 242 papers. Peak year 2024.01002003002000: 35 papers2001: 24 papers2002: 35 papers2003: 50 papers2004: 52 papers2005: 49 papers2006: 77 papers2007: 80 papers2008: 89 papers2009: 90 papers2010: 133 papers2011: 127 papers2012: 161 papers2013: 164 papers2014: 158 papers2015: 192 papers2016: 224 papers2017: 203 papers2018: 212 papers2019: 221 papers2020: 241 papers2021: 238 papers2022: 203 papers2023: 212 papers2024: 245 papers2025: 242 papers200020052010201520202025
Papers per year naming the Grammaticality Judgment Task, 2000 to 2025Bar chart. 2021: 238; 2022: 203; 2023: 212; 2024: 245; 2025: 242 papers. Peak year 2024.01002003002000: 35 papers2001: 24 papers2002: 35 papers2003: 50 papers2004: 52 papers2005: 49 papers2006: 77 papers2007: 80 papers2008: 89 papers2009: 90 papers2010: 133 papers2011: 127 papers2012: 161 papers2013: 164 papers2014: 158 papers2015: 192 papers2016: 224 papers2017: 203 papers2018: 212 papers2019: 221 papers2020: 241 papers2021: 238 papers2022: 203 papers2023: 212 papers2024: 245 papers2025: 242 papers200020052010201520202025
Papers per year whose title or abstract names this task (OpenAlex).
Show the numbers
YearPapers
2025242
2024245
2023212
2022203
2021238
2020241
2019221
2018212
2017203
2016224
2015192
2014158
2013164
2012161
2011127
2010133
200990
200889
200780
200677
200549
200452
200350
200235
200124
200035
A

Use grade A

1,000 or more papers from 2021 to 2025.

C

Evidence grade C

At least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies.

Papers on test-retest reliability
4
Papers on reliability or validity
166
Registered clinical studies using it as an outcome
4

Measured on ConductCognition

Pooled across the studies that feed our platform norms, by device group. A figure needs 50 or more people.

No pooled figure yet.

How the grades work

Use: A is 1,000 or more papers from 2021 to 2025, B 300 to 999, C 100 to 299, D 30 to 99 and E fewer than 30. Evidence: A means at least 25 papers report its test-retest reliability and at least 25 registered clinical studies use it as an outcome; B, at least 8 test-retest papers, and either 5 registered clinical studies or 150 reliability or validity papers; C, at least 2 test-retest papers, 30 reliability or validity papers or 3 registered clinical studies; D, little published measurement evidence found. The counts measure use. They include every paper that names the task in its title or abstract. Grades describe the published research on this task, not ConductCognition's version of it.

Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

Task design

The trial sequence as the test runs in ConductCognition.

Sentences
60 sentence frames, each written correct and with one error, in six error types of 10: subject-verb agreement, verb tense or form, noun plural, word order, verb argument structure and pronoun case.
Lists
Two lists drawn from the session's seed show each frame once: 30 correct sentences and 30 with an error, 5 and 5 of each type.
Order
Drawn from the session's seed, with no more than 3 correct or 3 incorrect sentences in a row and no two of the same error type in a row.
Keys
F and J; which key means correct is drawn from the session's seed and saved.
Time
Each sentence stays until a key press, with no time limit, and a 500 ms blank screen comes between sentences.
Practice
4 sentences with feedback for 1,500 ms.
Score
d-prime with the log-linear correction, treating a sentence with an error as the signal.

The sentences were written for this task; no published sentence set is used. The sentences are English.

Quality checks

Each session is marked valid, needs review or invalid, with the reason, before you see its scores.

Scored rows: grammaticality_judgment_test from the scored run, one key press per sentence. Accuracy significantly below chance (one in two) invalidates and accuracy not above chance is flagged. Judgments under 200 ms on at least half of the sentences invalidate. The same key on 90% of at least 12 judgments, with accuracy not above chance, invalidates. A session run in another language is flagged. A hidden tab is flagged.

Why these rules

Accuracy significantly below chance (one-sided exact test, p < .05) cannot come from guessing; it means the response mapping was reversed or the task was not followed (Slick, Sherman and Iverson 1999 treat below-chance forced-choice performance as definite response bias). Chance-level accuracy can be a real result in impaired participants, so it is only flagged. One option on at least 90% of answered trials, when the correct options are balanced and accuracy is not above chance, means the answers did not depend on the items (the task counterpart of long-string responding in surveys; Curran 2016). Half the sentences are correct and half have an error, so a key pressed for nearly every sentence cannot follow the sentences. An answer under 200 ms is faster than a simple visual reaction, so it cannot reflect the item. Following response-time effort screening for untimed tests (Wise and Kong 2005), the session is invalid only when at least half the answers are that fast. The word lists are English. A session run in another language shows English words to a participant who may not read English fluently, so it is flagged for review. Sentences stay on screen until a key press, so a hidden tab does not change what was shown; it is flagged.

Running this test

Settings you can change

SettingStandardAllowed
Sentences per error type106 to 10

Yearly plans can change settings within these limits. Free and pay-as-you-go studies use the standard settings.

How test settings work

Need a setting this test does not have?

Devices and languages

  • Untimed test: runs on desktops, laptops, tablets and phones. Participant devices
  • Instructions and screens: English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. Words and sentences: English.
  • Available on: Every plan, including the free plan.
  • Recruiting online? See the setup guides for Prolific, Sona Systems, CloudResearch Connect and Qualtrics.

Cite and describe

Methods text, with the standard settings

Participants completed the Grammaticality Judgment Task in a web browser (ConductCognition task version 1.0.0, scoring version 1.0.0; Johnson & Newport, 1989), with the standard settings (sentences per error type: 10). The main score was d-prime (Z(hit rate) minus Z(false-alarm rate), log-linear corrected, where a hit is an incorrect sentence judged to have an error).

ConductCognition versions: task version 1.0.0, scoring version 1.0.0. Every export records the versions each session used, for a methods section.

  • Johnson, J. S., & Newport, E. L. (1989). Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21(1), 60-99. https://doi.org/10.1016/0010-0285(89)90003-0
  • Linebarger, M. C., Schwartz, M. F., & Saffran, E. M. (1983). Sensitivity to grammatical structure in so-called agrammatic aphasics. Cognition, 13(3), 361-392. https://doi.org/10.1016/0010-0277(83)90015-X

Source papers

  • Johnson JS, Newport EL (1989). Critical period effects in second language learning: the influence of maturational state on the acquisition of English as a second language. Cognitive Psychology, 21(1):60-99.Paradigm source, Adults
  • Linebarger MC, Schwartz MF, Saffran EM (1983). Sensitivity to grammatical structure in so-called agrammatic aphasics. Cognition, 13(3):361-392.Paradigm source, Adults

Questions

How long does the Grammaticality Judgment Task take?

About 4 to 6 minutes, as listed in the test library.

What device does a participant need?

Untimed test: runs on desktops, laptops, tablets and phones. The browser must be Chrome, Edge, Firefox or Safari.

What scores does it produce?

d-Prime, Criterion c, Accuracy, Hit Rate, False-Alarm Rate, Accuracy, Agreement, Accuracy, Tense, Accuracy, Plural, Accuracy, Word Order, Accuracy, Argument Structure, Accuracy, Pronoun Case and Median Correct Time. Each session is also marked valid, needs review or invalid, with the reason.

How widely is the Grammaticality Judgment Task used in research?

1,140 papers from 2021 to 2025 name it in their title or abstract, up 4% compared with 2016 to 2020. That ranks it 22 of 711 test families in the ConductCognition test census (use grade A). Source: ConductCognition test census 0.58.0, counted 31 October 2026 from OpenAlex and ClinicalTrials.gov.

How much reliability evidence does the Grammaticality Judgment Task have?

In the published research, 4 papers report its test-retest reliability and 4 registered clinical studies use it as an outcome (evidence grade C in the ConductCognition test census).

Which settings can a researcher change?

Sentences per error type (6 to 10). Settings can be changed on yearly plans; free and pay-as-you-go studies use the standard settings.

Which languages can participants use?

The instructions and screens are in English, Spanish, French, German, Italian, Portuguese (Brazil), Chinese (Simplified) and Japanese. The words and sentences stay in English, so sessions in other languages are flagged for review. English is on every plan, and the other languages come with yearly plans. Have a native speaker read the machine-translated text before launch.

Is this a clinical test?

No. ConductCognition is for research use only. It runs, scores and exports the test; clinical interpretation is outside the platform.

Every test: the full test list.

New tests and features, about once a month. Unsubscribe at any time.

Run this test in your next study

Start free with 10 free participants on any test, then use participant credits or a yearly plan.

Start free

Related tests

Vocabulary TestSelf-Paced Reading TaskLexical Decision Task
ConductCognition

Hosted browser-native cognitive testing for academic and commercial research workflows.

A product of ConductScience, Inc.

Tests

  • All cognitive tests
  • Test batteries
  • Use and evidence
  • Test norms
  • Trail Making Test
  • N-Back Task
  • Big Five personality test
  • Automated scoring
  • Study design
  • New tests by email

Guides

  • Methods and questions
  • Blog
  • Recruitment setup
  • Participant devices
  • Prolific
  • Sona Systems
  • CloudResearch Connect
  • Qualtrics

Use cases

  • Student participant pools
  • Aging and dementia research
  • Clinical trials
  • US clinical research
  • Remote testing

Compare and buy

  • Pricing
  • Compare platforms
  • Offline edition
  • FAQ

Trust

  • Study Quality Monitor
  • HIPAA-ready testing
  • Data export
  • Privacy Policy
  • Terms of Use
  • Data Policy

Company

  • ConductScience
  • ConductScience Fellows
© 2026 ConductScience, Inc. Research use only.