Investigating a neural language model’s replicability of psycholinguistic experiments: A case study of NPI licensing

Unsub Shin, Eunkyung Yi, Sanghoun Song

Research output: Contribution to journalArticlepeer-review

Abstract

The recent success of deep learning neural language models such as Bidirectional Encoder Representations from Transformers (BERT) has brought innovations to computational language research. The present study explores the possibility of using a language model in investigating human language processes, based on the case study of negative polarity items (NPIs). We first conducted an experiment with BERT to examine whether the model successfully captures the hierarchical structural relationship between an NPI and its licensor and whether it may lead to an error analogous to the grammatical illusion shown in the psycholinguistic experiment (Experiment 1). We also investigated whether the language model can capture the fine-grained semantic properties of NPI licensors and discriminate their subtle differences on the scale of licensing strengths (Experiment 2). The results of the two experiments suggest that overall, the neural language model is highly sensitive to both syntactic and semantic constraints in NPI processing. The model’s processing patterns and sensitivities are shown to be very close to humans, suggesting their role as a research tool or object in the study of language.

Original languageEnglish
Article number937656
JournalFrontiers in Psychology
Volume14
DOIs
StatePublished - 2023

Keywords

  • BERT
  • grammatical illusion
  • licensing strength
  • negative polarity items
  • neural language model
  • NPI licensing
  • psycholinguistics
  • scale of negativity

Fingerprint

Dive into the research topics of 'Investigating a neural language model’s replicability of psycholinguistic experiments: A case study of NPI licensing'. Together they form a unique fingerprint.

Cite this