Suzanne Stevenson


2024

pdf bib
Style-Shifting Behaviour of the Manosphere on Reddit
Jai Aggarwal | Suzanne Stevenson
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

Hate speech groups (HSGs) may negatively influence online platforms through their distinctive language, which may affect the tone and topics of other spaces if spread beyond the HSGs. We explore the linguistic style of the Manosphere, a misogynistic HSG, on Reddit. We find that Manospheric authors have a distinct linguistic style using not only uncivil language, but a greater focus on gendered topics, which are retained when posting in other communities. Thus, potentially harmful aspects of Manospheric style carry over into posts on non-Manospheric subreddits, motivating future work to explore how this stylistic spillover may negatively influence community health.

2023

pdf bib
What social attitudes about gender does BERT encode? Leveraging insights from psycholinguistics
Julia Watson | Barend Beekhuizen | Suzanne Stevenson
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)

Much research has sought to evaluate the degree to which large language models reflect social biases. We complement such work with an approach to elucidating the connections between language model predictions and people’s social attitudes. We show how word preferences in a large language model reflect social attitudes about gender, using two datasets from human experiments that found differences in gendered or gender neutral word choices by participants with differing views on gender (progressive, moderate, or conservative). We find that the language model BERT takes into account factors that shape human lexical choice of such language, but may not weigh those factors in the same way people do. Moreover, we show that BERT’s predictions most resemble responses from participants with moderate to conservative views on gender. Such findings illuminate how a language model: (1) may differ from people in how it deploys words that signal gender, and (2) may prioritize some social attitudes over others.

pdf bib
Investigating Online Community Engagement through Stancetaking
Jai Aggarwal | Brian Diep | Julia Watson | Suzanne Stevenson
Findings of the Association for Computational Linguistics: EMNLP 2023

Much work has explored lexical and semantic variation in online communities, and drawn connections to community identity and user engagement patterns. Communities also express identity through the sociolinguistic concept of stancetaking. Large-scale computational work on stancetaking has explored community similarities in their preferences for stance markers – words that serve to indicate aspects of a speaker’s stance – without considering the stance-relevant properties of the contexts in which stance markers are used. We propose representations of stance contexts for 1798 Reddit communities and show how they capture community identity patterns distinct from textual or marker similarity measures. We also relate our stance context representations to broader inter- and intra-community engagement patterns, including cross-community posting patterns and social network properties of communities. Our findings highlight the strengths of using rich properties of stance as a way of revealing community identity and engagement patterns in online multi-community spaces.

2021

pdf bib
Quantifying Cognitive Factors in Lexical Decline
David Francis | Ella Rabinovich | Farhan Samir | David Mortensen | Suzanne Stevenson
Transactions of the Association for Computational Linguistics, Volume 9

We adopt an evolutionary view on language change in which cognitive factors (in addition to social ones) affect the fitness of words and their success in the linguistic ecosystem. Specifically, we propose a variety of psycholinguistic factors—semantic, distributional, and phonological—that we hypothesize are predictive of lexical decline, in which words greatly decrease in frequency over time. Using historical data across three languages (English, French, and German), we find that most of our proposed factors show a significant difference in the expected direction between each curated set of declining words and their matched stable words. Moreover, logistic regression analyses show that semantic and distributional factors are significant in predicting declining words. Further diachronic analysis reveals that declining words tend to decrease in the diversity of their lexical contexts over time, gradually narrowing their ‘ecological niches’.

pdf bib
A Formidable Ability: Detecting Adjectival Extremeness with DSMs
Farhan Samir | Barend Beekhuizen | Suzanne Stevenson
Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021

2020

pdf bib
Pick a Fight or Bite your Tongue: Investigation of Gender Differences in Idiomatic Language Usage
Ella Rabinovich | Hila Gonen | Suzanne Stevenson
Proceedings of the 28th International Conference on Computational Linguistics

A large body of research on gender-linked language has established foundations regarding cross-gender differences in lexical, emotional, and topical preferences, along with their sociological underpinnings. We compile a novel, large and diverse corpus of spontaneous linguistic productions annotated with speakers’ gender, and perform a first large-scale empirical study of distinctions in the usage of figurative language between male and female authors. Our analyses suggest that (1) idiomatic choices reflect gender-specific lexical and semantic preferences in general language, (2) men’s and women’s idiomatic usages express higher emotion than their literal language, with detectable, albeit more subtle, differences between male and female authors along the dimension of dominance compared to similar distinctions in their literal utterances, and (3) contextual analysis of idiomatic expressions reveals considerable differences, reflecting subtle divergences in usage environments, shaped by cross-gender communication styles and semantic biases.

pdf bib
Exploration of Gender Differences in COVID-19 Discourse on Reddit
Jai Aggarwal | Ella Rabinovich | Suzanne Stevenson
Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020

Decades of research on differences in the language of men and women have established postulates about the nature of lexical, topical, and emotional preferences between the two genders, along with their sociological underpinnings. Using a novel dataset of male and female linguistic productions collected from the Reddit discussion platform, we further confirm existing assumptions about gender-linked affective distinctions, and demonstrate that these distinctions are amplified in social media postings involving emotionally-charged discourse related to COVID-19. Our analysis also confirms considerable differences in topical preferences between male and female authors in pandemic-related discussions.

2019

pdf bib
Say Anything: Automatic Semantic Infelicity Detection in L2 English Indefinite Pronouns
Ella Rabinovich | Julia Watson | Barend Beekhuizen | Suzanne Stevenson
Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)

Computational research on error detection in second language speakers has mainly addressed clear grammatical anomalies typical to learners at the beginner-to-intermediate level. We focus instead on acquisition of subtle semantic nuances of English indefinite pronouns by non-native speakers at varying levels of proficiency. We first lay out theoretical, linguistically motivated hypotheses, and supporting empirical evidence, on the nature of the challenges posed by indefinite pronouns to English learners. We then suggest and evaluate an automatic approach for detection of atypical usage patterns, demonstrating that deep learning architectures are promising for this task involving nuanced semantic anomalies.

pdf bib
CodeSwitch-Reddit: Exploration of Written Multilingual Discourse in Online Discussion Forums
Ella Rabinovich | Masih Sultani | Suzanne Stevenson
Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)

In contrast to many decades of research on oral code-switching, the study of written multilingual productions has only recently enjoyed a surge of interest. Many open questions remain regarding the sociolinguistic underpinnings of written code-switching, and progress has been limited by a lack of suitable resources. We introduce a novel, large, and diverse dataset of written code-switched productions, curated from topical threads of multiple bilingual communities on the Reddit discussion platform, and explore questions that were mainly addressed in the context of spoken language thus far. We investigate whether findings in oral code-switching concerning content and style, as well as speaker proficiency, are carried over into written code-switching in discussion forums. The released dataset can further facilitate a range of research and practical activities.

pdf bib
CodeSwitch-Reddit: Exploration of Written Multilingual Discourse in Online Discussion Forums
Ella Rabinovich | Masih Sultani | Suzanne Stevenson
Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019)

In contrast to many decades of research on oral code-switching, the study of written multilingual productions has only recently enjoyed a surge of interest. Many open questions remain regarding the sociolinguistic underpinnings of written code-switching, and progress has been limited by a lack of suitable resources. We introduce a novel, large, and diverse dataset of written code-switched productions, curated from topical threads of multiple bilingual communities on the Reddit discussion platform, and explore questions that were mainly addressed in the context of spoken language thus far. We investigate whether findings in oral code-switching concerning content and style, as well as speaker proficiency, are carried over into written code-switching in discussion forums. The released dataset can further facilitate a range of research and practical activities.

2018

pdf bib
Predicting and Explaining Human Semantic Search in a Cognitive Model
Filip Miscevic | Aida Nematzadeh | Suzanne Stevenson
Proceedings of the 8th Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2018)

pdf bib
Modeling bilingual word associations as connected monolingual networks
Yevgen Matusevych | Amir Ardalan Kalantari Dehaghi | Suzanne Stevenson
Proceedings of the 8th Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2018)

2016

pdf bib
Comparing Computational Cognitive Models of Generalization in a Language Acquisition Task
Libby Barak | Adele E. Goldberg | Suzanne Stevenson
Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing

2015

pdf bib
A Computational Cognitive Model of Novel Word Generalization
Aida Nematzadeh | Erin Grant | Suzanne Stevenson
Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing

pdf bib
Perceptual, conceptual, and frequency effects on error patterns in English color term acquisition
Barend Beekhuizen | Suzanne Stevenson
Proceedings of the Sixth Workshop on Cognitive Aspects of Computational Language Learning

2014

pdf bib
Learning Verb Classes in an Incremental Model
Libby Barak | Afsaneh Fazly | Suzanne Stevenson
Proceedings of the Fifth Workshop on Cognitive Modeling and Computational Linguistics

pdf bib
A Usage-Based Model of Early Grammatical Development
Barend Beekhuizen | Rens Bod | Afsaneh Fazly | Suzanne Stevenson | Arie Verhagen
Proceedings of the Fifth Workshop on Cognitive Modeling and Computational Linguistics

pdf bib
A Cognitive Model of Semantic Network Learning
Aida Nematzadeh | Afsaneh Fazly | Suzanne Stevenson
Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)

2013

pdf bib
Acquisition of Desires before Beliefs: A Computional Investigation
Libby Barak | Afsaneh Fazly | Suzanne Stevenson
Proceedings of the Seventeenth Conference on Computational Natural Language Learning

2012

pdf bib
Modeling the Acquisition of Mental State Verbs
Libby Barak | Afsaneh Fazly | Suzanne Stevenson
Proceedings of the 3rd Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2012)

pdf bib
A Computational Model of Memory, Attention, and Word Learning
Aida Nematzadeh | Afsaneh Fazly | Suzanne Stevenson
Proceedings of the 3rd Workshop on Cognitive Modeling and Computational Linguistics (CMCL 2012)

pdf bib
Unsupervised Disambiguation of Image Captions
Wesley May | Sanja Fidler | Afsaneh Fazly | Sven Dickinson | Suzanne Stevenson
*SEM 2012: The First Joint Conference on Lexical and Computational Semantics – Volume 1: Proceedings of the main conference and the shared task, and Volume 2: Proceedings of the Sixth International Workshop on Semantic Evaluation (SemEval 2012)

2011

pdf bib
Incorporating Coercive Constructions into a Verb Lexicon
Claire Bonial | Susan Windisch Brown | Jena D. Hwang | Christopher Parisien | Martha Palmer | Suzanne Stevenson
Proceedings of the ACL 2011 Workshop on Relational Models of Semantics

2010

pdf bib
No Sentence Is Too Confusing To Ignore
Paul Cook | Suzanne Stevenson
Proceedings of the 2010 Workshop on NLP and Linguistics: Finding the Common Ground

pdf bib
A Graph-Theoretic Framework for Semantic Distance
Vivian Tsang | Suzanne Stevenson
Computational Linguistics, Volume 36, Number 1, March 2010

pdf bib
Automatically Identifying the Source Words of Lexical Blends in English
Paul Cook | Suzanne Stevenson
Computational Linguistics, Volume 36, Number 1, March 2010

pdf bib
Automatically Identifying Changes in the Semantic Orientation of Words
Paul Cook | Suzanne Stevenson
Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)

The meanings of words are not fixed but in fact undergo change, with new word senses arising and established senses taking on new aspects of meaning or falling out of usage. Two types of semantic change are amelioration and pejoration; in these processes a word sense changes to become more positive or negative, respectively. In this first computational study of amelioration and pejoration we adapt a web-based method for determining semantic orientation to the task of identifying ameliorations and pejorations in corpora from differing time periods. We evaluate our proposed method on a small dataset of known historical ameliorations and pejorations, and find it to perform better than a random baseline. Since this test dataset is small, we conduct a further evaluation on artificial examples of amelioration and pejoration, and again find evidence that our proposed method is able to identify changes in semantic orientation. Finally, we conduct a preliminary evaluation in which we apply our methods to the task of finding words which have recently undergone amelioration or pejoration.

2009

pdf bib
Unsupervised Type and Token Identification of Idiomatic Expressions
Afsaneh Fazly | Paul Cook | Suzanne Stevenson
Computational Linguistics, Volume 35, Number 1, March 2009

pdf bib
Proceedings of the Thirteenth Conference on Computational Natural Language Learning (CoNLL-2009)
Suzanne Stevenson | Xavier Carreras
Proceedings of the Thirteenth Conference on Computational Natural Language Learning (CoNLL-2009)

pdf bib
An Unsupervised Model for Text Message Normalization
Paul Cook | Suzanne Stevenson
Proceedings of the Workshop on Computational Approaches to Linguistic Creativity

2008

pdf bib
Fast Mapping in Word Learning: What Probabilities Tell Us
Afra Alishahi | Afsaneh Fazly | Suzanne Stevenson
CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning

pdf bib
An Incremental Bayesian Model for Learning Syntactic Categories
Christopher Parisien | Afsaneh Fazly | Suzanne Stevenson
CoNLL 2008: Proceedings of the Twelfth Conference on Computational Natural Language Learning

pdf bib
Special Issue Introduction: Semantic Role Labeling: An Introduction to the Special Issue
Lluís Màrquez | Xavier Carreras | Kenneth C. Litkowski | Suzanne Stevenson
Computational Linguistics, Volume 34, Number 2, June 2008 - Special Issue on Semantic Role Labeling

2007

pdf bib
A Cognitive Model for the Representation and Acquisition of Verb Selectional Preferences
Afra Alishahi | Suzanne Stevenson
Proceedings of the Workshop on Cognitive Aspects of Computational Language Acquisition

pdf bib
Distinguishing Subtypes of Multiword Expressions Using Linguistically-Motivated Statistical Measures
Afsaneh Fazly | Suzanne Stevenson
Proceedings of the Workshop on A Broader Perspective on Multiword Expressions

pdf bib
Pulling their Weight: Exploiting Syntactic Forms for the Automatic Identification of Idiomatic Expressions in Context
Paul Cook | Afsaneh Fazly | Suzanne Stevenson
Proceedings of the Workshop on A Broader Perspective on Multiword Expressions

2006

pdf bib
Automatically Constructing a Lexicon of Verb Phrase Idiomatic Combinations
Afsaneh Fazly | Suzanne Stevenson
11th Conference of the European Chapter of the Association for Computational Linguistics

pdf bib
Proceedings of the Workshop on Multiword Expressions: Identifying and Exploiting Underlying Properties
Begoña Villada Moirón | Aline Villavicencio | Diana McCarthy | Stefan Evert | Suzanne Stevenson
Proceedings of the Workshop on Multiword Expressions: Identifying and Exploiting Underlying Properties

pdf bib
Classifying Particle Semantics in English Verb-Particle Constructions
Paul Cook | Suzanne Stevenson
Proceedings of the Workshop on Multiword Expressions: Identifying and Exploiting Underlying Properties

pdf bib
Context Comparison as a Minimum Cost Flow Problem
Vivian Tsang | Suzanne Stevenson
Proceedings of TextGraphs: the First Workshop on Graph Based Methods for Natural Language Processing

2005

pdf bib
The Acquisition and Use of Argument Structure Constructions: A Bayesian Model
Afra Alishahi | Suzanne Stevenson
Proceedings of the Workshop on Psychocomputational Models of Human Language Acquisition

pdf bib
Automatically Distinguishing Literal and Figurative Usages of Highly Polysemous Verbs
Afsaneh Fazly | Ryan North | Suzanne Stevenson
Proceedings of the ACL-SIGLEX Workshop on Deep Lexical Acquisition

pdf bib
Exploiting a Verb Lexicon in Automatic Semantic Role Labelling
Robert Swier | Suzanne Stevenson
Proceedings of Human Language Technology Conference and Conference on Empirical Methods in Natural Language Processing

pdf bib
Automatic Acquisition of Knowledge About Multiword Predicates
Afsaneh Fazly | Suzanne Stevenson
Proceedings of the 19th Pacific Asia Conference on Language, Information and Computation

2004

pdf bib
Statistical Measures of the Semi-Productivity of Light Verb Constructions
Suzanne Stevenson | Afsaneh Fazly | Ryan North
Proceedings of the Workshop on Multiword Expressions: Integrating Processing

pdf bib
Calculating Semantic Distance between Word Sense Probability Distributions
Vivian Tsang | Suzanne Stevenson
Proceedings of the Eighth Conference on Computational Natural Language Learning (CoNLL-2004) at HLT-NAACL 2004

pdf bib
Using Selectional Profile Distance to Detect Verb Alternations
Vivian Tsang | Suzanne Stevenson
Proceedings of the Computational Lexical Semantics Workshop at HLT-NAACL 2004

pdf bib
Unsupervised Semantic Role Labellin
Robert S. Swier | Suzanne Stevenson
Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing

2003

pdf bib
A General Feature Space for Automatic Verb Classification
Eric Joanis | Suzanne Stevenson
10th Conference of the European Chapter of the Association for Computational Linguistics

pdf bib
Semi-supervised Verb Class Discovery Using Noisy Features
Suzanne Stevenson | Eric Joanis
Proceedings of the Seventh Conference on Natural Language Learning at HLT-NAACL 2003

pdf bib
Towards a Framework for Learning Structured Shape Models from Text-Annotated Images
Sven Wachsmuth | Suzanne Stevenson | Sven Dickinson
Proceedings of the HLT-NAACL 2003 Workshop on Learning Word Meaning from Non-Linguistic Data

2002

pdf bib
Crosslinguistic Transfer in Automatic Verb Classification
Vivian Tsang | Suzanne Stevenson | Paola Merlo
COLING 2002: The 19th International Conference on Computational Linguistics

pdf bib
A Multilingual Paradigm for Automatic Verb Classification
Paola Merlo | Suzanne Stevenson | Vivian Tsang | Gianluca Allaria
Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics

2001

pdf bib
Automatic verb classification using multilingual resources
Vivian Tsang | Suzanne Stevenson
Proceedings of the ACL 2001 Workshop on Computational Natural Language Learning (ConLL)

pdf bib
Automatic Verb Classification Based on Statistical Distributions of Argument Structure
Paola Merlo | Suzanne Stevenson
Computational Linguistics, Volume 27, Number 3, September 2001

2000

pdf bib
Establishing the Upper Bound and Inter-judge Agreement of a Verb Classification Task
Paola Merlo | Suzanne Stevenson
Proceedings of the Second International Conference on Language Resources and Evaluation (LREC’00)

pdf bib
Automatic Lexical Acquisition Based on Statistical Distributions
Suzanne Stevenson | Paola Merlo
COLING 2000 Volume 2: The 18th International Conference on Computational Linguistics

1999

pdf bib
Supervised Learning of Lexical Semantic Verb Classes Using Frequency Distributions
Suzanne Stevenson | Paola Merlo | Natalia Kariaeva Rutgers
SIGLEX99: Standardizing Lexical Resources

pdf bib
Automatic Verb Classification Using Distributions of Grammatical Features
Suzanne Stevenson | Paola Merlo
Ninth Conference of the European Chapter of the Association for Computational Linguistics

1998

pdf bib
Book Reviews: The Architecture of the Language Faculty
Suzanne Stevenson
Computational Linguistics, Volume 24, Number 4, December 1998

pdf bib
What grammars tell us about corpora: the case of reduced relative clauses
Paola Merlo | Suzanne Stevenson
Sixth Workshop on Very Large Corpora

1993

pdf bib
A Competition-Based Explanation of Syntactic Attachment Preferences and Garden Path Phenomena
Suzanne Stevenson
31st Annual Meeting of the Association for Computational Linguistics