|
Activity Number:
|
74
- Text Analysis in Machine Learning and Statistical Models
|
|
Type:
|
Contributed
|
|
Date/Time:
|
Monday, August 3, 2020 : 10:00 AM to 2:00 PM
|
|
Sponsor:
|
International Statistical Institute
|
|
Abstract #312622
|
|
|
Title:
|
Zero-Inflated Beta Distribution Applied to Word Frequency and Lexical Dispersion in Corpus Linguistics
|
|
Author(s):
|
Brent Burch* and Jesse Egbert
|
|
Companies:
|
Northern Arizona University and Northern Arizona University
|
|
Keywords:
|
British National Corpus;
Mixture distribution;
Ranking words
|
|
Abstract:
|
Corpus linguistics is the study of language as expressed in a body of texts or documents. The relative frequency of a word within a text and the dispersion of the word across the collection of texts provide information about the word's prominence and diffusion, respectively. The zero-inflated beta distribution enables one to model the relative frequency of a word in a text since some texts may not even contain the word under study. In this presentation, the expectation of a word's prominence and dispersion are defined under the zero-inflated beta model. Estimates of a word's prominence and dispersion are computed for words in the British National Corpus, a 100 million word collection of written and spoken language of a wide range of British English.
|
Authors who are presenting talks have a * after their name.
