Identifying Temporal Trends Based on Perplexity and Clustering: Are We Looking at Language Change?

Abstract

In this work we propose a data-driven methodology for identifying temporal trends in a corpus of medieval charters. We have used perplexities derived from RNNs as a distance measure between documents and then, performed clustering on those distances. We argue that perplexities calculated by such language models are representative of temporal trends. The clusters produced using the K-Means algorithm give an insight of the differences in language in different time periods at least partly due to language change. We suggest that the temporal distribution of the individual clusters might provide a more nuanced picture of temporal trends compared to discrete bins, thus providing better results when used in a classification task.
OriginalsprogEngelsk
TitelProceedings of the 1st International Workshop on Computational Approaches to Historical Language Change
ForlagAssociation for Computational Linguistics
Publikationsdato2019
Sider86-91
DOI
StatusUdgivet - 2019
BegivenhedComputational Approaches to Historical Language Change 2019: Workshop co-located with ACL 2019 - Florence, Italien
Varighed: 2 aug. 20192 aug. 2019
https://languagechange.org/events/2019-acl-lcworkshop/

Workshop

WorkshopComputational Approaches to Historical Language Change 2019
Land/OmrådeItalien
ByFlorence
Periode02/08/201902/08/2019
Internetadresse

Fingeraftryk

Dyk ned i forskningsemnerne om 'Identifying Temporal Trends Based on Perplexity and Clustering: Are We Looking at Language Change?'. Sammen danner de et unikt fingeraftryk.

Citationsformater