RT Journal Article
T1 A Methodology to Measure the Diachronic Language Distance between Three Languages Based on Perplexity
A1 Pichel Campos, José Ramom
A1 Gamallo Otero, Pablo
A1 Alegría, Iñaki
A1 Neves, Marco
AB The aim of this paper is to apply a corpus-based methodology, based on the measure of perplexity, to automatically calculate the cross-lingual language distance between historical periods of three languages. The three historical corpora have been constructed and collected with the closest spelling to the original on a balanced basis of fiction and non-fiction. This methodology has been applied to measure the historical distance of Galician with respect to Portuguese and Spanish, from the Middle Ages to the end of the 20th century, both in original spelling and automatically transcribed spelling. The quantitative results are contrasted with hypotheses extracted from experts in historical linguistics. Results show that Galician and Portuguese are varieties of the same language in the Middle Ages and that Galician converges and diverges with Portuguese and Spanish since the last period of the 19th century. In this process, orthography plays a relevant role. It should be pointed out that the method is unsupervised and can be applied to other languages
PB Taylor & Francis
SN 0929-6174
YR 2020
FD 2020
LK http://hdl.handle.net/10347/24655
UL http://hdl.handle.net/10347/24655
LA eng
NO José Ramom Pichel, Pablo Gamallo, Iñaki Alegria & Marco Neves (2020) A Methodology to Measure the Diachronic Language Distance between Three Languages Based on Perplexity, Journal of Quantitative Linguistics, DOI: 10.1080/09296174.2020.1732177
NO This is an Accepted Manuscript of an article published by Taylor & Francis in Journal of Quantitative Linguistics on 01 Mar 2020, available online: http://www.tandfonline.com/10.1080/09296174.2020.1732177
NO This work has received financial support from DOMINO project [PGC2018-102041-B-I00, MCIU/AEI/FEDER, UE]; eRisk project [RTI2018-093336-B-C21]; the Consellería de Cultura, Educación e Ordenación Universitaria (accreditation 2016-2019, ED431G/08, Consolidation and structuring of Groups with Growth Potential: 745ED431B 2017/39) and the European Regional Development Fund (ERDF)
DS Minerva
RD 28 abr 2026