0
Entropy Rate Estimates for Natural Language—A New Extrapolation of Compressed Large-Scale Corpora
Ryosuke Takahira, Kumiko Tanaka-Ishii, Łukasz Dębowski, 2016. Entropy.
Estimates the entropy rate of natural language from very large corpora in six languages by extrapolating compression results to infinite text length. Their answer is that it stays above zero.
What it's used for here
The bioinformatics and signal survey lists it among sources on entropy-rate estimation.
Cited by on this site 1 record
1 methods surveys
SRCSignal processing
Cite it
Takahira, R., Tanaka-Ishii, K., & Dębowski, Ł. (2016). Entropy Rate Estimates for Natural Language—A New Extrapolation of Compressed Large-Scale Corpora. Entropy. https://doi.org/10.3390/e18100364
@article{takahira2016entropy,
author = {Takahira, Ryosuke and Tanaka-Ishii, Kumiko and Dębowski, Łukasz},
title = {Entropy Rate Estimates for Natural Language—A New Extrapolation of Compressed Large-Scale Corpora},
journal = {Entropy},
year = {2016},
doi = {10.3390/e18100364},
url = {https://doi.org/10.3390/e18100364}
}TY - JOUR TI - Entropy Rate Estimates for Natural Language—A New Extrapolation of Compressed Large-Scale Corpora AU - Takahira, Ryosuke AU - Tanaka-Ishii, Kumiko AU - Dębowski, Łukasz PY - 2016 JO - Entropy DO - 10.3390/e18100364 UR - https://doi.org/10.3390/e18100364 ER -
Takahira, Ryosuke et al.. “Entropy Rate Estimates for Natural Language—A New Extrapolation of Compressed Large-Scale Corpora.” Entropy (2016). https://doi.org/10.3390/e18100364.