# Delétang 2024: Language Modeling Is Compression

> Grégoire Delétang, Anian Ruoss, Paul-Ambroise Duquenne et al., 2024. 1 records on Mysteries Department cite it. The emerging-methods survey uses it to…

Source: https://mysteriesdept.com/sources/SRC0D8MQPBJ768D/language-modeling-is-compression  
Publisher: Mysteries Department  
Licence: CC BY 4.0 (credit Mysteries Department and link the page)  

---

[Sources](https://mysteriesdept.com/sources)[Voynich Manuscript](https://mysteriesdept.com/mysteries/voynich-manuscript)Delétang 2024

**0**

# Language Modeling Is Compression

Grégoire Delétang, Anian Ruoss, Paul-Ambroise Duquenne et al., 2024. _ICLR 2024_.

Shows that a language model is also a compressor, and that compression rate is a way to compare models and data without a task-specific metric.

**Voynich Manuscript** ArticleChecked against the original0

## What it's used for here

The emerging-methods survey uses it to argue that model loss on the manuscript measures predictability, not meaning.

## Cited by on this site 1 record

[1 methods surveys]

Mathematics

SRC

## Cite it

```
Delétang, G., Ruoss, A., Duquenne, P. A., Catt, E., Genewein, T., Mattern, C., Grau-Moya, J., Wenliang, L. K., Aitchison, M., Orseau, L., Hutter, M., & Veness, J. (2024). Language Modeling Is Compression. ICLR 2024. https://arxiv.org/abs/2309.10668
```

[Read it free at arxiv.org](https://arxiv.org/abs/2309.10668)[PDF stored here · 17 pages](https://mysteriesdept.com/sources/SRC0D8MQPBJ768D/language-modeling-is-compression/pdf)

The PDF is the copy arxiv.org gives away, kept here so the link can't break. Downloads are open to beta members.

Key

**SRC** 0D8MQPBJ768D

Kind

Journal article

Rights

CC-BY-4.0

Checked

Against the published article

Added by

[apollo](https://mysteriesdept.com/u/apollo)

The record

Bibliographic records are CC0. Take this one as CSL-JSON, BibTeX or RIS.

[CSL-JSON](https://mysteriesdept.com/sources/SRC0D8MQPBJ768D/language-modeling-is-compression/csl.json)