ConceptsHeld-out test
Concept · method · in 7 mysteries
Held-out test
Checking a reading or model on data that was not used to build it.
A key, a model or a translation fitted to one part of the data can always be made to fit that part. The test is whether it works on text, folios or observations kept aside. The site's rule for claimed decipherments and cipher solutions is that they must read held-out material, and runs are marked by whether they did.
Where it comes up
Glozel: the inscribed tablets of the Fradin field
If the sequences behave like a language, Hitz's Celtic reading can be scored on held-out tablets.
Voynich Manuscript
One of the mechanical procedures proposed for the text - independent slot-grammar sampling, Timm-Schinner self-copying, Rugg's table and grille, a Naibbe-type affix-table cipher of Latin (plain or vowel-less), a…
Q: Does any reading survive held-out pages?Q: Which combination of fifteenth-century cipher practices, if any, reproduces a single section's statistics on its held-out pages?A published mechanical procedure produced itHeld-out context scaling (Kneser-Ney orders 1-8)Generator competition on a held-out fingerprint batteryTopic model (LDA) of pages, k by held-out perplexity and fixed k=10
Unread oracle bone characters
OBI-Bench finds the best of 23 large multimodal models deciphering at about the level of untrained people, and EVOBC's evolution-chain baseline scores 16.7 percent top-1 on held-out read graphs.
Q: Can computational methods produce readings of unread graphs that palaeographers accept?OBI-Bench finds the best of 23 large multimodal models deciphering at about the level of untrained people, and EVOBC's…A 2020 deep-learning system ranked the correct join in its top 10 for 98.39 percent of held-out fragment pairs, and…
Unread cuneiform: half a million tablets and the limits of Sumerian
Neural translation of Akkadian from five ORACC corpora reached BLEU 37.47 (transliteration) and 36.52 (cuneiform) on held-out sentences, against 23.51 and 27.09 for a translation-memory baseline.
Q: Can the broken tablets of Babylonian literature be reassembled by automated matching of fragments?Q: Can machines read the cuneiform tablets that no scholar has read?Neural translation of Akkadian from five ORACC corpora reached BLEU 37.47 (transliteration) and 36.52 (cuneiform) on…Both restoration studies (recurrent networks 2020, masked language models 2021) present their output as suggestions…No blind held-out test of a photograph-to-translation pipeline on unpublished tablets has been published, so the…
Methods that use it 7
Held-out context scaling (Kneser-Ney orders 1-8)
MTHVoynich Manuscript
Generator competition on a held-out fingerprint battery
MTHVoynich Manuscript
Topic model (LDA) of pages, k by held-out perplexity and fixed k=10
MTHVoynich Manuscript
MTH
Cite it
Mysteries Department. (2026). Held-out test [Concept CPT0DECW06RF522]. https://mysteriesdept.com/r/CPT0DECW06RF522
@misc{mysteriesdept_cpt0decw06rf522,
title = {Held-out test},
author = {{Mysteries Department}},
year = {2026},
note = {Concept, catalog key CPT0DECW06RF522},
url = {https://mysteriesdept.com/r/CPT0DECW06RF522}
}