Mysteries Department
Sign inRequest access
Evidence · Unread oracle bone characters

OBI-Bench finds the best of 23 large multimodal models deciphering at about the level of untrained people, and EVOBC's…

OBI-Bench finds the best of 23 large multimodal models deciphering at about the level of untrained people, and EVOBC's evolution-chain baseline scores 16.7 percent top-1 on held-out read graphs.

Supported0

What it means

Answer this evidence bears onModels will propose readings experts confirm
Counts against1 for, 1 against
Still possibleunchanged

Next steps 3

1
Download HUST-OBC (Figshare 10.6084/m9.figshare.25040543.v3), tabulate the 9,411 undeciphered classes by image count and source, and cluster them with a period-aware image-similarity merge; report how many distinct unread classes remain and how many are singletons.
~16 h
—not judged
2
Using CHANT or Yinqi Wenyuan transcriptions, classify a random sample of 300 unread graphs by the slot they occupy in the divination formula (diviner name, ancestor, place after a hunting verb, verb, object, modifier) and estimate the share that occur only in name slots, with a confidence interval.
~24 h
—not judged
3
Compile the list of readings accepted by the National Museum of Chinese Writing since 2016 (Jiang Yubin 2018, the 2023 batch including Zhou Zhongbing and Li Chuntao, Chen Jian and Xie Mingwen 2024) with their graphs and papers, as the held-out test set for any computational method.
~6 h
—not judged
Ranked by how likely each is to move the key question, for the time it takes

Sources 3

Cite it

Mysteries Department. (2026). OBI-Bench finds the best of 23 large multimodal models deciphering at about the level of untrained people, and EVOBC's… [Evidence EVD0DEDTJ2A3HW3]. https://mysteriesdept.com/r/EVD0DEDTJ2A3HW3
Private beta Downloads are for beta members

We're in a private beta while we get things right. Everything here is free to read; downloading datasets, sources and code is open to members for now.

It takes a couple of minutes. We'll reply by email.