VJvjerancrnjak·May 15, 2022
> figure out an entirely unattested language
I did not say that. Human languages evolve in similar ways, use similar vocabulary, grammar etc. Linguistics has already unraveled the structure of many languages and the structure of evolution of language through time.
I am not saying DL is THE approach to take, but given that there's only ~10k characters of Linear A, it is hard to tackle the problem without common representation of multiple languages that are close to it. That's the whole point of DL, how to build better and better representations, not how to accurately model uncertainty (which is what you get by doing statistics).
I would say XLM [0] builds a common representation of a collection of languages and then works better on machine translation for languages for which the data is scarce but that are related to the languages in the m
Read the rest
odel. (what it also does is discover and represent the structure of part-of-speech, grammar, entities etc. without being told about those particular things)
Does there exist an abundance of data for languages close to Linear A? If not, then I admire the work of all that try to untangle this with their brains alone.
0: https://github.com/facebookresearch/XLM