For mathematical models of language, their potential, limitations, and ways of improvement are investigated in terms of whether they reproduce the complex properties of language. The nature of linguistic structure is studied in terms of its relation to scaling properties of language.
Evaluating computational language models with scaling properties of natural language. Shuntaro Takahashi, Kumiko Tanaka-Ishii. Computational Linguistics, 2019.
Do neural nets learn statistical laws behind natural language? Shuntaro Takahashi, Kumiko Tanaka-Ishii. PLOS One, 2017.