We study mathematical properties of natural language by using the theory of complex systems. The relation between linguistic structure (such as words and grammar) and large-scale properties is investigated from the perspectives of fractals and chaos. Mathematical models of language that reproduce such understanding are explored and are applied to natural language processing. Language has properties in common with other large-scale social systems, such as finance, law and communication networks. We explore new ways of engineering these social systems by using texts and computing with large-scale resources.

Book 1Book 2

Natural Language as a complex system

Computional linguistics and study of natural language by using the theory of complex systems

• Statistical properties of language
• Methods for measuring non-stationarity and long memory underlying language
• Scaling properties of language
• Quantification of complexity of language
• Mathematical modeling of tree structure (syntax) of language

Mathematical language models

Mathematical language models and computational representations of language structure

• Language models that reproduce statistical properties of language
• Embeddings that encode scaling properties
• Mathematical relation between long memory and grammatical structure
• Deep learning methods for sequences with complex properties
• Generative document retrieval and language models

Social complex systems via texts

Analysis and prediction of social complex systems via texts

• Embedding methods for social complex system entities
• Deep learning methods for financial time series by using texts
• Jurimetrics and legal text processing
• Application of knowledge graphs