1. Quantifying the Structure of Language and Music
Damián H. Zanette, Centro Atómico Bariloche & Instituto Balseiro

2. Language and music are outputs of a very complex system.
They must display patterns at several organizational levels.
Written language: a 1D array of symbols (words).
And music?

3. Organization in written language
Frequency of words (Zipf’s law) music
Ordering of words (a linguistic universal)
Word distribution (the “scales of meaning”)

4. f (r) ~ r-z Zipf’s law Make a list of the different words
in a text, from the most frequent
to the least frequent.
The frequency of each word is
inversely proportional to
a power of its rank in the list .
George K. Zipf ( )
f (r) ~ r-z

5. Zipf’s law

6. D. H. Zanette, Musicae Scientiae 10, 3 (2006)

7. However… If words are shuffled at random, Zipf’s law persists but meaning is lost!
How much information is stored in the order of words?

8. Shannon and language entropy
Claude E. Shannon ( )

9. “The Shannon entropy of a symbolic sequence is a lower bound for the length of any lossless compression of the sequence.”
Estimators for H can be given from the Lempel-Ziv algorithm

10. M. A. Montemurro, D. H. Zanette, PLoS ONE 6(5) e19875 (2011)
D = 3.2 – 3.5 bits/word

11. Our conjecture
The universal value of the information stored in the order of words is related to a (cognitive?) constraint between the diversity of semantic symbols and the typical lengths of word ordering.

12. The scales of meaning
Burstiness in Darwin’s “On the Origin of Species”

13. How precisely do words tag the different parts of a text?
What is the optimal size of parts?

14. M. A. Montemurro, D. H. Zanette, Adv. Compl. Sys. 13, 135 (2010)
Divide the text into P equal parts of size s and calculate the mutual information between words and parts.
Compare with a random shuffling of the text.

15. M. A. Montemurro, D. H. Zanette, Adv. Compl. Sys. 13, 135 (2010)

16. M. A. Montemurro, D. H. Zanette, Adv. Compl. Sys. 13, 135 (2010)

17. M. A. Montemurro, D. H. Zanette, Adv. Compl. Sys. 13, 135 (2010)