The paper presents an elementary approach for the calculation of the entropy of a class of languages. This approach is based on the consideration of roots of a real polynomial and is also suitable for calculating the Bernoulli measure. The class of languages we consider here is a generalisation of the Łukasiewicz language.
@article{ITA_2005__39_4_621_0, author = {Staiger, Ludwig}, title = {The entropy of \L ukasiewicz-languages}, journal = {RAIRO - Theoretical Informatics and Applications - Informatique Th\'eorique et Applications}, volume = {39}, year = {2005}, pages = {621-639}, doi = {10.1051/ita:2005032}, zbl = {1073.68670}, language = {en}, url = {http://dml.mathdoc.fr/item/ITA_2005__39_4_621_0} }
Staiger, Ludwig. The entropy of Łukasiewicz-languages. RAIRO - Theoretical Informatics and Applications - Informatique Théorique et Applications, Tome 39 (2005) pp. 621-639. doi : 10.1051/ita:2005032. http://gdmltest.u-ga.fr/item/ITA_2005__39_4_621_0/
[1] Context-Free Languages and Pushdown Automata, in Handbook of Formal Languages, edited by G. Rozenberg and A. Salomaa. Springer-Verlag, Berlin 1 (1997) 111-174.
, and ,[2] Theory of Codes. Academic Press, Orlando (1985). | MR 797069 | Zbl 0587.68066
and ,[3] Finite-state languages. Inform. Control 1 (1958) 91-112. | Zbl 0081.14503
and ,[4] Codes and Infinite Words. Acta Cybernetica 11 (1994) 241-256. | Zbl 0938.68691
, , and ,[5] Automata, Languages and Machines, Vol. A. Academic Press, New York (1974). | MR 530382 | Zbl 0317.94045
,[6] Valuations of Languages, with Applications to Fractal Geometry. Theoret. Comput. Sci. 137 (1995) 177-217. | Zbl 0873.68110
,[7] Entropy and compression, in STACS'92, edited by A. Finkel and M. Jantzen. Lect. Notes Comput. Sci. 577 (1992) 515-530.
, and ,[8] Informations theorie. Addison-Wesley (1992).
,[9] On Probabilistic Context-Free Grammars that Achieve Capacity. Inform. Control 29 (1975) 268-285. | Zbl 0361.94030
and ,[10] The noncomputability of the channel capacity of context-sensitive languages. Inform. Control 17 (1970) 175-182. | Zbl 0196.01802
,[11] On the entropy of context-free languages. Inform. Control 16 (1970) 173-200. | Zbl 0193.32603
,[12] An Introduction to Kolmogorov Complexity and its Applications. Springer-Verlag, New York (1993). | MR 1238938 | Zbl 0805.68063
and ,[13] On infinitary finite length codes. RAIRO-Inf. Theor. Appl. 20 (1986) 483-494. | Numdam | Zbl 0628.68056
,[14] Ein Satz über die Entropie von Untermonoiden. Theor. Comput. Sci. 61 (1988) 279-282. | Zbl 0661.68075
,[15] Kolmogorov complexity and Hausdorff dimension. Inform. Comput. 103 (1993) 159-194. | Zbl 0789.68076
,