Influence of preconditioning and blocking on accuracy in solving Markovian models

Beata Bylina ; Jarosław Bylina

International Journal of Applied Mathematics and Computer Science, Tome 19 (2009), p. 207-217 / Harvested from The Polish Digital Mathematics Library

Résumé

The article considers the effectiveness of various methods used to solve systems of linear equations (which emerge while modeling computer networks and systems with Markov chains) and the practical influence of the methods applied on accuracy. The paper considers some hybrids of both direct and iterative methods. Two varieties of the Gauss elimination will be considered as an example of direct methods: the LU factorization method and the WZ factorization method. The Gauss-Seidel iterative method will be discussed. The paper also shows preconditioning (with the use of incomplete Gauss elimination) and dividing the matrix into blocks where blocks are solved applying direct methods. The motivation for such hybrids is a very high condition number (which is bad) for coefficient matrices occuring in Markov chains and, thus, slow convergence of traditional iterative methods. Also, the blocking, preconditioning and merging of both are analysed. The paper presents the impact of linked methods on both the time and accuracy of finding vector probability. The results of an experiment are given for two groups of matrices: those derived from some very abstract Markovian models, and those from a general 2D Markov chain.

Détail

Publié le : 2009-01-01

Zbl 1170.65022

EUDML-ID : urn:eudml:doc:207928

Bibliographie

[000] Benzi, M. and Ucar, B. (2007). Block triangular preconditioners for M-matrices and Markov chains, Electronic Transactions on Numerical Analysis 26(1): 209-227. | Zbl 1171.65388

[001] Bylina, B. and Bylina, J. (2004). Solving Markov chains with the WZ factorization for modelling networks, Proceedings of the 3rd International Conference Aplimat 2004, Bratislava, Slovakia, pp. 307-312. | Zbl 1081.68549

[002] Bylina, B. and Bylina, J. (2007). Linking of direct and iterative methods in Markovian models solving, Proceedings of the International Multiconference on Computer Science and Information Technology, Wisła, Poland, Vol. 2, pp. 467-477. | Zbl 1170.65022

[003] Bylina, B. and Bylina, J. (2008). Incomplete WZ decomposition algorithm for solving Markov chains, Journal of Applied Mathematics 1(2): 147-156. | Zbl 1081.68549

[004] Bylina, J. (2003). Distributed solving of Markov chains for computer network models, Annales UMCS Informatica 1(1): 15-20.

[005] Campbell, S. L. and Meyer, C. D. (1979). Generalized Inverses of Linear Transformations, Pitman Publishing Ltd., London. | Zbl 0417.15002

[006] Chawla, M. and Khazal, R. (2003). A new WZ factorization for parallel solution of tridiagonal systems, International Journal of Computer Mathematics 80(1): 123-131. | Zbl 1035.65028

[007] Duff, I. S. (2004). Combining direct and iterative methods for the solution of large systems in different application areas, Technical Report RAL-TR-2004-033, Rutherford Appleton Laboratory, Chilton.

[008] Evans, D. J. and Barulli, M. (1998). BSP linear solver for dense matrices, Parallel Computing 24(5-6): 777-795. | Zbl 0909.68013

[009] Evans, D. J. and Hatzopoulos, M. (1979). The parallel solution of linear system, International Journal of Computer Mathematics 7(3): 227-238. | Zbl 0442.65019

[010] Funderlic, R. E. and Meyer, C. D. (1986). Sensitivity of the stationary distrbution vector for an ergodic Markov chain, Linear Algebra and Its Applications 76(1): 1-17. | Zbl 0583.60064

[011] Funderlic, R. E. and Plemmons, R. J. (1986). Updating LU factorizations for computing stationary distributions, SIAM Journal on Algebraic and Discrete Methods 7(1): 30-42. | Zbl 0592.65014

[012] Golub, G. H. and Meyer, C. D. (1986). Using the QR factorization and group inversion to compute, differentiate and estimate the sensitivity of stationary distributions for Markov chains, SIAM Journal on Algebraic and Discrete Methods 7(2): 273-281. | Zbl 0594.60072

[013] Harrod, W. J. and Plemmons, R. J. (1984). Comparisons of some direct methods for computing stationary distributions of Markov chains, SIAM Journal on Scientific and Statistical Computing 5(2): 453-469. | Zbl 0574.65147

[014] Haviv, M. (1987). Aggregation/disagregation methods for computing the stationary distribution of a Markov chain, SIAM Journal on Numerical Analysis 24(4): 952-966. | Zbl 0637.65147

[015] Jennings, A. and Stewart, W. J. (1975). Simultaneous iteration for partial eigensolution of real matrices, Journal of the Institute of Mathematics and Its Applications 15(3): 351-361. | Zbl 0307.65042

[016] Pollett, P. K. and Stewart, D. E. (1994). An efficient procedure for computing quasi-stationary distributions of Markov chains with sparse transition structure, Advances in Applied Probability 26(1): 68-79. | Zbl 0797.60060

[017] Rao, S. C. S. and Sarita (2008). Parallel solution of large symmetric tridiagonal linear systems, Parallel Computing 34(3): 177-197.

[018] Ridler-Rowe, C. J. (1967). On a stochastic model of an epidemic, Advances in Applied Probability 4(1): 19-33. | Zbl 0166.15903

[019] Saad, Y. and Schultz, M. H. (1986). GMRES: A generalized minimal residual algorithm for solving non-symmetric linear systems, SIAM Journal of Scientific and Statistical Computing 7(3): 856-869. | Zbl 0599.65018

[020] Schweitzer, P. J. and Kindle, K. W. (1986). An iterative aggregation-disaggregation algorithm for solving linear systems, Applied Mathematics and Computation 18(4): 313-353. | Zbl 0594.65020

[021] Stewart, W. (1994). Introduction to the Numerical Solution of Markov Chains, Princeton University Press, Chichester. | Zbl 0821.65099

[022] Stewart, W. J. and Jennings, A. (1981). A simultaneous iteration algorithm for real matrices, ACM Transactions on Mathematical Software 7(2): 184-198. | Zbl 0455.65028

[023] Yalamov, P. and Evans, D. J. (1995). The WZ matrix factorization method, Parallel Computing 21(7): 1111-1120. | Zbl 0875.68775