A new approach to nonlinear modelling of dynamic systems based on fuzzy rules

Łukasz Bartczuk ; Andrzej Przybył ; Krzysztof Cpałka

International Journal of Applied Mathematics and Computer Science, Tome 26 (2016), p. 603-621 / Harvested from The Polish Digital Mathematics Library

Résumé

For many practical weakly nonlinear systems we have their approximated linear model. Its parameters are known or can be determined by one of typical identification procedures. The model obtained using these methods well describes the main features of the system's dynamics. However, usually it has a low accuracy, which can be a result of the omission of many secondary phenomena in its description. In this paper we propose a new approach to the modelling of weakly nonlinear dynamic systems. In this approach we assume that the model of the weakly nonlinear system is composed of two parts: a linear term and a separate nonlinear correction term. The elements of the correction term are described by fuzzy rules which are designed in such a way as to minimize the inaccuracy resulting from the use of an approximate linear model. This gives us very rich possibilities for exploring and interpreting the operation of the modelled system. An important advantage of the proposed approach is a set of new interpretability criteria of the knowledge represented by fuzzy rules. Taking them into account in the process of automatic model selection allows us to reach a compromise between the accuracy of modelling and the readability of fuzzy rules.

Détail

Publié le : 2016-01-01
EUDML-ID : urn:eudml:doc:286734

Bibliographie

[000] Adjrad, M. and Belouchrani, A. (2007). Estimation of multicomponent polynomial-phase signals impinging on a multisensor array using state-space modeling, IEEE Transactions on Signal Processing 55(1): 32-45.

[001] Angelov, P.P., Filev, D.P. (2004). Flexible models with evolving structure, International Journal of Intelligent Systems 19(4): 327-340. | Zbl 1101.68747

[002] Babuska, R., Verbruggen, H. (2003). Flexible neuro-fuzzy methods for nonlinear system identification, Annual Reviews in Control 27(1): 73-85.

[003] Bagarinao, E., Matsuo, K., Nakai, T. and Sato, S. (2003). Estimation of general linear model coefficients for real-time application, NeuroImage 19(2): 422-429.

[004] Banerjee, A., Arkun, Y., Ogunnaike, B. and Pearson, R. (1997). Estimation of nonlinear systems using linear multiple models, AIChE Journal 43(5): 1204-1226.

[005] Bohlin, T.P. (2006). Practical Grey-Box Process Identification: Theory and Applications, Springer, London. | Zbl 1122.93059

[006] Boukezzoula, R., Galichet, S. and Foulloy, L. (2007). Fuzzy feedback linearizing controller and its equivalence with the fuzzy nonlinear internal model control structure, International Journal of Applied Mathematics and Computer Science 17(2): 233-248, DOI: 10.2478/v10006-007-0021-4. | Zbl 1119.93357

[007] Casillas, J., Cordón, O., Herrera, F. and Magdalena, L. (2003). Interpretability improvements to find the balance interpretability-accuracy in fuzzy modeling: An overview, in J. Casillas et al. (Eds.), Interpretability Issues in Fuzzy Modeling, Springer, Berlin/Heidelberg, pp. 3-22. | Zbl 1048.93003

[008] Caughey, T.K. (1963). Equivalent linearization techniques, Journal of the Acoustical Society of America 35(11): 1706-1711.

[009] Cordón, O. (2011). A historical review of evolutionary learning methods for Mamdani-type fuzzy rule-based systems: Designing interpretable genetic fuzzy systems, International Journal of Approximate Reasoning 52(6): 894-913.

[010] Cordón, O., Herrera, F., Hoffmann, F. and Magdalena, L. (2001). Genetic Fuzzy Systems, World Scientific Publishing Company, Singapore. | Zbl 1042.68098

[011] Cpałka, K. (2009a). A new method for design and reduction of neuro-fuzzy classification systems, IEEE Transactions on Neural Networks 20(4): 701-714.

[012] Cpałka, K. (2009b). On evolutionary designing and learning of flexible neuro-fuzzy structures for nonlinear classification, Nonlinear Analysis A: Theory, Methods and Applications 71(12): 1659-1672.

[013] Cpałka, K., Łapa, K., Przybył, A. and Zalasiński, M. (2014). A new method for designing neuro-fuzzy systems for nonlinear modelling with interpretability aspects, Neurocomputing 135: 203-217.

[014] Cpałka, K., Rebrova, O., Nowicki, R. and Rutkowski, L. (2013). On design of flexible neuro-fuzzy systems for nonlinear modelling, International Journal of General Systems 42(6): 706-720. | Zbl 1268.93016

[015] Czekalski, P. (2006). Evolution-fuzzy rule based system with parameterized consequences, International Journal of Applied Mathematics and Computer Science 16(3): 373-385. | Zbl 1144.68339

[016] DeHaan, D. and Guay, M. (2006). A new real-time perspective on non-linear model predictive control, Journal of Process Control 16(6): 615-624.

[017] Di Nuovo, A. and Ascia, G. (2013). A fuzzy system index to preserve interpretability in deep tuning of fuzzy rule based classifiers, Journal of Intelligent and Fuzzy Systems 25(2): 493-504.

[018] Eiben, A.E. and Smith, J. (2008). Introduction to Evolutionary Computing, Springer, Berlin/Heidelberg. | Zbl 1028.68022

[019] Fei, X., Lu, C.-C. and Liu, K. (2011). A Bayesian dynamic linear model approach for real-time short-term freeway travel time prediction, Transportation Research C: Emerging Technologies 19(6): 1306-1318.

[020] Fogel, D.B. (2006). Evolutionary Computation: Toward a New Philosophy of Machine Intelligence, Vol. 1, John Wiley & Sons, Hoboken, NJ. | Zbl 0926.68052

[021] Fogel, D.B. and Atmar, J.W. (1990). Comparing genetic operators with Gaussian mutations in simulated evolutionary processes using linear systems, Biological Cybernetics 63(2): 111-114.

[022] Forst, W. and Hoffmann, D. (2010). Optimization Theory and Practice, Springer, New York, NY. | Zbl 1211.90002

[023] Gabryel, M. and Rutkowski, L. (2006). Evolutionary learning of Mamdani-type neuro-fuzzy systems, in L. Rutkowski et al. (Eds.), Artificial Intelligence and Soft Computing, Lecture Notes in Computer Science, Vol. 4029, Springer, Berlin/Heidelberg, pp. 354-359.

[024] Gacto, M., Alcala, R. and Herrera, F. (2011). Interpretability of linguistic fuzzy rule-based systems: An overview of interpretability measures, Information Sciences 181(20): 4340-4360. | Zbl 05947939

[025] Grabowski, P. and Callier, F.M. (2001). Circle criterion and boundary control systems in factor form: Input-output approach, Applied Mathematics and Computer Science 11(6): 1387-1403. | Zbl 0999.93061

[026] Háber, R. and Keviczky, L. (1999). Nonlinear System Identification-Input-Output Modeling Approach, Vol. 1: Nonlinear System Parameter Identification, Springer Netherlands, Dordrecht. | Zbl 0934.93004

[027] Homaifar, A. and McCormick, E. (1995). Simultaneous design of membership functions and rule sets for fuzzy controllers using genetic algorithms, IEEE Transactions on Fuzzy Systems 3(2): 129-139.

[028] Horzyk, A. and Tadeusiewicz, R. (2004). Self-optimizing neural networks, Advances in Neural Networks, Springer, Berlin/Heidelberg, pp. 150-155.

[029] Huijberts, H., Nijmeijer, H. and Willems, R. (2000). System identification in communication with chaotic systems, IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications 47(6): 800-808. | Zbl 0972.93017

[030] Ikonen, E. and Najim, K. (2001). Advanced Process Identification and Control, Vol. 9, CRC Press, New York, NY. | Zbl 1132.93048

[031] Ishibashi, R. and Lucio Nascimento, Jr., C. (2013). GFRBS-PHM: A genetic fuzzy rule-based system for PHM with improved interpretability, IEEE Conference on Prognostics and Health Management, 2013, Gaithersburg, MD, USA, pp. 1-7.

[032] Ishibuchi, H. and Yamamoto, T. (2004). Fuzzy rule selection by multi-objective genetic local search algorithms and rule evaluation measures in data mining, Fuzzy Sets and Systems 141(1): 59-88. | Zbl 1081.68091

[033] Jang, I.-S. R. and Sun, C.-T. (1995). Neuro-fuzzy modeling and control, Proceedings of the IEEE 83(3): 378-406.

[034] Johansen, T.A., Shorten, R. and Murray-Smith, R. (2000). On the interpretation and identification of dynamic Takagi-Sugeno fuzzy models, IEEE Transactions on Fuzzy Systems 8(3): 297-313.

[035] Johansson, U., Sönströd, C., Norinder, U. and Boström, H. (2011). Trade-off between accuracy and interpretability for predictive in silico modeling, Future Medicinal Chemistry 3(6): 647-663.

[036] Jordan, A. (2006). Linearization of non-linear state equation, Bulletin of the Polish Academy of Sciences: Technical Sciences 54(1): 63-73. | Zbl 1194.78065

[037] Juang, C.-F. and Chen, C.-Y. (2013). Data-driven interval type-2 neural fuzzy system with high learning accuracy and improved model interpretability, IEEE Transactions on Cybernetics 43(6): 1781-1795.

[038] Kim, M.-S., Kim, C.-H. and Lee, J.-J. (2006). Evolving compact and interpretable Takagi-Sugeno fuzzy models with a new encoding scheme, IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics 36(5): 1006-1023.

[039] Kluska, J. (2009). Analytical Methods in Fuzzy Modeling and Control, Springer, Berlin/Heidelberg. | Zbl 1226.93002

[040] Kluska, J. (2015). Selected applications of P1-TS fuzzy rule-based systems, in L. Rutkowski et al. (Eds.), Artificial Intelligence and Soft Computing, Lecture Notes in Computer Science, Vol. 9119, Springer, Berlin/Heidelberg, pp. 195-206.

[041] Kristensen, N.R., Madsen, H. and Jørgensen, S.B. (2004). A method for systematic improvement of stochastic grey-box models, Computers & Chemical Engineering 28(8): 1431-1449.

[042] Kroese, D.P., Taimre, T. and Botev, Z.I. (2011). Handbook of Monte Carlo Methods, Vol. 706, John Wiley & Sons, Hoboken, NJ. | Zbl 1213.65001

[043] Li, C. and Chiang, T.-W. (2012). Intelligent financial time series forecasting: A complex neuro-fuzzy approach with multi-swarm intelligence, International Journal of Applied Mathematics and Computer Science 22(4): 787-800, DOI: 10.2478/v10006-012-0058-x. | Zbl 1286.91149

[044] Ljung, L. (2010). Approaches to identification of nonlinear systems, 9th Chinese Control Conference, Beijing, China, pp. 1-5.

[045] Łęski, J. (2003). A fuzzy if-then rule-based nonlinear classifier, International Journal of Applied Mathematics and Computer Science 13(2): 215-223. | Zbl 1048.93503

[046] Lughofer, E. (2013). On-line assurance of interpretability criteria in evolving fuzzy systems-achievements, new concepts and open issues, Information Sciences 251: 22-46.

[047] Malchiodi, D. and Pedrycz, W. (2013). Learning membership functions for fuzzy sets through modified support vector clustering, in F. Masulli et al. (Eds.), Fuzzy Logic and Applications, Springer, Cham, pp. 52-59. | Zbl 06344557

[048] Medasani, S., Kim, J. and Krishnapuram, R. (1998). An overview of membership function generation techniques for pattern recognition, International Journal of Approximate Reasoning 19(3): 391-417. | Zbl 0947.68555

[049] Miller, G.A. (1956 ). The magical number seven, plus or minus two: Some limits on our capacity for processing information, The Psychological Review 63: 81-97.

[050] Mrugalski, M. (2014). Advanced Neural Network-Based Computational Schemes for Robust Fault Diagnosis, Studies in Computational Intelligence, Vol. 510, Springer-Verlag, Berlin/Heidelberg. | Zbl 1280.68007

[051] Murray-Smith, R. and Johansen, T. (1997). Multiple Model Approaches to Nonlinear Modelling and Control, CRC Press, Boca Raton, FL.

[052] Nelles, O. (2001). Nonlinear System Identification: From Classical Approaches to Neural Networks and Fuzzy Models, Springer, Berlin/Heidelberg. | Zbl 0963.93001

[053] Ogata, K. (2004). System Dynamics, Pearson/Prentice Hall, Upper Saddle River, NJ.

[054] Patton, R.J., Korbicz, J., Witczak, M. and Uppal, F. (2005). Combined computational intelligence and analytical methods in fault diagnosis, IEE Control Engineering Series 70: 349. | Zbl 1267.93125

[055] Pedro, J.O. and Dahunsi, O.A. (2011). Neural network based feedback linearization control of a servo-hydraulic vehicle suspension system, International Journal of Applied Mathematics and Computer Science 21(1): 137-147, DOI: 10.2478/v10006-011-0010-5. | Zbl 1221.93088

[056] Przybył, A. and Jelonkiewicz, J. (2003). Genetic algorithm for observer parameters tuning in sensorless induction motor drive, Proceedings of the 6th International Conference on Neural Networks and Soft Computing, Zakopane Poland, pp. 376-381.

[057] Puig, V., Witczak, M., Nejjari, F., Quevedo, J. and Korbicz, J. (2007). A GMDH neural network-based approach to passive robust fault detection using a constraint satisfaction backward test, Engineering Applications of Artificial Intelligence 20(7): 886-897.

[058] Quah, K.H. and Quek, C., (2006). FITSK: Online local learning with generic fuzzy input Takagi-Sugeno-Kang fuzzy framework for nonlinear system estimation, IEEE Transactions on Systems, Man, and Cybernetics B: Cybernetics 36(1): 166-178.

[059] Roffel, B. and Betlem, B.H. (2004). Advanced Practical Process Control, Springer, Berlin/Heidelberg. | Zbl 1042.93003

[060] Rüping, S. (2006). Learning Interpretable Models, Ph.D. thesis, Technical University of Dortmund, Dortmund.

[061] Rutkowski, L. (2008). Computational Intelligence: Methods and Techniques, Springer, Berlin/Heidelberg. | Zbl 1147.68061

[062] Rutkowski, L. and Cpałka, K. (2005). Designing and learning of adjustable quasi-triangular norms with applications to neuro-fuzzy systems, IEEE Transactions on Fuzzy Systems 13(1): 140-151.

[063] Salapa, K., Trawińska, A., Roterman, I. and Tadeusiewicz, R. (2014). Speaker identification based on artificial neural networks. Case study: The Polish vowel (a pilot study), Bio-Algorithms and Med-Systems 10(2): 91-99.

[064] Setnes, M. and Roubos, H. (2000). GA-fuzzy modeling and classification: Complexity and performance, IEEE Transactions on Fuzzy Systems 8(5): 509-522.

[065] Schröder, D. (Ed.) (2000). Intelligent Observer and Control Design for Nonlinear Systems, Springer, Berlin/Heidelberg.

[066] Shill, P., Akhand, M. and Murase, K. (2011). Simultaneous design of membership functions and rule sets for type-2 fuzzy controllers using genetic algorithms, 14th International Conference on Computer and Information Technology, Dhaka, Bangladesh, pp. 554-559.

[067] Shukla, P. and Tripathi, S. (2013). Interpretability issues in evolutionary multi-objective fuzzy knowledge base systems, 7th International Conference on Bio-Inspired Computing: Theories and Applications, Madhya Pradesh, India, pp. 473-484.

[068] Sivanandam, S. and Deepa, S. (2008). Genetic Algorithm Optimization Problems, Springer, Berlin/Heidelberg. | Zbl 1129.90001

[069] Starczewski, J.T., Bartczuk, Ł., Dziwiński, P. and Marvuglia, A. (2010). Learning methods for type-2 FLS based on FCM, in L. Rutkowski et al. (Eds.), Artificial Intelligence and Soft Computing, Springer, Berlin/Heidelberg, pp. 224-231.

[070] Tadeusiewicz, R. (2010). Using neural networks for simplified discovery of some psychological phenomena, in L. Rutkowski et al. (Eds.), Artificial Intelligence and Soft Computing, Springer, Berlin/Heidelberg, pp. 104-123.

[071] Tadeusiewicz, R., Chaki, R. and Chaki, N. (2014). Exploring Neural Networks with C#, CRC Press, Boca Raton, FL.

[072] Tadeusiewicz, R. and Figura, I. (2011). Phenomenon of tolerance to damage in artificial neural networks, Computer Methods in Materials Science 11(4): 501-513.

[073] Tan, Y. (2004). Time-varying time-delay estimation for nonlinear systems using neural networks, International Journal of Applied Mathematics and Computer Science 14(1): 63-68. | Zbl 1171.94386

[074] Wang, H., Kwong, S., Jin, Y., Wei, W. and Man, K.-F. (2005). Agent-based evolutionary approach for interpretable rule-based knowledge extraction, IEEE Transactions on Systems, Man, and Cybernetics C: Applications and Reviews 35(2): 143-155.

[075] Wang, H., Kwong, S., Jin, Y., Wei, W. and Man, K.-F. (2005). Multi-objective hierarchical genetic algorithm for interpretable fuzzy rule-based knowledge extraction, Fuzzy Sets and Systems 149(1): 149-186. | Zbl 1071.68550

[076] Wilamowski, B.M. (2005). Methods of computational intelligence for nonlinear control systems, ICCAE 2005 International Conference on Control, Automation and System, Gyeonggi-Do, Korea, pp. P1-P8.

[077] Witkowska, A. and Śmierzchalski, R. (2012). Designing a ship course controller by applying the adaptive backstepping method, International Journal of Applied Mathematics and Computer Science 22(4): 985-997, DOI: 10.2478/v10006-012-0073-y. | Zbl 1283.93156

[078] Wu, C.-J. and Liu, G.-Y. (2000). A genetic approach for simultaneous design of membership functions and fuzzy control rules, Journal of Intelligent and Robotic Systems 28(3): 195-211. | Zbl 1034.68701

[079] Xie, Y., Guo, B., Xu, L., Li, J. and Stoica, P. (2006). Multistatic adaptive microwave imaging for early breast cancer detection, IEEE Transactions on Biomedical Engineering 53(8): 1647.

[080] Zhou, S.-M., Gan, J. Q. (2008). Low-level interpretability and high-level interpretability: A unified view of data-driven interpretable fuzzy system modelling, Fuzzy Sets and Systems 159(23): 3091-3131.