Abnormal prediction of dense crowd videos by a purpose-driven lattice Boltzmann model

Yiran Xue ; Peng Liu ; Ye Tao ; Xianglong Tang

International Journal of Applied Mathematics and Computer Science, Tome 27 (2017), p. 181-194 / Harvested from The Polish Digital Mathematics Library

Résumé

In the field of intelligent crowd video analysis, the prediction of abnormal events in dense crowds is a well-known and challenging problem. By analysing crowd particle collisions and characteristics of individuals in a crowd to follow the general trend of motion, a purpose-driven lattice Boltzmann model (LBM) is proposed. The collision effect in the proposed method is measured according to the variation in crowd particle numbers in the image nodes; characteristics of the crowd following a general trend are incorporated by adjusting the particle directions. The model predicts dense crowd abnormal events in different intervals through iterations of simultaneous streaming and collision steps. Few initial frames of a video are needed to initialize the proposed model and no training procedure is required. Experimental results show that our purpose-driven LBM performs better than most state-of-the-art methods.

Détail

Publié le : 2017-01-01
EUDML-ID : urn:eudml:doc:288090

Bibliographie

[000] Adam, A., Rivlin, E., Shimshoni, I. and Reinitz, D. (2008). Robust real-time unusual event detection using multiple fixed-location monitors, IEEE Transactions on Pattern Analysis and Machine Intelligence 30(3): 555-560.

[001] Ahlquist, J.S. and Breunig, C. (2012). Model-based clustering and typologies in the social sciences, Political Analysis 20(1): 92-112.

[002] Al-nasur, S.J. (2006). New Models for Crowd Dynamics and Control, PhD thesis, Virginia Polytechnic Institute and State University, Blacksburg, VA.

[003] Alahi, A., Ramanathan, V. and Fei-Fei, L. (2014). Socially-aware large-scale crowd forecasting, 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA, pp. 2211-2218.

[004] Ali, S. and Shah, M. (2007). A Lagrangian particle dynamics approach for crowd flow segmentation and stability analysis, 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA, pp. 1-6.

[005] Baker, S., Scharstein, D., Lewis, J.P., Roth, S., Black, M.J. and Szeliski, R. (2011). A database and evaluation methodology for optical flow, International Journal of Computer Vision 92(1): 1-31.

[006] Bhatnagar, P.L., Gross, E.P. and Krook, M. (1954). A model for collision processes in gases. I: Small amplitude processes in charged and neutral one-component systems, Physical Review 94(3): 511-525. | Zbl 0055.23609

[007] Cao, T., Wu, X., Guo, J., Yu, S. and Xu, Y. (2009). Abnormal crowd motion analysis, 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO), Guilin, China, pp. 1709-1714.

[008] Chan, A.B. and Vasconcelos, N. (2008). Modeling, clustering, and segmenting video with mixtures of dynamic textures, IEEE Transactions on Pattern Analysis and Machine Intelligence 30(5): 909-926.

[009] Chetverikov, D. and Péteri, R. (2005). A brief survey of dynamic texture description and recognition, in M. Kurzyński et al. (Eds.), Computer Recognition Systems, Advances in Soft Computing, Vol. 30, Springer, Berlin/Heidelberg, pp. 17-26.

[010] Cong, Y., Yuan, J. and Liu, J. (2011). Sparse reconstruction cost for abnormal event detection, 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA, pp. 3449-3456.

[011] Cong, Y., Yuan, J. and Liu, J. (2013). Abnormal event detection in crowded scenes using sparse representation, Pattern Recognition 46(7): 1851-1864.

[012] Dębski, R. (2014). High-performance simulation-based algorithms for an alpine ski racer's trajectory optimization in heterogeneous computer systems, International Journal of Applied Mathematics and Computer Science 24(3): 551-566, DOI: 10.2478/amcs-2014-0040. | Zbl 1322.93075

[013] Dębski, R. (2016). An adaptive multi-spline refinement algorithm in simulation based sailboat trajectory optimization using onboard multi-core computer systems, International Journal of Applied Mathematics and Computer Science 26(2): 351-365, DOI: 10.1515/amcs-2016-0025. | Zbl 1347.93151

[014] Dollár, P., Appel, R., Belongie, S. and Perona, P. (2014). Fast feature pyramids for object detection, IEEE Transactions on Pattern Analysis and Machine Intelligence 36(8): 1532-1545.

[015] Jiang, Y.-Q., Zhang, P., Wong, S.C. and Liu, R.-X. (2010). A higher-order macroscopic model for pedestrian flows, Physica A: Statistical Mechanics and Its Applications 389(21): 4623-4635.

[016] Johansson, A., Helbing, D., Al-Abideen, H.Z. and Al-Bosta, S. (2008). From crowd dynamics to crowd safety: A video-based analysis, Advances in Complex Systems 11(04): 497-527. | Zbl 1152.91750

[017] Kowalski, M., Kaczmarek, P., Kabaciński, R., Matuszczak, M., Tranbowicz, K. and Sobkowiak, R. (2014). A simultaneous localization and tracking method for a worm tracking system, International Journal of Applied Mathematics and Computer Science 24(3): 599-609, DOI: 10.2478/amcs-2014-0043. | Zbl 1322.93013

[018] Lee, B.H., Koo, Y.-H., Oh, J.Y., Cheon, J.S., Tahk, Y.-W. and Sohn, D.-S. (2011). Fuel performance code cosmos for analysis of LWR UO2 and MOX fuel, Nuclear Engineering and Technology 43(6): 499-508.

[019] Li, W., Mahadevan, V. and Vasconcelos, N. (2014). Anomaly detection and localization in crowded scenes, IEEE Transactions on Pattern Analysis and Machine Intelligence 36(1): 18-32.

[020] Mandl, F. (2008). Statistical Physics, 2nd Edition, Manchester Physics, Hoboken, NJ.

[021] Mathiassen, J.R. and Skavhaug, A. (2002). Texture similarity measure using Kullback-Leibler divergence between gamma distributions, ECCV 2002: 7th European Conference on Computer Vision, Copenhagen, Denmark, Part III, pp. 133-147. | Zbl 1039.68686

[022] McNamara, G.R. and Zanetti, G. (1988). Use of the Boltzmann equation to simulate lattice-gas automata, Physical Review Letters 61(20): 2332.

[023] Mehran, R., Oyama, A. and Shah, M. (2009). Abnormal crowd behavior detection using social force model, 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Miami, FL, USA, pp. 935-942.

[024] Mészáros, A., Papp, J. and Telek, M. (2014). Fitting traffic traces with discrete canonical phase type distributions and Markov arrival processes, International Journal of Applied Mathematics and Computer Science 24(3): 453-470, DOI: 10.2478/amcs-2014-0034. | Zbl 1322.93092

[025] Raghavendra, R., Bue, A.D., Cristani, M. and Murino, V. (2011a). Optimizing interaction force for global anomaly detection in crowded scenes, 2011 IEEE International Conference on Computer Vision Workshops, Barcelona, Spain, pp. 136-143.

[026] Raghavendra, R., Bue, A., Cristani, M. and Murino, V. (2011b). Abnormal crowd behavior detection by social force optimization, in A.A. Salah and B. Lepri (Eds.), Human Behavior Understanding: Second International Workshop, HBU 2011, Springer, Berlin/Heidelberg, pp. 134-145.

[027] Rodriguez, M., Laptev, I., Sivic, J. and Audibert, J.Y. (2011). Density-aware person detection and tracking in crowds, 2011 International Conference on Computer Vision, Barcelona, Spain, pp. 2423-2430.

[028] Rowlinson, J.S. (2005). The Maxwell-Boltzmann distribution, Molecular Physics 103(21-23): 2821-2828.

[029] Silveira Jacques Jr., J.C., Raupp Musse, S. and Rosito Jung, C. (2010). Crowd analysis using computer vision techniques, IEEE Signal Processing Magazine 27(5): 66-77.

[030] Solmaz, B., Moore, B.E. and Shah, M. (2012). Identifying behaviors in crowd scenes using stability analysis for dynamical systems, IEEE Transactions on Pattern Analysis and Machine Intelligence 34(10): 2064-2070.

[031] Still, G.K. (2000). Crowd Dynamics, PhD thesis, University of Warwick, Coventry.

[032] Wang, B., Ye, M., Li, X., Zhao, F. and Ding, J. (2012). Abnormal crowd behavior detection using high-frequency and spatio-temporal features, Machine Vision and Applications 23(3): 501-511.

[033] Wang, Z., Bovik, A.C., Sheikh, H.R. and Simoncelli, E.P. (2004). Image quality assessment: From error visibility to structural similarity, IEEE Transactions on Image Processing 13(4): 600-612.

[034] Wolf-Gladrow, D. (2000). Lattice-Gas Cellular Automata and Lattice Boltzmann Models-An Introduction, Lecture Notes in Mathematics, Vol. 1725, Springer, Berlin. | Zbl 0999.82054

[035] Wu, S., Moore, B.E. and Shah, M. (2010). Chaotic invariants of lagrangian particle trajectories for anomaly detection in crowded scenes, 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, USA, pp. 2054-2060.

[036] Xiong, G., Cheng, J., Wu, X., Chen, Y.-L., Ou, Y. and Xu, Y. (2012). An energy model approach to people counting for abnormal crowd behavior detection, Neurocomputing 83: 121-135.

[037] Xiong, G., Wu, X., Chen, Y.L. and Ou, Y. (2011). Abnormal crowd behavior detection based on the energy model, 2011 IEEE International Conference on Information and Automation (ICIA), Shenzhen, China, pp. 495-500.

[038] Xu, J., Denman, S., Sridharan, S., Fookes, C. and Rana, R. (2011). Dynamic texture reconstruction from sparse codes for unusual event detection in crowded scenes, Proceedings of the 2011 Joint ACM Workshop on Modeling and Representing Events, Scottsdale, AZ, USA, pp. 25-30.

[039] Yu, H., Zhou, Y., Simmons, J., Przybyla, C., Lin, Y., Fan, X., Mi, Y. and Wang, S. (2016). Groupwise tracking of crowded similar-appearance targets from low-continuity image sequences, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, pp. 952-960.

[040] Yuan, Y., Fang, J. and Wang, Q. (2015). Online anomaly detection in crowd scenes via structure analysis, IEEE Transactions on Cybernetics 45(3): 548-561.

[041] Zhao, J., Xu, Y., Yang, X. and Yan, Q. (2011). Crowd instability analysis using velocity-field based social force model, 2011 IEEE Conference on Visual Communications and Image Processing (VCIP), Tainan, China, pp. 1-4.