Hybrid tracking model and GSLM based neural network for crowd behavior recognition

Abstract

Crowd behaviors analysis is the ‘state of art’ research topic in the field of computer vision which provides applications in video surveillance to crowd safety, event detection, security, etc. Literature presents some of the works related to crowd behavior detection and analysis. In crowd behavior detection, varying density of crowds and motion patterns appears to be complex occlusions for the researchers. This work presents a novel crowd behavior detection system to improve these restrictions. The proposed crowd behavior detection system is developed using hybrid tracking model and integrated features enabled neural network. The object movement and activity in the proposed crowded behavior detection system is assessed using proposed GSLM-based neural network. GSLM based neural network is developed by integrating the gravitational search algorithm with LM algorithm of the neural network to increase the learning process of the network. The performance of the proposed crowd behavior detection system is validated over five different videos and analyzed using accuracy. The experimentation results in the crowd behavior detection with a maximum accuracy of 93% which proves the efficacy of the proposed system in video surveillance with security concerns.

Keywords

crowd video / crowd behavior / tracking / recognition / neural network / gravitational search algorithm

References

[1] HofmannM, HaagM, RigollG. Unified hierarchical multi-object tracking using global data association [J]. IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS), 20132228

[2] PÄTZOLDM, SikoraT. Real-time person counting by propagating networks flows [C]// IEEE International Conference on Advanced Video and Signal-Based Surveillance (AVSS). Klagenfurt, 20116670

[3] BreitensteinM D, ReichlinF, LeibeB, MeierE K, GoolL VRobust tracking-by-detection using a detector confidence particle filter [C]// IEEE International Conference on Computer Vision, 2009, Japan, Kyoto: 15151522

[4] EiseleinV, ArpD, PÄTZOLDM, SikoraTReal-time multi-human tracking using a probability hypothesis density filter and multiple detectors [C]// IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance (AVSS), 2012, China, Beijing: 325330

[5] WuZ, HristovN, HedrickT, KunzT, BetkeMTracking a large number of objects from multiple views [C]// IEEE 12th International Conference on Computer Vision, 2009, Japan, Kyoto: 15461553

[6] SongX, ShaoX, ZhaoH, CuiJ, ShibasakiR, ZhaHAn online approach: Learning-semantic-scene-by-tracking and trackingby- learning-semantic-scene [C]// IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010, USA, San Francisco, CA: 739746

[7] ZhanB B, MonekossoD N, PaoloR, SergioA V, XuL Q. Crowd analysis: A survey [J]. Machine Vision and Applications, 2008, 19(5): 345-357

[8] SaxenaS, BremondF, ThonnatM, MaR. Crowd behavior recognition for video surveillance [J]. Proceedings of 10th International Conference on Advanced Concepts for Intelligent Vision Systems, 2008, 5259: 970-981

[9] ChandolaV, BanerjeeA, KumarV. Anomaly detection: A survey [J]. ACM Computing Surveys, 2009, 41(3): 1-72

[10] LiW-x, MahadevanV, VasconcelosN. Anomaly detection and localization in crowded scenes [J]. IEEE transactions on pattern analysis and machine intelligence, 2014, 36(1): 18-32

[11] RodriguezM, SivicJ, LaptevI, AudibertJ YData-driven crowd analysis in videos [C]// IEEE International Conference on Computer Vision (ICCV), 2011, Spain, Barcelona: 12351242

[12] FradiH, EiseleinV, DugelayJ L, KellerI, SikoraTSpatio-temporal crowd density model in a human detection and tracking framework [J], 2015, 31: 100-111

[13] AliI, DaileyM N. Multiple human tracking in high-density crowds [J]. Image and Vision Computing, 2012, 30(12): 966-977

[14] CaoL-j, ZhangX, RenW-q, HuangK-qi. Large scale crowd analysis based on convolutional neural network [J]. Pattern Recognition, 2015, 48(10): 3016-3024

[15] LiuX, TaoD-c, SongM-l, ZhangL-m, BuJ-j, ChenChun. Learning to track multiple targets [J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 26(5): 1060-1073

[16] HuX, HuS-q, ZhangX-y, ZhangH-l, LuoL-kun. Anomaly detection based on local nearest neighbor distance descriptor in crowded scenes [J]. The Scientific World Journal, 2014632575

[17] WuS, WongH-s, YuZ-wen. A bayesian model for crowd escape behavior detection [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2014, 24(1): 85-98

[18] ChenC-y, ShaoY, BiX-jun. Detection of anomalous crowd behavior based on the acceleration feature [J]. IEEE Sensors Journal, 2015, 15(12): 7252-7261

[19] MartinT, HagaN, MohammadB, MenhaJ. Training feedforward networks with the Marquardt algorithm [J]. IEEE Transactions on Neural Networks, 1994, 5(6): 989-993

[20] KumarM, BhatnagarC. Zero-stopping constraint-based hybrid tracking model for dynamic and high dense crowd videos [J]. Journal of the Imaging Science, 2017, 65(2): 75-86

[21] TahmasebiP, HezarkhaniA. A hybrid neural networks-fuzzy logic-genetic algorithm for grade estimation [J]. Computers & Geosciences, 2012, 42: 18-27

[22] RashediE, Nezamabadi-PourH, SaryazdiS. GSA: A gravitational search algorithm [J]. Information Sciences, 2009, 179(13): 2232-2248

[23] CRCV. Tracking in High Density Crowds Data Set [EB/OL]. http://crcv.ucf.edu/data/tracking.php.

[24] UCSD. UCSD Anomaly Detection Dataset [EB/OL]. http://www.svcl.ucsd.edu/projects/anomaly/dataset.htm.

[25] AberaB, WolinskiD, PettreJ, ManochaD. Real-time crowd tracking using parameter optimized mixture of motion models [J]. Computer Vision and Pattern Recognition, Cornell library, 2014