A new approach for real time object detection and tracking on high resolution and multi-camera surveillance videos using GPU

Abstract

High resolution cameras and multi camera systems are being used in areas of video surveillance like security of public places, traffic monitoring, and military and satellite imaging. This leads to a demand for computational algorithms for real time processing of high resolution videos. Motion detection and background separation play a vital role in capturing the object of interest in surveillance videos, but as we move towards high resolution cameras, the time-complexity of the algorithm increases and thus fails to be a part of real time systems. Parallel architecture provides a surpass platform to work efficiently with complex algorithmic solutions. In this work, a method was proposed for identifying the moving objects perfectly in the videos using adaptive background making, motion detection and object estimation. The pre-processing part includes an adaptive block background making model and a dynamically adaptive thresholding technique to estimate the moving objects. The post processing includes a competent parallel connected component labelling algorithm to estimate perfectly the objects of interest. New parallel processing strategies are developed on each stage of the algorithm to reduce the time-complexity of the system. This algorithm has achieved a average speedup of 12.26 times for lower resolution video frames (320×240, 720×480, 1024×768) and 7.30 times for higher resolution video frames (1360×768, 1920×1080, 2560×1440) on GPU, which is superior to CPU processing. Also, this algorithm was tested by changing the number of threads in a thread block and the minimum execution time has been achieved for 16×16 thread block. And this algorithm was tested on a night sequence where the amount of light in the scene is very less and still the algorithm has given a significant speedup and accuracy in determining the object.

Keywords

central processing unit (CPU) / graphics processing unit (GPU) / morphology / connected component labelling (CCL)

References

[1] EklundA, DufortP, ForsbergD, LaconteS M. Medical image processing on the GPU–Past, present and future [J]. Medical Image Analysis, 2013, 17(8): 1073-1094

[2] BuchN, VelastinS A, OrwellJ. A review of computer vision techniques for the analysis of urban traffic [J]. IEEE Transactions on Intelligent Transportation Systems, 2011, 12(3): 920-939

[3] AttardL, FarrugiaR A. Vision based surveillance system [C]//. Proceedings of IEEE EUROCON-International Conference on Computer as a Tool (EUROCON 2011), 20111-4

[4] Mohammad FarukhHASHMI, KeskarA G. Analysis and monitoring of a high density traffic flow at t-intersection using statistical computer vision based approach [C]//. Proceedings of 12th IEEE International Conference on Intelligent Systems Design and Applications (ISDA-2012), 201252-57

[5] Mohammad FarukhHASHMI, KeskarA G. Video surveillance for disorganized traffic flow at T–intersections [C]//. Proceedings of Elsevier, Seventh International Conference on Image and Signal Processing (ICISP-2013), 201351-61

[6] HuangS-chia. An advanced motion detection algorithm with video quality analysis for video surveillance systems [J]. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(1): 1-14

[7] FradiH, DugelayJ. Robust foreground segmentation using improved Gaussian mixture model and optical flow [C]//. Proceedings of IEEE International Conference on Informatics, Electronics & Vision (ICIEV-2012), 2012248-253

[8] ChengF-C, RuanS-Jang. Accurate motion detection using a self-adaptive background matching framework [J]. IEEE Transactions on Intelligent Transportation Systems, 2012, 13(2): 671-679

[9] RihaL, HodaE-Sayed. Real-time motion object tracking using GPU [C]//. Proceedings of IEEE 9th IEEE/ACS International Conference on Computer Systems and Applications (AICCSA-2011), 2011301-304

[10] RaneM A. Fast morphological image processing on GPU using CUDA [D]. Pune: College of Engineering, 2013

[11] ThurleyM J, DanellV. Fast morphological image processing open-source extensions for GPU processing with CUDA [J]. IEEE Journal of Selected Topics in Signal Processing, 2012, 6(7): 849-855

[12] DomanskiL, VallottonP, WangD-dong. Parallel van Herk/Gil-Werman image morphology on GPUs using CUDA [C]//. Proceedings of Conference Posters GTC, 2009

[13] SohY, AshrafH, HaeY, KimIntaek. Fast parallel connected component labeling algorithms using CUDA based on 8-directional label selection [J]. International Journal of Latest Research in Science and Technology, 2014, 3(2): 187-190

[14] WuK, OtooE, SuzukiK. Optimizing two-pass connected component labelling algorithms [J]. Pattern Analysis & Applications, 2009, 2: 117-135

[15] Wen-MeiW HwuGPU Computing Gems Emerald Edition [M], 20111-831

[16] KirkD B, Wen-MeiW H W UProgramming massively parallel processors: A hands-on approach [M], 20121-487