Feature extraction for classification of different weather conditions

Abstract

Classification of different weather conditions provides a first step support for outdoor scene modeling, which is a core component in many different applications of outdoor video analysis and computer vision. Features derived from intrinsic properties of the visual effects of different weather conditions contribute to successful classification. In this paper, features representing both the autocorrelation of pixel-wise intensities over time and the max directional length of rain streaks or snowflakes are proposed. Based on the autocorrelation of each pixel’s intensities over time, two temporal features are used for coarse classification of weather conditions according to their visual effects. On the other hand, features are extracted for fine classification of video clips with rain and snow. The classification results on 249 video clips associated with different weather conditions indicate the effectiveness of the extracted features, by using C-SVM as the classifier.

Keywords

feature extraction / classification / rain / snow / illumination variation / weather condition / autocorrelation function

References

[1] Zhang B C, Gao Y S, Zhao S Q, Zhong B. Kernel similarity modeling of texture pattern flow for motion detection in complex background. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(1): 29-38

[2] Khan Z H, Gu I Y H, Backhouse A G. Robust visual object tracking using multi-mode anisotropic mean shift and particle filters. IEEE Transactions on Circuits and Systems for Video Technology, 2011, 21(1): 74-87

[3] Woo H, Jung Y M, Kim J G, Seo J K. Environmentally robust motion detection for video surveillance. IEEE Transactions on Image Processing, 2010, 19(11): 2838-2848

[4] Gouko M, Ito K. An action generation model by using time series prediction and its application to robot navigation. International Journal of Neural Systems, 2009, 19(2): 105-113

[5] Geetha M K, Palanivel S. A novel event-oriented segmentof-interest discovery method for surveillance video. International Journal of Computational Intelligence Systems, 2009, 2(1): 39-50

[6] Maddalena L, Petrosino A. Video classification and shot detection for video retrieval applications. IEEE Transactions on Image Processing, 2008, 17(7): 1168-1177

[7] Narasimhan S G, Nayar S K. Vision and the atmosphere. International Journal of Computer Vision, 2002, 48(3): 233-254

[8] Narasimhan S G, Nayar S K. Contrast restoration of weather degraded images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(6): 713-724

[9] Fattal R. Single image dehazing. In: Proceedings of International Conference on Computer Graphics and Interactive Techniques. 2008, 1-9

[10] He K, Sun J, Tang X. Single image haze removal using dark channel prior. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2009, 1956-1963

[11] Garg K, Nayar S K. Detection and removal of rain from videos. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 2004, 528-535

[12] Garg K, Nayar S K. Vision and rain. International Journal of Computer Vision, 2007, 75(1): 3-27

[13] Zhang X, Li H, Qi Y, Leow W, Ng T. Rain removal in video by combining temporal and chromatic properties. In: Proceedings of the International Conference on Multimedia and Expo. 2006, 461-464

[14] Barnum P, Kanade T, Narasimhan S G. Spatio-temporal frequency analysis for removing rain and snow from videos. In: Workshop on Photometric Analysis for Computer Vision. 2007

[15] Garg K, Nayar S K. When does a camera see rain? In: Proceedings of the Tenth IEEE International Conference on Computer Vision. 2005, 2: 1067-1074

[16] Li L, Huang W, Gu I Y, Tian Q. Statistical modeling of complex backgrounds for foreground object detection. IEEE Transactions on Image Processing, 2004, 13(11): 1459-1472

[17] Toyama K, Krumm J, Brumitt B, Meyers B. Wallflower: principles and practice of background maintenance. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. 1999, 256-261

[18] Fan J Q, Yao Q W. Nonlinear Time Series: Nonparametric and Parametric Methods. New York: Springer-Verlag, 2008

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg