Distortion identification technique based on Hilbert-Huang transform in video stabilization

Abstract

A distortion identification technique is presented based on Hilbert-Huang transform to identify distortion model and distortion frequency of distorted real-world image sequences. The distortion model is identified simply based on Hilbert marginal spectral analysis after empirical mode decomposing. And distortion frequency is identified by analyzing the occurrence frequency of instantaneous frequency components of every intrinsic mode functions. Rational digital frequency filter with suitable cutoff frequency is designed to remove undesired fluctuations based on identification results. Experimental results show that this technique can identify distortion model and distortion frequency of displacement sequence accurately and efficiently. Based on identification results, distorted image sequence can be stabilized effectively.

Keywords

image sequence distortion / video stabilization / distortion model identification / distortion frequency identification / Hilbert-Huang transform

References

[1] Liu Yan, Zou Mouyan, Cao Ying et al. Dynamic displacement field model used as a new camera motion model in video stabilization[C]. In: Proceedings of International Conference on Consumer Electronics. Las Vegas, USA, 2007. 1–2.

[2] Liu Y., Zou Mouyan. Video stabilization technique for spatially variable distorted image sequence based on dynamic displacement field model[J]. Journal of the Graduate School of the Chinese Academy of Sciences, 2008, 25(1): 117-122.

[3] Chang H., Lai S., Lu Kuangrong. A robust and efficient video stabilization algorithm[C]. Proceedings of IEEE International Conference on Multimedia and Expo. Taipei, China, 2004, 1, 29-32.

[4] Zerafat Pisheh M A, Sheikhi A. Detection and compensation of image sequence jitter due to an unstable CCD camera for video tracking of a moving target[C]. In: Proceedings of the 2nd International Symposium on 3D Data Processing, Visualization and Transmission. Thessaloniki, Greece, 2004. 258–261.

[5] Pan J., Hu B., Zhang H. Q. Robust and accurate object tracking under various types of occlusions[J]. IEEE Trans on Circuits and Systems for Video Technology, 2008, 18(2): 223-236.

[6] Farsiu S., Elad M., Milanfar P. Multiframe demosaicing and super-resolution of color images[J]. IEEE Trans on Image Processing, 2006, 15(1): 141-159.

[7] Huang N. E., Shen Z., Long S. R., et al. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis[J]. Proceedings of the Royal Society of London Series A Mathematical Physical and Engineering Sciences, 1998, 454(1971): 903-995.

[8] Huang N. E., Wu M.-L. C., Long S. R., et al. A confidence limit for the empirical mode decomposition and Hilbert spectral analysis[J]. Proceedings of the Royal Society of London Series A Mathematical Physical and Engineering Sciences, 2003, 459(2037): 2317-2345.

[9] Stankovic L. A method for time-frequency analysis[J]. IEEE Trans on Signal Processing, 1994, 42(1): 225-229.

[10] Hlawatsch F., Boudreaux-Bartels G. F. Linear and quadratic time-frequency signal representations[J]. IEEE Signal Processing Magazine, 1992, 9(2): 21-67.

[11] Roy A., Chun-Hsien W., Doherty J. F., et al. Signal feature extraction from microbarograph observations using the Hilbert-Huang transform[J]. IEEE Trans on Geoscience and Remote Sensing, 2008, 46(5): 1442-1447.

[12] Messina A. R., Vittal V. Extraction of dynamic patterns from wide-area measurements using empirical orthogonal functions[J]. IEEE Trans on Power Systems, 2007, 22(2): 682-692.

[13] Wang H., Siu K., Ju K., et al. Identification of transient renal autoregulatory mechanisms using timefrequency spectral techniques[J]. IEEE Trans on Biomedical Engineering, 2005, 52(6): 1033-1039.

[14] Flandrin P., Rilling G., Goncalves P. Empirical mode decomposition as a filter bank[J]. IEEE Signal Processing Letters, 2004, 11(2): 112-114.

[15] Wu F. J., Qu L. S. An improved method for restraining the end effect in empirical mode decomposition and its applications to the fault diagnosis of large rotating machinery[J]. Journal of Sound and Vibration, 2008, 314(3–5): 586-602.

[16] Carlos M., Rama Chellappa. Evaluation of image stabilization algorithms[C]. Proceedings of IEEE International Conference on Acoustics, tSpeech and Signal Processing. Seattle, USA, 1998, 5, 2789-2792.

[17] Liu Yan, Zou Mouyan. Distortion identification technique in video stabilization[C]. In: Proceedings of International Conference on Consumer Electronics. Las Vegas, USA, 2009. 1–2.