Global point tracking based panoramic image stabilization system

Abstract

A novel image stabilization system is presented, which consists of a global feature point tracking based motion estimation, a Kalman filtering based motion smoothing and an image mosaic based panoramic compensation. The global motion is estimated using feature point matching and iteration with the least-square method. Then, the Kalman filter is applied to smooth the original motion vectors to effectively alleviate unwanted camera vibrations and follow the intentional camera scan. Lastly, the loss information of image boundary due to the motion compensation is reconstructed with image mosaic to improve the visual quality. The experimental results show that this system can smooth unwanted translation or rotation of the video sequences and realize a panoramic stabilization at real-time speed.

Keywords

Kalman Filter / Video Sequence / Global Motion / Panoramic Image / Image Mosaic

References

[1] VellaF., CastorinaA., MancusoM., MessinaG.. IEEE Transactions on Consumer Electronics, 2002, 48: 796

[2] KoS.-J., LeeS.-H., JeonS.-W., KangE.-S.. IEEE Transactions on Consumer Electronics, 1998, 44: 617

[3] ZhuJ.-j., GuoB.-l.. Journal of Optoelectronics·Laser, 2007, 18: 108

[4] C. Harris and M. Stephens, Proc. 4th Alvey Vision Conference [C]. Manchester, UK, 1988, 189.

[5] XiangY., GuoB.. Journal of Xidian University, 2003, 30: 386

[6] DingJ.-r., LiZ.-j., Jin-Wen. Optoelectronics Letters, 2007, 3: 0303

[7] ZhuJ., GuoB.. Chinese Optics Letters, 2006, 4: 553

[8] YangL.-m., GuoL.-h.. Optoelectronics Letters, 2007, 3: 0069

[9] WangX.-t., YangC.-q., XuX.-g.. Journal of Optoelectronics Laser, 2007, 18: 1367