Discriminatively learning for representing local image features with quadruplet model

Abstract

Traditional hand-crafted features for representing local image patches are evolving into current data-driven and learning-based image feature, but learning a robust and discriminative descriptor which is capable of controlling various patch-level computer vision tasks is still an open problem. In this work, we propose a novel deep convolutional neural network (CNN) to learn local feature descriptors. We utilize the quadruplets with positive and negative training samples, together with a constraint to restrict the intra-class variance, to learn good discriminative CNN representations. Compared with previous works, our model reduces the overlap in feature space between corresponding and non-corresponding patch pairs, and mitigates margin varying problem caused by commonly used triplet loss. We demonstrate that our method achieves better embedding result than some latest works, like PN-Net and TN-TG, on benchmark dataset.

Keywords

A

References

[1] Molton N., Davison A. J., Reid I.. Locally Planar Patch Features for Real-Time Structure from Motion. 20041

[2] Seitz S. M., Curless B., Diebel J., Scharstein D., Szeliski R.. A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms. 2006519

[3] Szeliski R.. Foundations and Trends in Computer Graphics and Vision. 2006, 2: 1

[4] Lowe D. G.. International Journal of Computer Vision. 2004, 60: 91

[5] Bay H., Ess A., Tuytelaars T., Van Gool L.. Computer Vision and Image Understanding. 2008, 110: 346

[6] Simo-Serra E., Trulls E., Ferraz L., Kokkinos I., Fna P., Moreno-Noguer F.. Discriminative Learning of Deep Convolutional Feature Point Descriptors. 2015118

[7] Zagoruyko S., Komodakis N.. Learning to Compare Image Patches via Convolutional Neural Networks. 20154353

[8] Balntas V., Johns E., Tang L., Mikolajczyk K.. PN-Net: Conjoined Triple Deep Network for Learning Local Image Descriptors. 2016

[9] Kumar B. G. V., Carneiro G., Reid I.. Learning Local Image Descriptors with Deep Siamese and Triplet Convolutional Networks by minimising global loss Functions. 20165385

[10] Jia Y., Shelhamer E., Donahue J., Karayev S., Long J., Girshick R., Guadarrama S., Darrell T.. Caffe: Convolutional Architecture for Fast Feature Embedding. 2014

[11] Brown M., Hua G., Winder S.. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2011, 33: 43

[12] Simonyan K., Vedaldi A., Zisserman A.. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2014, 36: 1573