In the saliency object detection task, a salient object detection method based on object integrity enhancement guided edge information is proposed to address the problems of blurred edges and object incompleteness in recognition results. Firstly, the diversity feature extraction module was proposed to capture the features of complex and variable salient objects through various convolutional operations, thereby enriching the feature representation of the model. Then, the object integrity enhancement module was designed to process the initial fused multi-level features in parallel, and the integrity information of salient objects was further enhanced by exploring spatial and channel branches. Finally, the edge feature enhancement module was employed to use the deep edge prediction features to guide the feature map to pay more attention to the foreground and background region and edge information, and to improve the model’s edge perception capability. Experiments on four public datasets, such as ECSSD and DUTS-TE, showed that the proposed algorithm achieved higher detection accuracy than other advanced algorithms in several metrics, such as S-measure and F-measure on DUTS-TE dataset were 0.859 and 0.895, respectively. The proposed algorithm demonstrated superior capability in the perception and refinement of salient object boundaries, further enhancing its robustness in complex scenes.
Acknowledgement
This work was supported by Priority Academic Program Development of Jiangsu Higher Education Institutions and the 111 Project (No. B12018)
Declaration of conflicting interests
The authors have no conflict of interests related to this publication.
| [1] |
HOYER L, MUNOZ M, KATIYAR P, et al. Grid saliency for context explanations of semantic segmentation. Advances in Neural Information Processing Systems, 2019, 32: 6462-6473.
|
| [2] |
ZHANG P, ZHUO T, HUANG W, et al. Online object tracking based on CNN with spatial-temporal saliency guided sampling. Neurocomputing, 2017, 257: 115-127.
|
| [3] |
ZHOU Y, MAO A L, HUO S W, et al. Salient object detection via fuzzy theory and object-level enhancement. IEEE Transactions on Multimedia, 2019, 21(1): 74-85.
|
| [4] |
LIN X, WANG Z J, MA L Z, et al. Saliency detection via multi-scale global cues. IEEE Transactions on Multimedia, 2019, 21(7): 1646-1659.
|
| [5] |
ZHANG P P, WANG D, LU H C, et al. Amulet: aggregating multi-level convolutional features for salient object detection//2017 IEEE International Conference on Computer Vision, October 22-29, 2017, Venice, Italy. New York: IEEE, 2017: 202-211.
|
| [6] |
ZHANG X N, WANG T T, QI J Q, et al. Progressive attention guided recurrent network for salient object detection//2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 18-23, 2018, Salt Lake City, UT, USA. New York: IEEE, 2018: 714-722.
|
| [7] |
ZHAO K, GAO S H, WANG W G, et al. Optimizing the F-measure for threshold-free salient object detection//2019 IEEE/CVF International Conference on Computer Vision, October 27-November 2, 2019. Seoul, Korea. New York: IEEE, 2019: 8849-8857.
|
| [8] |
LIU N, HAN J W, YANG M H. PiCANet: pixel-wise contextual attention learning for accurate saliency detection. IEEE Transactions on Image Processing, 2020, 29: 6438-6451.
|
| [9] |
FANG J S, TAO Y H, ZHU G P. Saliency detection from complex background with attention-based boundary-aware pyramid pooling network. SSRN Electronic Journal, 2022: 4098532.
|
| [10] |
QIN X B, ZHANG Z C, HUANG C Y, et al. BASNet: boundary-aware salient object detection//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 15-20, 2019, Long Beach, CA, USA. New York: IEEE, 2020: 7471-7481.
|
| [11] |
ZHOU H J, XIE X H, LAI J H, et al. Interactive two-stream decoder for accurate and fast saliency detection//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 13-19, 2020. Seattle, WA, USA. New York: IEEE, 2020: 9138-9147.
|
| [12] |
HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition//2016 IEEE Conference on Computer Vision and Pattern Recognition, June 27-30, 2016, Las Vegas, NV, USA. New York: IEEE, 2016: 770-778.
|
| [13] |
CHEN L C, PAPANDREOU G, SCHROFF F, et al. Rethinking atrous convolution for semantic image segmentation. 2017: arXiv: 1706.05587.
|
| [14] |
DING X H, GUO Y C, DING G G, et al. ACNet: strengthening the kernel skeletons for powerful CNN via asymmetric convolution blocks//2019 IEEE/CVF International Conference on Computer Vision, October 27-November 2, 2019. Seoul, Korea. New York: IEEE, 2019: 1911-1920.
|
| [15] |
ZHUGE M C, FAN D P, LIU N, et al. Salient object detection via integrity learning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(3): 3738-3752.
|
| [16] |
ZHAO J X, LIU J J, FAN D P, et al. EGNet: edge guidance network for salient object detection//2019 IEEE/CVF International Conference on Computer Vision, October 27-November 2, 2019. Seoul, Korea. New York: IEEE, 2019: 8779-8788.
|
| [17] |
CANNY J. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986, 8(6): 679-698.
|
| [18] |
WANG L J, LU H C, WANG Y F, et al. Learning to detect salient objects with image-level supervision//2017 IEEE Conference on Computer Vision and Pattern Recognition, July 21-26, 2017, Honolulu, HI, USA. New York: IEEE, 2017: 3796-3805.
|
| [19] |
YAN Q, XU L, SHI J P, et al. Hierarchical saliency detection//2013 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2013, Portland, OR, USA. New York: IEEE, 2013: 1155-1162.
|
| [20] |
LI Y, HOU X D, KOCH C, et al. The secrets of salient object segmentation//2014 IEEE Conference on Computer Vision and Pattern Recognition, June 23-28, 2014, Columbus, OH, USA. New York: IEEE, 2014: 280-287.
|
| [21] |
LI G B, YU Y Z. Visual saliency based on multiscale deep features//2015 IEEE Conference on Computer Vision and Pattern Recognition, June 7-12, 2015, Boston, MA, USA. New York: IEEE, 2015: 5455-5463.
|
| [22] |
FAN D P, CHENG M M, LIU Y, et al. Structure-measure: a new way to evaluate foreground maps//2017 IEEE International Conference on Computer Vision, October 22-29, 2017, Venice, Italy. New York: IEEE, 2017: 4558-4567.
|
| [23] |
ACHANTA R, HEMAMI S, ESTRADA F, et al. Frequency-tuned salient region detection//2009 IEEE Conference on Computer Vision and Pattern Recognition, June 20-25, 2009, Miami, FL, USA. New York: IEEE, 2009: 1597-1604.
|
| [24] |
FAN D P, GONG C, CAO Y, et al. Enhanced-alignment measure for binary foreground map evaluation. 2018: arXiv: 1805.10421.
|
| [25] |
WU Z, SU L, HUANG Q M. Cascaded partial decoder for fast and accurate salient object detection//2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 15-20, 2019, Long Beach, CA, USA. New York: IEEE, 2020: 3902-3911.
|
| [26] |
WEI J, WANG S H, HUANG Q M. F3Net: fusion, feedback and focus for salient object detection. Proceedings of the AAAI Conference on Artificial Intelligence, 2020, 34(7): 12321-12328.
|
| [27] |
PANG Y W, ZHAO X Q, ZHANG L H, et al. Multi-scale interactive network for salient object detection//2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition, June 13-19, 2020. Seattle, WA, USA. New York: IEEE, 2020: 9410-9419.
|
| [28] |
CHEN T Y, HU X G, XIAO J, et al. BPFINet: Boundary-aware progressive feature integration network for salient object detection. Neurocomputing, 2021, 451: 152-166.
|
| [29] |
MEI H Y, LIU Y Y, WEI Z Q, et al. Exploring dense context for salient object detection. IEEE Transactions on Circuits and Systems for Video Technology, 2022, 32(3): 1378-1389.
|
| [30] |
KE Y Y, TSUBONO T. Recursive contour-saliency blending network for accurate salient object detection//2022 IEEE/CVF Winter Conference on Applications of Computer Vision, January 3-8, 2022, Waikoloa, HI, USA. New York: IEEE, 2022: 1360-1370.
|
| [31] |
LIU J J, HOU Q B, LIU Z A, et al. PoolNet: exploring the potential of pooling for salient object detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023, 45(1): 887-904.
|
PDF
(30480KB)
