A survey on distributed compressed sensing: theory and applications

Abstract

The compressed sensing (CS) theory makes sample rate relate to signal structure and content. CS samples and compresses the signal with far below Nyquist sampling frequency simultaneously. However, CS only considers the intra-signal correlations, without taking the correlations of the multi-signals into account. Distributed compressed sensing (DCS) is an extension of CS that takes advantage of both the inter- and intra-signal correlations, which is wildly used as a powerful method for the multi-signals sensing and compression in many fields. In this paper, the characteristics and related works of DCS are reviewed. The framework of DCS is introduced. As DCS’s main portions, sparse representation, measurement matrix selection, and joint reconstruction are classified and summarized. The applications of DCS are also categorized and discussed. Finally, the conclusion remarks and the further research works are provided.

Keywords

compressed sensing / distributed compressed sensing / sparse representation / measurement matrix / joint reconstruction / joint sparsity model

References

[1] Donoho D L. Compressed sensing. IEEE Transactions on Information Theory, 2006, 52(4): 1289-1306

[2] Tsaig Y, Donoho D L. Extensions of compressed sensing. Signal processing, 2006, 86(3): 549-571

[3] Candès E J. Compressive sampling. In: Proceedings of the international congress of mathematicians. 2006, 1433-1452

[4] Lustig M, Donoho D, Pauly J. Rapid mr imaging with compressed sensing and randomly under-sampled 3DFT trajectories. In: Proceedings of the 14th Annual Meeting ISMRM. 2006

[5] Lustig M, Lee J H, Donoho D L, Pauly J M. Faster imaging with randomly perturbed, under-sampled spirals and l1 reconstruction. In: Proceedings of the 13th Annual Meeting of ISMRM. 2005, 685

[6] Lustig M, Santos J M, Lee J H, Donoho D L, Pauly J M. Application of compressed sensing for rapid MR imaging. In: Proceedings of Work. Struc. Parc. Rep. Adap. Signaux (SPARS). 2005

[7] Trzasko J, Manduca A. Highly undersampled magnetic resonance image reconstruction via homotopic-minimization. IEEE Transactions on Medical imaging, 2009, 28(1): 106-121

[8] Baraniuk R G. Single-pixel imaging via compressive sampling. IEEE Signal Processing Magazine, 2008

[9] Marcia R F, Harmany Z T, Willett R M. Compressive coded aperture imaging. In: IS&T/SPIE Electronic Imaging. 2009, 72460G-72460G

[10] Robucci R, Chiu L K, Gray J, Romberg J, Hasler P, Anderson D. Compressive sensing on a cmos separable transform image sensor. In: Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing. 2008, 5125-5128

[11] Yin H, Liu Z, Chai Y, Jiao X. A survey of compressed sensing. Control and Decision, 2013, 28(10): 1441-1445

[12] Baron D, Wakin M B, Duarte M F, Sarvotham S, Baraniuk R G. Distributed compressed sensing, 2005

[13] Slepian D, Wolf J K. Noiseless coding of correlated information sources. IEEE Transactions on Information Theory, 1973, 19(4): 471-480

[14] Tropp J A, Gilbert A C, Strauss M J. Simultaneous sparse approxi mation via greedy pursuit. In: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. 2005, 721-724

[15] Hu H, Yang Z. Spatial correlation-based distributed compressed sensing in wireless sensor networks. In: Proceedings of the 2010 6th International Conference onWireless Communications Networking and Mobile Computing (WiCOM). 2010, 1-4

[16] Yang H, Huang L, Xu H, Liu A. Distributed compressed sensing in wireless local area networks. International Journal of Communication Systems, 2013

[17] Golbabaee M, Vandergheynst P. Distributed compressed sensing for sensor networks using thresholding. In: Proceedings of the SPIE Optical Engineering and Applications. 2009

[18] Liu Y, Zhu X, Zhang L, Cho S H. Distributed compressed video sensing in camera sensor networks. International Journal of Distributed Sensor Networks, 2012, Artide 352167

[19] Puri R, Ramchandran K. Prism: A new robust video coding architecture based on distributed compression principles. In: Proceedings of the Annual Allerton Conference on Communication Control and Computing. 2002, 586-595

[20] Hu H F, Yang Z. An energy-efficient distributed compressed sensing architecture for wireless sensor networks based on a distributed wavelet compression algorithm. In: Proceedings of the 2011 International Conference on Wireless Communications and Signal Processing. 2011

[21] Wang Q, Liu Z. A novel distributed compressed sensing algorithm for multichannel electrocardiography signals. In: Proceedings of 2011 4th International Conference on Biomedical Engineering and Informatics. 2011, 607-611

[22] Prades-Nebot J, Ma Y, Huang T. Distributed video coding using compressive sampling. In: Proceedings of the 2009 Picture Coding Symposium. 2009, 1-4

[23] Do T T, Chen Y, Nguyen D T, Nguyen N, Gan L, Tran T D. Distributed compressed video sensing. In: Proceedings of the 16th IEEE International Conference on Image Processing (ICIP). 2009, 1393-1396

[24] Kang L W, Lu C S. Distributed compressive video sensing. In: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. 2009, 1169-1172

[25] Yu D, Wang A, Zhao M. A multiple description distributed compressed video sensing for robust transmission. In: Proceedings of 2012 International Conference on Computing, Measurement, Control and Sensor Network. 2012, 13-16

[26] Baron D, Duarte M F, Sarvotham S, Wakin M B, Baraniuk R G. An information-theoretic approach to distributed compressed sensing. In: Proceedings of the 45rd Conference on Communication, Control, and Computing. 2005

[27] Duarte M F, Sarvotham S, Baron D, Wakin M B, Baraniuk R G. Distributed compressed sensing of jointly sparse signals. In: Proceedings of Asilomar Conf. Signals, Sys., Comput. 2005, 1537-1541

[28] Wakin M B, Duarte M F, Sarvotham S, Baron D, Baraniuk R G. Recovery of jointly sparse signals from few random projections. In: Proceedings of Neural Information Processing Systems Foundation. 2005

[29] Phan A H, Cichocki A, Nguyen K S. Simple and efficient algorithm for distributed compressed sensing. In: Proceedings of the 2008 IEEE Workshop on Machine Learning for Signal Processing. 2008, 61-66

[30] Zhang W, Ma C, Wang W, Liu Y, Zhang L. Side information based orthogonal matching pursuit in distributed compressed sensing. In: Proceedings of the 2nd IEEE International Conference on Network Infrastructure and Digital Content. 2010, 80-84

[31] Vinuelas-Peris P, Artes-Rodriguez A. Bayesian joint recovery of correlated signals in distributed compressed sensing. In: Proceedings of the 2nd International Workshop on Cognitive Information Processing (CIP). 2010, 382-387

[32] Yu N, Qiu T, Bi F, Wang A. Image features extraction and fusion based on joint sparse representation. IEEE Journal of Selected Topics in Signal Processing, 2011, 5(5): 1074-1082

[33] Tan Y, Xu W, He Z, Tian B, Wang D. Mimo-ofdm channel estimation based on distributed compressed sensing and kalman filter. In: Proceedings of the 2011 IEEE International Conference on Signal Processing, Communications and Computing. 2011

[34] Nagesh P, Li B. A compressive sensing approach for expressioninvariant face recognition. In: Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. 2009, 1518-1525

[35] Cheng H, Liu Z, Yang L, Chen X. Sparse representation and learning in visual recognition: theory and applications. Signal Processing, 2013, 93(6): 1408-1425

[36] Ma X, Quang Luong H, Philips W, Song H, Cui H. Sparse representation and position prior based face hallucination upon classified overcomplete dictionaries. Signal Processing, 2012, 92(9): 2066-2074

[37] Donoho D L, Flesia A G. Can recent innovations in harmonic analysisexplain’key findings in natural image statistics? Network: Computation in Neural Systems, 2001, 12(3): 371-393

[38] Chew W, Song J. Fast fourier transform of sparse spatial data to sparse fourier data. In: Proceedings of IEEE Antennas and Propagation Society, AP-S International Symposium (Digest). 2000, 2324-2327

[39] Nawab S H, Dorken E. Efficient stft approximation using a quantization and differencing method. In: Proceedings of the 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing. 1993, 587-590

[40] Selesnick I W. Sparse signal representations using the tunable q-factor wavelet transform. In: Proceedings of SPIE Optical Engineering and Applications. 2011

[41] Donoho D L. Wedgelets: nearly minimax estimation of edges. The Annals of Statistics, 1999, 27(3): 859-897

[42] Meyer F G, Coifman R R. Brushlets: a tool for directional image analysis and image compression. Applied and computational harmonic analysis, 1997, 4(2): 147-187

[43] Huo X, Donoho D. Beamlets and multiscale image analysis. Multiscale and Multiresolution Methods, 2002, 149-196

[44] Le Pennec E, Mallat S. Image compression with geometrical wavelets. In: Proceedings of the 2000 International Conference on Image Processing. 2000, 661-664

[45] Candes E J, Donoho D L. Ridgelets: A key to higher-dimensional intermittency. Philosophical Transactions of the Royal Society, 1999, 357(1760): 2495-2509

[46] Donoho D L. Orthonormal ridgelets and linear singularities. SIAM Journal on Mathematical Analysis, 2000, 31(5): 1062-1099

[47] Candes E J, Donoho D L. Curvelets: A Surprisingly Effective Non adaptive Representation for Objects With Edges. Technical report, DTIC Document. 2000

[48] Do M N, Vetterli M. Contourlets. Studies in Computational Mathematics, 2003, 10: 83-105

[49] Fong H, Zhang Q, Wei S. Image reconstruction based on sub-gaussian random projection. In: Proceedings of the 4th International Conference on Image and Graphics. 2007, 210-214

[50] Candes E J, Tao T. Near-optimal signal recovery from random projections: Universal encoding strategies? IEEE Transactions on Information Theory, 2006, 52(12): 5406-5425

[51] Bi X, Chen X D, Zhang Y, Liu B. Image compressed sensing based on wavelet transform in contourlet domain. Signal Processing, 2011, 91(5): 1085-1092

[52] Yin H, Li S. Multimodal image fusion with joint sparsity model. Optical Engineering, 2011, 50(6): 067007-067007

[53] Engan K, Aase S O, Husøy J H. Multi-frame compression: theory and design. Signal Processing, 2000, 80(10): 2121-2140

[54] Aharon M, Elad M, Bruckstein A. K-svd: An algorithm for designing overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing, 2006, 54(11): 4311-4322

[55] Rubinstein R, Bruckstein A M, Elad M. Dictionaries for sparse representation modeling. Proceedings of the IEEE, 2010, 98(6): 1045-1057

[56] Dong W, Li X, Zhang D, Shi G. Sparsity-based image denoising via dictionary learning and structural clustering. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2011, 457-464

[57] Baraniuk R, Davenport M, DeVore R, Wakin M. A simple proof of the restricted isometry property for random matrices. Constructive Approximation, 2008, 28(3): 253-263

[58] Candes E J. The restricted isometry property and its implications for compressed sensing. Comptes Rendus Mathematique, 2008, 346(9): 589-592

[59] Candès E J, Romberg J, Tao T. Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information. IEEE Transactions on Information Theory, 2006, 52(2): 489-509

[60] Candes E J, Romberg J K, Tao T. Stable signal recovery from incomplete and inaccurate measurements. Communications on pure and applied mathematics, 2006, 59(8): 1207-1223

[61] Haghighatshoar S, Abbe E, Telatar E. Adaptive sensing using deterministic partial hadamard matrices. In: Proceedings of the 2012 IEEE International Symposium on Information Theory Proceedings (ISIT). 2012, 1842-1846

[62] Yin W, Morgan S, Yang J, Zhang Y. Practical compressive sensing with toeplitz and circulant matrices. In: Proceedings of the 2010 Visual Communications and Image Processing. 2010, Article 77440K

[63] Bajwa W U, Haupt J D, Raz G M, Wright S J, Nowak R D. Toeplitzstructured compressed sensing matrices. In: Proceedings of IEEE/SP 14th Workshop on Statistical Signal Processing. 2007, 294-298

[64] Sebert F, Zou Y M, Ying L. Toeplitz block matrices in compressed sensing and their applications in imaging. In: Proceedings of the 2008 International Conference on Information Technology and Applications in Biomedicine. 2008, 47-50

[65] Rauhut H. Circulant and Toeplitz Matrices in Compressed Sensing. arXiv.ovg>cs>arXiv:0902.4394. 2009

[66] Li Z, Wu X, Peng H. Nonnegative matrix factorization on orthogonal subspace. Pattern Recognition Letters, 2010, 31(9): 905-911

[67] Applebaum L, Howard S D, Searle S, Calderbank R. Chirp sensing codes: deterministic compressed sensing measurements for fast recovery. Applied and Computational Harmonic Analysis, 2009, 26(2): 283-290

[68] Romberg J. Sensing by random convolution. In: Proceedings of the 2nd IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing. 2007, 137-140

[69] Wang K, Chen J Z, Zhu Y G, Niu Y T. Comparison and analysis of the performance on measurement matrix to spectrum estimation. In: Proceedings of the 2012 National Conference on Information Technology and Computer Science. 2012, 1034-1037

[70] Haupt J, Bajwa W U, Raz G, Nowak R. Toeplitz compressed sensing matrices with applications to sparse channel estimation. IEEE Transactions on Information Theory, 2010, 56(11): 5862-5875

[71] Wang K, Liu Y, Chen S. Measurement matrix in compressed sensing of ir-uwb signal. In: Proceedings of the 2012 International Conference on Systems and Informatics (ICSAI). 2012, 2084-2088

[72] Sun R, Zhao H, Xu H. The application of improved hadamard measurement matrix in compressed sensing. In: Proceedings of the 2012 International Conference on Systems and Informatics. 2012, 1994-1997

[73] Yu Y, Petropulu A P, Poor H V. Measurement matrix design for compressive sensing-based mimo radar. IEEE Transactions on Signal Processing, 2011, 59(11): 5338-5352

[74] Mishali M, Elron A, Eldar Y C. Sub-nyquist processing with the modulated wideband converter. In: Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). 2010, 3626-3629

[75] Mishali M, Eldar Y C, Elron A J. Xampling: Signal acquisition and processing in union of subspaces. IEEE Transactions on Signal Processing, 2011, 59(10): 4719-4734

[76] Mishali M, Eldar Y C. Expected rip: conditioning of the modulated wideband converter. In: Proceedings of the 2009 Information Theory Workshop. 2009, 343-347

[77] Chen Y, Mishali M, Eldar Y C, Hero A O. Modulated wideband converter with non-ideal lowpass filters. In: Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). 2010, 3630-3633

[78] Chen Y, Xiao G. Fusion of infrared and visible images based on distributed compressive sensing. In: Proceedings of WAP Conference Series: Information Science and Technology

[79] Luo J, Yang B, Chen Z. Color image restoration via extended joint sparse model. In: Proceedings of Communications in Computer and Information Science, Pattern Recognition. 2012, 321: 497-504

[80] Roy O, Hormati A, Lu Y M, Vetterli M. Distributed sensing of signals linked by sparse filtering. In: Proceedings of the 2009 IEEE International Conference on Acoustics, Speech and Signal Processing. 2009, 2409-2412

[81] Hormati A, Roy O, Lu Y M, Vetterli M. Distributed sampling of signals linked by sparse filtering: theory and applications. IEEE Transactions on Signal Processing, 2010, 58(3): 1095-1109

[82] Wang X, Fang H, Zhu X, Li B, Liu Y. Sparse filter correlation model based joint reconstruction in distributed compressive video sensing. In: Proceedings of the 2nd IEEE International Conference on Network Infrastructure and Digital Content. 2010, 483-487

[83] Wang H Q, Zhu X H, Li Y S. Parameter estimation for transmit diversity mimo radar based on distributed compressed sensing. Systems Engineering and Electronics, 2012, 34(12): 2463-2467

[84] Kang J, Tang L, Zuo X, Li A, Li H. Distributed compressed sensingbased data fusion in sensor networks. In: Proceedings of the 1st International Conference on Pervasive Computing Signal Processing and Applications (PCSPA). 2010, 1083-1086

[85] Li Z L, Chen H J, Yao C, Li J P. Compressed sensing reconstruction algorithm based on spectral projected gradient pursuit. Acta Automatica Sinica, 2012, 38(7): 1218-1223 (in Chinese)

[86] Mallat S G, Zhang Z. Matching pursuits with time-frequency dictionaries. IEEE Transactions on Signal Processing, 1993, 41(12): 3397-3415

[87] Tropp J A, Gilbert A C. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Transactions on Information Theory, 2007, 53(12): 4655-4666

[88] Fang H, Yang H R. Greedy algorithms and compressed sensing. Acta Automatica Sinica, 2011, 37(12): 1413-1421 (in Chinese)

[89] Gilbert A C, Strauss M J, Tropp J A, Vershynin R. Algorithmic linear dimension reduction in the l_1 norm for sparse vectors. In: Proceedings of the 44th Annual Allerton Conference Communication Contron and Computing. 2006

[90] Schnelle S R, Laska J N, Hegde C, Duarte M F, Davenport M A, Baraniuk R G. Texas hold’em algorithms for distributed compressive sensing. In: Proceedings of the 2010 IEEE International Conference on Acoustics Speech and Signal Processing (ICASSP). 2010, 2886-2889

[91] Hormati A, Vetterli M. Distributed compressed sensing: Sparsity models and reconstruction algorithms using annihilating filter. In: Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing. 2008, 5141-5144

[92] Liang J, Liu Y, Zhang W, Xu Y, Gan X, Wang X. Joint compressive sensing in wideband cognitive networks. In: Proceedings of the 2010 Wireless Communications and Networking Conference (WCNC). 2010, 1-5

[93] Davenport M A, Boufounos P T, Baraniuk R G. Compressive domain interference cancellation. Technical report, DTIC Document. 2009

[94] Xu W, Lin J, Niu K, He Z. A joint recovery algorithm for distributed compressed sensing. Transactions on Emerging Telecommunications Technologies, 2012, 23(6): 550-559

[95] Sundman D, Saikat C, Skoglund M. A greedy pursuit algorithm for distributed compressed sensing. In: Proceedings of the 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). 2012, 2729-2732

[96] Shen M, Zhang Q, Yang J. A novel receive beamforming approach of ultrasound signals based on distributed compressed sensing. In: Proceedings of Instrumentation and Measurement Technology Conference (I2MTC). 2011, 1-5

[97] Wang X, Guo W, Lu Y, Wang W. Distributed compressed sensing for block-sparse signals. In: Proceedings of the 2011 IEEE 22nd International Symposium on Personal Indoor and Mobile Radio Communications (PIMRC). 2011, 695-699

[98] Donoho D L. High-dimensional centrally symmetric polytopes with neighborliness proportional to dimension. Discrete & Computational Geometry, 2006, 35(4): 617-652

[99] Do T T, Gan L, Nguyen N, Tran T D. Sparsity adaptive matching pursuit algorithm for practical compressed sensing. In: Proceedings of the 42nd Asilomar Conference Signals, Systems and Computers. 2008, 581-587

[100] Wang Q, Liu Z. A robust and efficient algorithm for distributed compressed sensing. Computers & Electrical Engineering, 2011, 37(6): 916-926

[101] Ndjiki-Nya P, Doshkov D, Kaprykowsky H, Zhang F, Bull D, Wiegand T. Perception-oriented video coding based on image analysis and completion: a review. Signal Processing: Image Communication, 2012, 27(6): 579-594

[102] Yick J, Mukherjee B, Ghosal D. Wireless sensor network survey. Computer networks, 2008, 52(12): 2292-2330

[103] Rahman S M, Ahmad M O, Swamy M. Contrast-based fusion of noisy images using discrete wavelet transform. Image Processing, IET, 2010, 4(5): 374-384

[104] Yang A Y, Maji S, Hong K, Yan P, Sastry S S. Distributed compression and fusion of nonnegative sparse signals for multiple-view object recognition. In: Proceedings of the 12th International Conference on Information Fusion. 2009, 1867-1874

[105] Wang W G, Yang Z, Hu H F. The method of achieving simultaneous channels estimation on distributed compressed sensing. Signal Processing (Xinhao Chuli), 2012, 28(6): 778-784 (in Chinese)

[106] Wang D H, Niu K, He Z Q, Tian B Y. Channel estimation based on distributed compressed sensing in amplify-and-forward relay networks. The Journal of China Universities of Posts and Telecommunications, 2010, 17(5): 44-49

[107] Corroy S, Mathar R. Distributed compressed sensing for the mimo mac with correlated sources. In: Proceedings of the 2012 IEEE International Conference on Communications (ICC). 2012, 2516-2520

[108] Li Y, Song R. A new compressive feedback scheme based on distributed compressed sensing for time-correlated mimo channel. KSII Transactions on Internet & Information Systems, 2012, 6(2)

[109] Prunte L. Application of distributed compressed sensing for gmti purposes. In: Proceedings of IET International Conference on Radar Systems (Radar 2012). 2012, 1-6

[110] Wu D, Zhu W P, Swamy M. Compressive sensing-based speech enhancement in non-sparse noisy environments. IET Signal Processing, 2013, 7(5): 450-457

RIGHTS & PERMISSIONS

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg