Complete focal plane compression based on CMOS image sensor using predictive coding

Abstract

In this paper, a CMOS image sensor (CIS) is proposed, which can accomplish both decorrelation and entropy coding of image compression directly on the focal plane. The design is based on predictive coding for image decorrelation. The predictions are performed in analog domain by 2×2 pixel units. Both the prediction residuals and original pixel values are quantized and encoded in parallel. Since the residuals have a peak distribution around zero, the output codewords can be replaced by the valid part of the residuals’ binary mode. The compressed bit stream is accessible directly at the output of CIS without extra disposition. Simulation results show that the proposed approach achieves a compression rate of 2.2 and PSNR of 51 on different test images.

Keywords

CMOS image sensor / focal plane compression / predictive coding / entropy coder

References

[1] Posch C, Serrano-Gotarredona T, Linares-Barranco B, et al. Retinomorphic event-based vision sensors: Bioinspired cameras with spiking output[J]. Proceedings of the IEEE, 2014, 102(10): 1470-1484.

[2] Park J-H, Aoyama S, Watanabe T, et al. A high-speed lownoise CMOS image sensor with 13-b column-parallel single-ended cyclic ADCs[J]. IEEE Transactions on Electron Devices, 2009, 56(11): 2414-2422.

[3] Yao S, Nie K, Zhao Shibin. Design of lowpower DPGA used in CMOS image sensor[J]. Journal of Tianjin University, 2011, 44(10): 865-871.

[4] Oike Y, El Gamal A. CMOS image sensor with per-column ΣΔ ADC and programmable compressed sensing[J]. IEEE Journal of Solid-State Circuits, 2013, 48(1): 318-328.

[5] Nilchi A, Aziz J, Genov R. Focal-plane algorithmically-multiplying CMOS computational image sensor[J]. IEEE Journal of Solid-State Circuits, 2009, 44(6): 1829-1839.

[6] Kawahito S, Yoshida M, Sasaki M, et al. A CMOS image sensor with analog two-dimensional DCT-based compression circuits for one-chip cameras[J]. IEEE Journal of Solid-State Circuits, 1997, 32(12): 2030-2041.

[7] Lin Z, Hoffman M W, Leon W D, et al. A CMOS front-end for a lossy image compression sensor[C]. IEEE International Symposium on Circuits and Systems, 2007.

[8] Oliveira F D V R, Haas H L, Gomes J G R C, et al. CMOS imager with focal-plane analog image compression combining DPCM and VQ[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2013, 60(5): 1331-1344.

[9] Olyaei A, Genov R. Focal-plane spatially oversampling CMOS image compression sensor[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2007, 54(1): 26-34.

[10] Cardoso B B, Gomes J G R C. CMOS imager with focalplane image compression based on the EZW algorithm[ C]. IEEE Symposium on Circuits and Systems (LASCAS). Santiago, Chile, 2014.

[11] Leon D, Balkir S, Sayood K, et al. A CMOS imager with pixel prediction for image compression[C]. International Symposium on Circuits and Systems. Bangkok, Thailand, 2003.

[12] Wang H T, Leon-Salas W D. A multiresolution algorithm for focal-plane compression[C]. IEEE International Symposium on Circuits and Systems. Seoul, Republic of Korea, 2012.

[13] Lin Z, Hoffman M W, Schemm N, et al. A CMOS image sensor for multi-level focal plane image decomposition[J]. IEEE Transactions on Circuits and Systems I: Regular Papers, 2008, 55(9): 2561-2572.

[14] Leon-Salas W D, Balkir S, Sayood K, et al. A CMOS imager with focal plane compression using predictive coding[J]. IEEE Journal of Solid-State Circuits, 2007, 42(11): 2555-2572.

[15] Effros M, Chou P A, Riskin E A, et al. A progressive universal noiseless coder [J]. IEEE Transactions on Information Theory, 1994, 40(1): 108-117.