Factors affecting forensic electric network frequency matching-A comprehensive study

Abstract

The power system frequency fluctuations could be captured by digital recordings and extracted to compare with a reference database for forensic timestamp verification. It is known as the Electric Network Frequency (ENF) criterion, enabled by the properties of random fluctuations and intra-grid consistency. In essence, this is a task of matching a short random sequence within a long reference, whose accuracy is mainly concerned with whether this match could be uniquely correct. In this paper, we comprehensively analyze the factors affecting the reliability of ENF matching, including the length of test recording, length of reference, temporal resolution, and Signal-to-Noise Ratio (SNR). For synthetic analysis, we incorporate the first-order AutoRegressive (AR) ENF model and propose an efficient Time-Frequency Domain noisy ENF synthesis method. Then, the reliability analysis schemes for both synthetic and real-world data are respectively proposed. Through a comprehensive study, we quantitatively reveal that while the SNR is an important external factor to determine whether timestamp verification is viable, the length of test recording is the most important inherent factor, followed by the length of reference. However, the temporal resolution has little impact on performance. Finally, a practical workflow of the ENF-based audio timestamp verification system is proposed, incorporating the discovered results.

Keywords

Digital forensics / Audio forensics / Data authentication / Timestamp verification / Electric network frequency criterion

References

[1] R.C. Maher, Audio forensic examination: authenticity, enhancement and interpretation, IEEE Signal Process. Mag. 2 (2) (2009) 84-94.

[2] S. Gupta, S. Cho, C.-C.J. Kuo, Current developments and future trends in audio authentication, IEEE Multimedia 19 (1) (2012) 50-59.

[3] C. Grigoras, Digital audio recordings analysis: the electric network frequency (ENF) criterion, Int. J. Speech Lang. Law 12 (1) (2005) 63-76.

[4] S. Vatansever, A.E. Dirik, N. Memon, Detecting the presence of ENF signal in digital videos: a superpixel-based approach, IEEE Signal Process. Lett. 24 (10) (2017) 1463-1467.

[5] Z. Zhong, C. Xu, B.J. Billian, L. Zhang, S.S. Tsai, R.W. Conners, V.A. Centeno, A.G. Phadke, Y. Liu, Power system frequency monitoring network (FNET) implementation, IEEE Trans. Power Syst. 20 (4) (2005) 1914-1921.

[6] Y. Zhang, P. Markham, T. Xia, L. Chen, Y. Ye, Z. Wu, Z. Yuan, L. Wang, J. Bank, J. Burgett, R.W. Conners, Y. Liu, Wide-area frequency monitoring network (FNET) architecture and applications, IEEE Trans. Smart Grid 1 (2) (2010) 159-167.

[7] J. Dong, X. Ma, S.M. Djouadi, H. Li, Y. Liu, Frequency prediction of power systems in FNET based on state-space approach and uncertain basis functions, IEEE Trans. Power Syst. 29 (6) (2014) 2602-2612.

[8] Y. Yao, S. Xiong, H. Qi, Y. Liu, L.M. Tolbert, Q. Cao, Efficient histogram estimation for smart grid data processing with the loglog-bloom-filter, IEEE Trans. Smart Grid 6 (1) (2015) 199-208.

[9] Y. Liu, L. Zhan, Y. Zhang, P.N. Markham, D. Zhou, J. Guo, Y. Lei, G. Kou, W. Yao, J. Chai, Y. Liu, Wide-area-measurement system development at the distribution level: an FNET/GridEye example, IEEE Trans. Power Deliv. 31 (2) (2016) 721-731.

[10] Y. Liu, Z. Yuan, P.N. Markham, R.W. Conners, Y. Liu, Application of power system frequency for digital audio authentication, IEEE Trans. Power Deliv. 27 (4) (2012) 1820-1828.

[11] A.J. Cooper, An automated approach to the electric network frequency (ENF) criterion: theory and practice, Int. J. Speech Lang. Law 16 (2) (2009) 193-218.

[12] M. Huijbregtse, Z. Geradts, Using the ENF criterion for determining the time of recording of short digital audio recordings, in: Proc. 3rd IWCF, vol. 1, 2009, pp. 116-124.

[13] G. Hua, J. Goh, V.L.L. Thing, A dynamic matching algorithm for audio timestamp identification using the ENF criterion, IEEE Trans. Inf. Forensics Secur. 9 (7) (2014) 1045-1055.

[14] L. Zheng, Y. Zhang, C.E. Lee, V.L.L. Thing,Time-of-recording estimation for audio recordings, in:Proceedings of Digital Forensic Research Conference (DFRWS US), 2017, pp. 1-11.

[15] G. Hua, Error analysis of forensic ENF matching, in: 2018 IEEE International Workshop on Information Forensics and Security (WIFS), 2018, pp. 1-7.

[16] J. Chai, L. Y, Z. Yuan, R.W. Conners, Y. Liu, Tampering detection of digital recordings using electric network frequency and phase angle, in: Audio Engineering Society Convention 135, 2013, 1-1.

[17] D.P.N. Rodríguez, J.A. Apolinario, L.W.P. Biscainho, Audio authenticity: detecting ENF discontinuity with high precision phase analysis, IEEE Trans. Inf. Forensics Secur. 5 (3) (2010) 534-543.

[18] P. Esquef, J.A. Apolinario, L. Biscainho, Edit detection in speech recordings via instantaneous electric network frequency variations, IEEE Trans. Inf. Forensics Secur. 9 (12) (2014) 2314-2326.

[19] P.A.A. Esquef, J.A. Apolinário, L.W.P. Biscainho, Improved edit detection in speech via enf patterns, in: 2015 IEEE International Workshop on Information Forensics and Security (WIFS), 2015, pp. 1-6.

[20] P.M.G.I. Reis, J.P.C. Lustosa da Costa, R.K. Miranda, G. Del Galdo, ESPRIT-Hilbert-based audio tampering detection with SVM classifier for forensic analysis via electrical network frequency, IEEE Trans. Inf. Forensics Secur. 12 (4) (2017) 853-864.

[21] G. Hua, Y. Zhang, J. Goh, V.L.L. Thing, Audio authentication by exploring the absolute-error-map of ENF signals, IEEE Trans. Inf. Forensics Secur. 11 (5) (2016) 1003-1016.

[22] M. Mao, Z. Xiao, X. Kang, X. Li, L. Xiao, Electric network frequency based audio forensics using convolutional neural networks, in: G. Peterson, S. Shenoi (Advances in Digital Forensics XVI,Eds.), Springer International Publishing, 2020, pp. 253-270.

[23] C.W. Wong, A. Hajj-Ahmad, M. Wu,Invisible geo-location signature in a single image, in: Proc. 2018 IEEE Int. Conf. Acoustics Speech and Signal Processing (ICASSP), 2018, pp. 1987-1991.

[24] A. Hajj-Ahmad, R. Garg, M. Wu, ENF-based region-of-recording identification for media signals, IEEE Trans. Inf. Forensics Secur. 10 (6) (2015) 1125-1136.

[25] W. Yao, J. Zhao, M.J. Till, S. You, Y. Liu, Y. Cui, Y. Liu, Source location identification of distribution-level electric network frequency signals at multiple geographic scales, IEEE Access 5 (2017) 11166-11175.

[26] A. Hajj-Ahmad, A. Berkovich, M. Wu, Exploiting power signatures for camera forensics, IEEE Signal Process. Lett. 23 (5) (2016) 713-717.

[27] L. Fu, P.N. Markham, R.W. Conners, Y. Liu, An improved discrete Fourier transform-based algorithm for electric network frequency extraction, IEEE Trans. Inf. Forensics Secur. 8 (7) (2013) 1173-1181.

[28] O. Ojowu, J. Karlsson, J. Li, Y. Liu, ENF extraction from digital recordings using adaptive techniques and frequency tracking, IEEE Trans. Inf. Forensics Secur. 7 (4)(2012) 1330-1338.

[29] L. Dosiek, Extracting electrical network frequency from digital recordings using frequency demodulation, IEEE Signal Process. Lett. 22 (6) (2015) 691-695.

[30] D. Bykhovsky, A. Cohen, Electrical network frequency (ENF) maximum likelihood estimation via a multitone harmonic model, IEEE Trans. Inf. Forensics Secur. 8 (5)(2013) 744-753.

[31] X. Lin, X. Kang, Robust electric network frequency estimation with rank reduction and linear prediction, ACM Trans. Multimed Comput. Commun. Appl 14 (4) (2018), 84:1-84:13.

[32] A. Hajj-Ahmad, R. Garg, M. Wu, Spectrum combining for ENF signal estimation, IEEE Signal Process. Lett. 20 (9) (2013) 885-888.

[33] G. Hua, G. Bi, V.L.L. Thing, On practical issues of electric network frequency based audio forensics, IEEE Access 5 (2017) 20640-20651.

[34] A. Hajj-Ahmad, C. Wong, S. Gambino, Q. Zhu, M. Yu, M. Wu, Factors affecting ENF capture in audio, IEEE Trans. Inf. Forensics Secur. 14 (2) (2019) 277-288.

[35] S. Vatansever, A.E. Dirik, N. Memon, Analysis of rolling shutter effect on ENF based video forensics, IEEE Trans. Inf. Forensics Secur. 14 (9) (2019) 2262-2275.

[36] C. Grigoras, Applications of ENF criterion in forensic audio, video computer and telecommunication analysis, Forensic Sci. Int. 167 (2-3) (2007) 136-145.

[37] Y. Liu, Z. Yuan, P.N. Markham, R.W. Conners, Y. Liu, Wide-area frequency as a criterion for digital audio recording authentication, in: Proc. IEEE Power and Energy Soc. General Meeting, 2011, pp. 1-7.

[38] M.M. Elmesalawy, M.M. Eissa, New forensic ENF reference database for media recording authentication based on harmony search technique using GIS and wide area frequency measurements, IEEE Trans. Inf. Forensics Secur. 9 (4) (2014) 633-644.

[39] R. Garg, A.L. Varna, M. Wu, Modeling and analysis of electric network frequency signal for timestamp verification, in: Proc. IEEE Int. WIFS, 2012, pp. 67-72.

[40] R. Garg, A.L. Varna, A. Hajj-Ahmad, M. Wu, Seeing ENF: power signature based timestamp for digital multimedia via optical sensing and signal processing, IEEE Trans. Inf. Forensics Secur. 8 (9) (2013) 1417-1432.

[41] S. Vatansever, A.E. Dirik, N. Memon, Factors affecting ENF based time-of-recording estimation for video, in: IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2019, pp. 2497-2501.

[42] A. Hajj-Ahmad, R. Garg, M. Wu, Instantaneous frequency estimation and localization for ENF signals, in: Proceedings of the 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA 2012), 2012, pp. 1-10.

[43] W.-H. Chuang, R. Garg, M. Wu, Anti-forensics and countermeasures of electrical network frequency analysis, IEEE Trans. Inf. Forensics Secur. 8 (12) (2013) 2073-2086.

[44] S.M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory, Prentice Hall, Upper Saddle River, NJ, USA, 1993.

[45] E. Jacobsen, P. Kootsookos, Fast accurate frequency estimators, IEEE Signal Process. Mag. 24 (2) (2007) 123-125.

[46] D.C. Rife, R.R. Boorstyn, Single-tone parameter estimation from discrete-time observations, IEEE Trans. Inf. Theor. 20 (5) (1974) 591-598.