Jensen–Renyi’s–Tsallis Fuzzy Divergence Information Measure with its Applications

Abstract

In this paper, we have characterized the sum of two general measures associated with two distributions with discrete random variables. One of these measures is logarithmic, while others contains the power of variables, named as joint representation of Renyi’s–Tsallis divergence measure. Then, we propose a divergence measure based on Jensen–Renyi’s–Tsallis entropy which is known as a Jensen–Renyi’s–Tsallis divergence measure. It is a generalization of J-divergence information measure. One of the silent features of this measure is that we can allot the equal weight to each probability distribution. This makes it specifically reasonable for the study of decision problems, where the weights could be the prior probabilities. Further, the idea has been generalized from probabilistic to fuzzy similarity/dissimilarity measure. Besides the validation of the proposed measure, some of its key properties are also studied. Further, the performance of the proposed measure is contrasted with some existing measures. At last, some illustrative examples are solved in the context of clustering analysis, financial diagnosis and pattern recognition which demonstrate the practicality and adequacy of the proposed measure between two fuzzy sets (FSs).

Keywords

Fuzzy sets / Divergence measure / Similarity measure / Clustering analysis / Financial diagnosis

References

[1] Arqub OA. Adaptation of reproducing kernel algorithm for solving fuzzy Fredholm–Voltera integrodifferential equations. Neural Comput. Appl.. 2017, 28 1591-1610

[2] Arqub OA, Al-Smadi MH, Momani SM, Hayat T. Numerical solutions of fuzzy differential equations using reproducing kernel Hilbert space method. Soft Comput.. 2016, 20 3283-3302

[3] Arqub OA, Al-Smadi MH, Momani SM, Hayat T. Application of reproducing kernel algorithm for solving second-order, two point fuzzy boundary value problems. Soft Comput.. 2017, 21 7191-7206

[4] Bhatia PK, Singh S. Three families of generalized fuzzy directed divergence. AMO Adv. Model Optim.. 2012, 14 3 599-614

[5] Bhatia PK, Singh S. A new measure of fuzzy directed divergence and its applications in image segmentation. Int. J. Intell. Syst. Appl.. 2013, 4 81-89

[6] Boekee DE, Vander Lubbe JCA. The R-norm information measure. Inf. Control. 1980, 45 136-155

[7] Burbea J, Rao CR. On the convexity of some divergence measures based on entropy functions. IEEE Trans. Infor. Theory. 1982, 28 489-495

[8] Bouchet A, Montes S, Ballarin V, Diaz I. Intuitionistic fuzzy set and fuzzy mathematical morphology applied to color leukocytes segmentation, Signal. Image Video Process.. 2019

[9] Cover TM, Thomas JA. Elements of Information Theory. 1991 New York: Wiley-Interscience

[10] Chou CC. A generalized similarity measure for fuzzy numbers. J. Intell. Fuzzy Syst.. 2016, 30 2 1147-1155

[11] Cross VV, Sudkampm T. A Similarity and Compatibility in Fuzzy Set Theory. 2002 Heidelberg: Physica-Verlag

[12] Deselaers T, Keysers D, Ney H. Features for image retrieval:an experimental comparison. Inf. Retr.. 2008, 11 2 77-107

[13] De Luca A, Termini S. A definition of a non- probabilistic entropy in the setting of fuzzy sets theory. Inf. Control. 1972, 20 301-312

[14] Fan J, Xie W. Distance measures and induced fuzzy entropy. Fuzzy Sets Syst.. 1999, 104 2 305-314

[15] Fan S, He P, Nie H. Infrared electric image thresholding using two dimensional fuzzy entropy. Energy Proc.. 2011, 12 411-419

[16] Ferreri C. Hyper entropy and related hetrogeneity divergence and information measure. Statistical. 1980, 40 2 155-168

[17] Garg D, Kumar S. Parametric R-norm directed divergence convex function. Infinite dimensional analysis, quantum probability and related topics. 2016, 19 2 1-12

[18] Garg H. An improved cosine similarity measure for intuitionistic fuzzy sets and their applications to decision-making process. Hacet. J. Math. Stat.. 2018, 47 6 1578-1594

[19] Ghosh M, Das D, Ray C, Chadraborty AK. Autumated lerkocyte recoginition using fuzzy divergence. Micron. 2010, 41 840-846

[20] Hung WL, Yang MS. Similarity measures of intuitionistic fuzzy sets based on $L_p$ metric. Int. J. Approx. Reason.. 2007, 46 120-136

[21] Hwang CH, Yang MS. On entropy of fuzzy sets. Int. J. Uncertain Fuzzy Knowel. Based Syst.. 2008, 16 4 519-527

[22] Jeffreys H. Scientific Interface. 1973 Cambridge: Cambridge University Press

[23] Joshi R, Kumar S. An (R’, S’)-norm fuzzy relative measure with its applications strategic decision making. Comp. Appl. Math.. 2018, 37 4 4518-4543

[24] Kabir, S., Wanger, C., Havens, T.C., Anderson, D.T.: A bidirectional subsethood based similarity measure for fuzzy sets. In 2018 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE), pp. 1–7, (2018)

[25] Kullback S, Leibler RA. On information and sufficiency. Ann. Math. Stat.. 1951, 22 79-86

[26] Kullback S. Information Theory and Statistics. 1959 New York: Wiley

[27] Lin J. Divergence measure based on Shannon entropy. IEEE Trans. Inform. Theory. 1991, 37 1 145-151

[28] Mahalanobis PC. On the generalized distance in statistics. Proc. Natl. Inst. Sci.. 1936, 2 49-55

[29] Mitchell HB. On the Dengfeng–Chuntain similarity measure and its application to pattern recognition. Pattern Recognit. Lett.. 2003, 24 3101-3104

[30] Montes S, Couso I, Gil P, Bertoluzza C. Divergence mesure between fuzzy sets. Int. J. Approx. Reason. 2002, 30 2 91-105

[31] Rao CR. Diversity and dissimilarity coefficients: a unified approach. Theor. Popul. Biol.. 1982, 21 24-43

[32] Renyi, A.: On measures of entropy and information. In: Proceedings of 4th Bakley Symposium on Mathematics and Statistics and Probability, University of California Press, vol. 1, p. 547 (1961)

[33] Rubner Y, Puzicha J, Tomasi C, Buhmann M. Empirical evaluation of dissimilarity measures for color and texture. Comput. Vis. Image Underst.. 2001, 84 1 25-43

[34] Santini S, Jain R. Similarity measures. IEEE Trans. Pattern Anal. Mach. Intell.. 1999, 21 9 871-883

[35] Santos-Rodriguez, R., Garcia-Garcia, D., Cid-Sueiro, J.: Cost-sensitive classification based on Bregman divergences for medical diagnosis, In M.A. Wani, editor, Proceedings of the 8th International Conference on Machine Learning and Applications (ICMLA’09), Miami beach, Fl., USA, December 13–15, pp. 551–556 (2009)

[36] Shannon CE. A mathematical theory of communication. Bell. Syst. Technol. J.. 1948, 27 378–423 623-656

[37] Szmidt, E., kacprzyk, J.: A similarity measure for intuitionistic fuzzy sets and its application in supporting medical diagnostic reasoning. In Proceedings of the 7th International Conference on Artificial Intelligence and Soft Computing (ICAISC’04), pp. 388–393 (2004)

[38] Tsallis C. Possible generalization of Boltzman–Gibbs statistics. J. Stat. Phys.. 1988, 52 480-487

[39] Wondie, L., Kumar, S.: A joint representation of Renyi’s–Tsallis entropy with application in coding theory. Int J. Math. Math. Sci. 2017, Article ID 2683293 (2017). https://doi.org/10.1155/2017/2683293

[40] Williams J, Steele N. Difference, distance and similarity as a basis for fuzzy decision support based on prototypical decision classes. Fuzzy Sets Syst.. 2002, 131 35-46

[41] Xu ZS, Wu JJ. Clustering algorithm for intuitionistic fuzzy sets. Inf. Sci.. 2008, 178 3775-3790

[42] Yager RR. On the measure of fuzziness and negation. Part 1: membership in the unit interval. Int. J. Gen. Syst.. 1979, 5 221-229

[43] Yang MS, Wu KL. A similarity-based robust clustering method. IEEE Trans. Pattern Anal. Mach. Intell.. 2004, 26 434-448

[44] Zadeh LA. Fuzzy sets. Inf. Control. 1965, 8 221-229

[45] Zadeh LA. Probability measures of fuzzy events. J. Math. Anal. Appl.. 1968, 23 421-427

[46] Zadeh LA. Similarity relations and fuzzy orderings. Inf. Sci.. 1971, 3 177-200

[47] Zhang HM, Xu ZS, Chen Q. On clustering approach to intuitionistic fuzzy sets. Control Decis.. 2007, 22 882-888

[48] Zwick R, Carlstein E, Budesco DV. Measures of similarity amongst fuzzy concepts: a comparative analysis. Int. J. Approx. Reason.. 1987, 1 221-242