Fuzzy entropy design for non convex fuzzy set and application to mutual information

Abstract

Fuzzy entropy was designed for non convex fuzzy membership function using well known Hamming distance measure. The proposed fuzzy entropy had the same structure as that of convex fuzzy membership case. Design procedure of fuzzy entropy was proposed by considering fuzzy membership through distance measure, and the obtained results contained more flexibility than the general fuzzy membership function. Furthermore, characteristic analyses for non convex function were also illustrated. Analyses on the mutual information were carried out through the proposed fuzzy entropy and similarity measure, which was also dual structure of fuzzy entropy. By the illustrative example, mutual information was discussed.

Keywords

fuzzy entropy / non convex fuzzy membership function / distance measure / similarity measure / mutual information

References

[1] BhandariD., PalN. R.. Some new information measure of fuzzy sets [J]. Information Science, 1993, 67: 209-228

[2] GhoshA.. Use of fuzziness measure in layered networks for object extraction: A generalization [J]. Fuzzy Sets and Systems, 1995, 72: 331-348

[3] KoskoB.Neural networks and fuzzy systems [M], 1992, Englewood Cliffs, NJ, Prentice-Hall: 275-278

[4] LiuX.-cheng.. Entropy, distance measure and similarity measure of fuzzy sets and their relations [J]. Fuzzy Sets and Systems, 1992, 52: 305-318

[5] PalN. R., PalS. K.. Object-background segmentation using new definitions of entropy [J]. IEEE Proceeding, 1989, 36: 284-295

[6] LeeS. H., PedryczW., SohnG. Y.. Design of similarity and dissimilarity measures for fuzzy sets on the basis of distance measure [J]. International Journal of Fuzzy Systems, 2009, 11(2): 67-72

[7] LeeS. H., CheonS. P.. KIM Jinho. Measure of certainty with fuzzy entropy function [J]. Lecture Notes in Artificial Intelligence, 2006, 4114: 134-139

[8] LeeS. H., RyuK. H., SohnG. Y.. Study on entropy and similarity measure for fuzzy set [J]. IEICE Trans Inf & Syst, 2009, 92/D(9): 1783-1786

[9] DingS. F., XiaS. H., JinF. X., ShisZ. Z.. Novel fuzzy information proximity measures [J]. Journal of Information Science, 2007, 33(6): 678-685

[10] JANG J S R, SUN C T, MIZUTANI E. Neuro-fuzzy and soft computing [M]. Upper Saddle River, Prentice Hall, 1997: 19-21.

[11] GARIBALDI J M, MUSIKASUWAN S, OZEN T, JOHN R I. A case study to illustrate the use of non convex membership functions for linguistic terms [C]// 2004 IEEE International Conference on Fuzzy Systems. Budapest, Hungary, 2004: 1403–1408.

[12] RébilléY.. Decision making over necessity measures through the Choquet integral criterion [J]. Fuzzy Sets and Systems, 2006, 157(23): 3025-3039

[13] SugumaranV., SabareeshG. R., RamachandranK. I.. Fault diagnostics of roller bearing using kernel based neighborhood score multi-class support vector machine [J]. Expert Systems with Applications, 2008, 34(4): 3090-3098

[14] KangW. S., ChoiJ. Y.. Domain density description for multiclass pattern classification with reduced computational load [J]. Pattern Recognition, 2009, 41(6): 1997-2009

[15] ShihF. Y., ZhangK.. A distance-based separator representation for pattern classification [J]. Image and Vision Computing, 2008, 26(5): 667-672