Decision tree and deep learning based probabilistic model for character recognition

Abstract

One of the most important methods that finds usefulness in various applications, such as searching historical manuscripts, forensic search, bank check reading, mail sorting, book and handwritten notes transcription, is handwritten character recognition. The common issues in the character recognition are often due to different writing styles, orientation angle, size variation (regarding length and height), etc. This study presents a classification model using a hybrid classifier for the character recognition by combining holoentropy enabled decision tree (HDT) and deep neural network (DNN). In feature extraction, the local gradient features that include histogram oriented gabor feature and grid level feature, and grey level co-occurrence matrix (GLCM) features are extracted. Then, the extracted features are concatenated to encode shape, color, texture, local and statistical information, for the recognition of characters in the image by applying the extracted features to the hybrid classifier. In the experimental analysis, recognition accuracy of 96% is achieved. Thus, it can be suggested that the proposed model intends to provide more accurate character recognition rate compared to that of character recognition techniques used in the literature.

Keywords

grey level co-occurrence matrix feature / histogram oriented gabor gradient feature / hybrid classifier / holoentropy enabled decision tree classifier

References

[1] PradeepJ, SrinivasanE, HimavathiS. Neural network based handwritten character recognition system without feature extraction [C]. Proceedings of International Conference on Computer, Communication, and Electrical Technology, 20114044

[2] VamvakasG, GatosB, PerantonisS J. Handwritten character recognition through two-stage foreground sub-sampling [J]. Pattern Recognition, 2010, 43: 2807-2816

[3] PauplinO, JiangJ-m. DBN-based structural learning and optimisation for automated handwritten character recognition [J]. Pattern Recognition Letters, 2012, 33: 685-692

[4] KaderM, DebK. Neural-network based english alphanumeric character recognition [J]. Computer Science, Engineering and Applications, 2012, 2(4): 1-10

[5] MohanaiahP, SathyanarayanaP, GurukumarL. Image texture feature extraction using GLCM approach [J]. Scientific and Research Publications, 2013, 3(5): 1-5

[6] PrasadK, AgrawalS. Character recognition using neural networks [C]. International Conference on Research and development in Computer Science and Applications, 20159092

[7] PillaiC S. A survey of shape descriptors for digital image processing [J]. Computer Science and Information technology & Security., 2013, 3(1): 44-45

[8] ZhangY-d, WangS-h, DongZ-c. Classification of alzheimer disease based on structural magnetic resonance imaging by kernel support vector machine decision tree [J]. Progress in Electromagnetics Research, 2014, 144: 171-184

[9] van GrinsvenM J J P, van GinnekenB, HoyngC B, TheelenT, SánchezC I. Fast convolutional neural network training using selective data sampling: Application to hemorrhage detection in color fundus images [J]. IEEE Transactions on Medical Imaging, 2016, 35(5): 1273-1284

[10] SamadianiN, HassanpourH. A neural network-based approach for recognizing multi-font printed English characters [J]. Electrical Science and Information Technology, 2015, 2: 207-218

[11] YangY, XuL-j, ChengC. English character recognition based on feature combination [C]. Advances in Engineering, 2011159164

[12] PirloG. Adaptive membership functions for handwritten character recognition by voronoi-based image zoning [J]. Image Processing, 2012, 21(9): 3827-3837

[13] JameelA, KoutsougerasC. On features used for handwritten character recognition in a neural network environment [C]. International Conference on Tools with Artificail Intelligence, 1993280284

[14] SurintaO, KaraabaM, SchomakerL B, MarcoA W. Recognition of handwritten characters using local gradient feature descriptors [J]. Engineering Applications of Artificial intelligence, 2015, 45: 405-414

[15] FukushimaK. Character recognition with neural networks [J]. Neuro Computing, 1992, 4(5): 221-233

[16] ChoudharyaA, RishiR, AhlawatS. Off-line handwritten character recognition using features extracted from binarization technique [C]. International Conference on Intelligent Systems and Control, 2013306312

[17] Avi-ItzhakH I, ThanhA. Diep, and harry garland, high accuracy optical character recognition using neural networks with centroid dithering [J]. Pattern Analysis and Machine Intelligence, 1995, 17(2): 218-224

[18] SzirhnyiT, CsicsvariJ. High-speed character recognition using a dual cellular neural network architecture (CNN) [J]. Circuits and Systems-II: Analog and Digital Signal Processing, 1993, 40(3): 223-231

[19] GuY X, WangQ R, SuenC Y. Application of a multilayer decision tree in computer recognition of Chinese characters [J]. Pattern Analysis and Machine Intelligence, 1983, 5(1): 83-89

[20] SurintaO, SchomakerL R B, WieringM A. Handwritten character classification using the hotspot feature extraction technique [C]. Proceedings of First International Conference on Pattern Recognition Applications and Methods (ICPRAM), 2012261264

[21] SuB, DingX. Linear sequence discriminant analysis: A modelbased dimensionality reduction method for vector sequences [C]. Proceedings of IEEE International Conference on Computer Vision (ICCV), 2013889896

[22] KambleP M, HegadiR S. Handwritten marathi character recognition using R-HOG feature [J]. Computer Science, 2015, 45: 266-274

[23] NibaranD, RamS, SubhadipB, SahaP, MahantapasK, MitaN. Handwritten bangla character recognition using a soft computing paradigm embedded in two pass approach [J]. Pattern Recognition, 2015, 48(6): 2054-2071

[24] ZahidH M, AshrafulA M, YanH. Rapid feature extraction for optical character recognition [J]. Computer Vision and Pattern Recognition, 201215

[25] ZhangB, ZhangS, ZhangJ, JingX. A method region of interest extraction based on orientation entropy [C]. Proceedings of International Conference on Broadband Network and Multimedia Technology, 2011664669

[26] DalaiN, TriggsB. Histograms of oriented gradients for human detection [C]. Proceedings of International Conference on Computer Vision and Pattern Recognition, 2005886893

[27] BanerjiS, SinhaA, LiuC-j. New image descriptors based on color, texture, shape and wavelets for object and scene image classification [J]. NeuroComputing, 2013, 117: 173-185

[28] TianS-x, BhattacharyaU, LuS-j, SuB-l, WangQ-q, WeiX-h, LuY, ChewL-t. Multilingual scene character recognition with co-occurrence of histogram of oriented gradients [J]. Pattern Recognition, 2016, 51: 125-134

[29] ChenY, LinZ, ZhaoX, WangG, GuY. Deep learning-based classification of hyperspectral data [J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2014, 7(6): 2094-2107

[30] HintonG, LiD, DongY, DahlG E, MohamedA R, JaitlyN, SeniorA, VanhouckeV, NguyenP, SainathT N, KingsburyB. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups [J]. IEEE Signal Processing Magazine, 2012, 29(6): 82-97

[31] PalmR BPrediction as a candidate for learning deep hierarchical models of data [D], 2012

[32] ManeV M, JadhavD V. Holoentropy enabled-decision tree for automatic classification of diabetic retinopathy using retinal fundus images [J]. Biomedical Engineering/Biomedizinische Technik, 2016, 62: 321-332

[33] de CamposT EThe Chars74K dataset: Character recognition in natural images[EB/OL], 2012

[34] SenthilnathJ, OmkarS N, ManiV. Clustering using firefly algorithm: Performance study [J]. Swarm and Evolutionary Computation, 2011, 1: 164-171