Topic hierarchy construction from heterogeneous evidence

Abstract

Existing studies on hierarchy constructionmainly focus on text corpora and indiscriminately mix numerous topics,thus increasing the possibility of knowledge acquisition bottlenecks and misconceptions. To address these problems and provide a comprehensive and in-depth representation of domain specific topics, we propose a novel topic hierarchy construction method with real-time update. This method combines heterogeneous evidence from multiple sources including folksonomy and encyclopedia, separately in both initial topic hierarchy construction and topic hierarchy improvement.Results of comprehensive experiments indicate that the proposed method significantly outperforms state-of-theart methods (t-test, p-value<0.000 1); recall has particularly improved by 20.4% to 38.7%.

Keywords

hierarchy construction / Chinese topic hierarchy / folksonomy / heterogeneous evidence / hierarchy update

References

[1] Liu X, Song Y, Liu S,Wang H. Automatic taxonomy construction from keywords. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2012, 1433–1441

[2] Trant J. Studying social tagging and folksonomy: a review and framework.Journal of Digital Information, 2009, 10(1): 1–42

[3] Hoffart J, Suchanek F M, Berberich K,Weikum G. YAGO2: a spatially and temporally enhanced knowledge base from Wikipedia. Artificial Intelligence, 2013, 194: 28–61

[4] Zhu X, Ming Z Y, Zhu X, Chua T. Topic hierarchy construction for the organization of multi-source user generated contents. In: Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval. 2013, 233–242

[5] Hearst M A. Automatic acquisition of hyponyms from large text corpora.In: Proceedings of the 14th Conference on Computational Linguistic,1992, 539–545

[6] Girju R, Badulescu A, Moldovan D. Learning semantic constraints for the automatic discovery of part-whole relations. In: Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology. 2003, 1–8

[7] Ming Z Y, Wang K, Chua T S. Prototype hierarchy based clustering for the categorization and navigation of web collections. In: Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 2010, 2–9

[8] Snow R, Jurafsky D, Ng A Y. Semantic taxonomy induction from heterogenous evidence. In: Proceedings of the 21st International Conference on Computational Linguistics and the 44th Annual Meeting of the Association for Computational Linguistics. 2006, 801–808

[9] Yang H, Callan J. A metric-based framework for automatic taxonomy induction. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the AFNLP. 2009, 271–279

[10] Yu J, Zha Z J, Wang M, Wang K, Chua T. Domain-assisted product aspect hierarchy generation: towards hierarchical organization of unstructured consumer reviews. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing. 2011, 140–150

[11] Navigli R, Velardi P, Faralli S. A graph-based algorithm for inducing lexical taxonomies from scratch. In: Proceedings of the 22nd International Joint Conference on Artificial Intelligence. 2011, 1872–1877

[12] Zhou M, Bao S, Wu X, Yu Y. An unsupervised model for exploring hierarchical semantics from social annotations. In: Proceedings of the 6th International Semantic Web Conference and the 2nd Asian Semantic Web Conference. 2007, 680–693

[13] Heymann P, Garcia-Molina H. Collaborative Creation of Communal Hierarchical Taxonomies in Social Tagging Systems. Technical Report.2006

[14] Angeletou S, Sabou M, Motta E. Semantically enriching folksonomies with FLOR. In: Proceedings of the 1st International Workshop on Collective Semantics: Collective Intelligence & the Semantic Web. 2008,1–16

[15] Tomuro N, Shepitsen A. Construction of disambiguated folksonomy ontologies using Wikipedia. In: Proceedings of the 2009 Workshop on the People’s Web Meets NLP: Collaboratively Constructed Semantic Resources. 2009, 42–50

[16] Blei D M, Ng A Y,Jordan M I. Latent dirichlet allocation. Journal of Machine Learning Research, 2003, (3): 993–1022

[17] Tang J, Leung H, Luo Q, Chen D, Gong J. Towards ontology learning from folksonomies. In: Proceedings of the 21st International Joint Conference on Artificial Intelligence. 2009, 2089–2094

[18] Bundschus M, Yu S, Tresp V, Rettinger A. Hierarchical Bayesian models for collaborative tagging systems. In: Proceedings of the 9th IEEE International Conference on Data Mining. 2009, 728–733

[19] Daud A, Li J Z, Zhou L Z, Zhang L. Modeling ontology of folksonomy with latent semantics of tags. In: Proceedings of the 2010 IEEE/WIC/ACMInternational Conference onWeb Intelligence and Intelligent Agent Technology. 2010, 516–523

[20] Xue H, Qin B, Liu T. Topical key concept extraction from folksonomy through graph-based ranking. Multimedia Tools and Applications,2014: 1–19

[21] Edmonds J. Optimum branchings. Journal of Research of the National Bureau of Standards B, 1967, 71: 233–240

RIGHTS & PERMISSIONS

2014 Higher Education Press and Springer-Verlag Berlin Heidelberg