Event detection and evolution in multi-lingual social streams

Abstract

Real-life events are emerging and evolving in social and news streams. Recent methods have succeeded in capturing designed features of monolingual events, but lack of interpretability and multi-lingual considerations. To this end, we propose a multi-lingual event mining model, namely MLEM, to automatically detect events and generate evolution graph in multilingual hybrid-length text streams including English, Chinese, French, German, Russian and Japanese. Specially, we merge the same entities and similar phrases and present multiple similarity measures by incremental word2vec model. We propose an 8-tuple to describe event for correlation analysis and evolution graph generation. We evaluate the MLEM model using a massive humangenerated dataset containing real world events. Experimental results show that our new model MLEM outperforms the baseline method both in efficiency and effectiveness.

Keywords

event detection / event evolution / stream processing / multi-lingual anomaly detection

References

[1] Mathioudakis M, Koudas N. Twittermonitor: trend detection over the twitter stream. In: Proceedings of the 2010 ACM SIGMOD International Conference on Management of data. 2010, 1155–1158

[2] Guille A, Favre C. Event detection, tracking, and visualization in twitter: a mention-anomaly-based approach. Social Network Analysis & Mining, 2015, 5(1): 18

[3] Xie W, Zhu F, Jiang J, Lim E P, Wang K. Topicsketch: real-time bursty topic detection from twitter. IEEE Transactions on Knowledge & Data Engineering, 2016, 28(8): 2216–2229

[4] Li J, Wen J, Tai Z, Zhang R, Yu W. Bursty event detection from microblog: a distributed and incremental approach. Concurrency & Computation Practice & Experience, 2016, 28(11): 3115–3130

[5] Zhang X, Chen X, Chen Y, Wang S, Li Z, Xia J. Event detection and popularity prediction in microblogging. Neurocomputing, 2015, 149: 1469–1480

[6] Yu W, Li J, Bhuiyan M Z A, Zhang R, Huai J. Ring: real-time emerging anomaly monitoring system over text streams. IEEE Transactions on Big Data, 2017, DOI:10.1109/TBDATA.2017.2672672

[7] Cordeiro M. Twitter event detection: combining wavelet analysis and topic inference summarization. In: Proceedings of the Doctoral Symposium on Informatics Engineering. 2012, 11–16

[8] Weiler A, Grossniklaus M, Scholl M H. Event identification and tracking in social media streaming data. In: Proceedings of the Workshop on Multimodal Social Data Management. 2014, 798–807

[9] Yan X, Guo J, Lan Y, Cheng X. A biterm topic model for short texts. In: Proceedings of the 22nd International Conference on World Wide Web. 2013, 1445–1456

[10] Cheng X, Yan X, Lan Y, Guo J. BTM: topic modeling over short texts. IEEE Transactions on Knowledge & Data Engineering, 2014, 26(12): 2928–2941

[11] Peng H, Li J, He Y, Liu Y, Bao M, Wang L, Song Y, Yang Q. Largescale hierarchical text classification with recursively regularized deep graph-CNN. In: Proceedings of the 2018WorldWideWeb Conference. 2018, 1063–1072

[12] Benson E, Haghighi A, Barzilay R. Event discovery in social media feeds. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. 2011, 389–398

[13] Angel A, Koudas N, Sarkas N, Srivastava D, Svendsen M, Tirthapura S. Dense subgraph maintenance under streaming edge weight updates for real-time story identification. The VLDB Journal, 2014, 23(2): 175–199

[14] Agarwal M K, Bhide M, Bhide M. Real time discovery of dense clusters in highly dynamic graphs: identifying real world events in highly dynamic environments. Proceedings of the VLDB Endowment, 2012, 5(10): 980–991

[15] Cai H, Huang Z, Srivastava D, Zhang Q. Indexing evolving events from tweet streams. In: Proceedings of the 32nd IEEE International Conference on Data Engineering. 2016, 1538–1539

[16] Wang J, Tong W, Yu H, Li M, Ma X, Cai H, Hanratty T, Han J. Mining multi-aspect reflection of news events in twitter: discovery, linking and presentation. In: Proceedings of the 15th IEEE International Conference on Data Mining. 2016, 429–438

[17] Bonchi F, Bordino I, Gullo F, Stilo G. Identifying buzzing stories via anomalous temporal subgraph discovery. In: Proceedings of IEEE/WIC/ACM International Conference on Web Intelligence. 2017, 161–168

[18] Li D, Chakradhar S, Becchi M. Grapid: a compilation and runtime framework for rapid prototyping of graph applications on many-core processors. In: Proceedings of the 20th IEEE International Conference on Parallel and Distributed Systems. 2015, 174–182

[19] Li D, Chen X, Becchi M, Zong Z. Evaluating the energy efficiency of deep convolutional neural networks on CPUs and GPUs. In: Proceedings of IEEE International Conferences on Big Data and Cloud Computing, Social Computing and Networking, Sustainable Computing and Communications. 2016, 477–484

[20] Li D, Wu H, Becchi M. Exploiting dynamic parallelism to efficiently support irregular nested loops on GPUs. In: Proceedings of International Workshop on Code Optimisation for Multi and Many Cores. 2015

[21] Li D, Sajjapongse K, Truong H, Conant G, Becchi M. A distributed CPU-GPU framework for pairwise alignments on large-scale sequence datasets. In: Proceedings of the 24th IEEE International Conference on Application-Specific Systems, Architectures and Processors. 2013, 329–338

[22] Li D, Becchi M. Deploying graph algorithms on GPUs: an adaptive solution. In: Proceedings of the 27th IEEE International Symposium on Parallel and Distributed Processing. 2013, 1013–1024

[23] Wang S, Hu X, Yu P S, Li Z. Mmrate: inferring multi-aspect diffusion networks with multi-pattern cascades. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2014, 1246–1255

[24] Leskovec J, Backstrom L, Kleinberg J. Meme-tracking and the dynamics of the news cycle. In: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2009, 497–506

[25] Yang C C, Shi X, Wei C P. Discovering event evolution graphs from news corpora. IEEE Transactions on Systems, Man, and Cybernetics- Part A: Systems and Humans, 2009, 39(4): 850–863

[26] Pei L, Lakshmanan L V S, Milios E E. Incremental cluster evolution tracking from highly dynamic network data. In: Proceedings of the 30th IEEE International Conference on Data Engineering. 2014, 3–14

[27] Lu Z, Yu W, Zhang R, Li J, Wei H. Discovering event evolution chain in microblog. In: Proceedings of the 17th IEEE International Conference on High Performance Computing and Communications. 2015, 635–640

[28] Marcus A, Bernstein M S, Badar O, Karger D R, Madden S, Miller R C. Twitinfo: aggregating and visualizing microblogs for event exploration. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2011, 227–236

[29] Lee P, Lakshmanan L V S, Milios E E. Event evolution tracking from streaming social posts. Computer Science, 2013

[30] Peng H, Li J, Song Y, Liu Y. Incrementally learning the hierarchical softmax function for neural language models. In: Proceedings of the 31st AAAI Conference on Artificial Intelligence. 2017

[31] Peng H, Bao M, Li J, Bhuiyan M Z, Liu Y, He Y, Yang E. Incremental term representation learning for social network analysis. Future Generation Computer Systems, 2018, 86: 1503–1512

[32] Nguyen D T, Jung J E. Real-time event detection for online behavioral analysis of big social data. Future Generation Computer Systems, 2017, 66: 137–145

[33] Liu Y, Peng H, Guo J, He T, Li X, Song Y, Li J. Event detection and evolution based on knowledge base. In: Proceedings of the 1st Work shop on Knowledge Base Construction, Reasoning and Mining. 2018, 38–39

[34] Lejeune G, Brixtel R, Doucet A, Lucas N. Multilingual event extraction for epidemic detection. Artificial Intelligence in Medicine, 2015, 65(2): 131–143

[35] Agerri R, Aldabe I, Laparra E, Rigau G, Fokkens A, Huijgen P, Erp M V, Bevia R I, Vossen P, Minard A L. Multilingual event detection using the newsreader pipelines. In: Proceedings of International Conference on Language Resources and Evaluation. 2016

[36] Lin C, Lin C, Li J, Wang D, Chen Y, Li T. Generating event storylines from microblogs. In: Proceedings of the 21st ACM International Conference on Information and Knowledge Management. 2012, 175–184

[37] Ge T, Pei W, Ji H, Li S, Chang B, Sui Z. Bring you to the past: automatic generation of topically relevant event chronicles. In: Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 2015, 575–585

[38] Zhou P, Wu B, Cao Z. Emmbtt: a novel event evolution model based on TFxIEF and TDC in tracking news streams. In: Proceedings of the 2nd IEEE International Conference on Data Science in Cyberspace. 2017, 102–107

[39] Manning C D, Surdeanu M, Bauer J, Finkel J, Bethard S J, Mcclosky D. The stanford corenlp natural language processing toolkit. In: Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics: System Demonstrations. 2014

[40] Yu W, Aggarwal C C, Ma S, Wang H. On anomalous hotspot discovery in graph streams. In: Proceedings of the 13th IEEE International Conference on Data Mining. 2014, 1271–1276

[41] Reid F, Mcdaid A, Hurley N. Percolation computation in complex networks. In: Proceedings of IEEE/ACMInternational Conference on Advances in Social Networks Analysis and Mining. 2012, 274–281

[42] Mihalcea R, Tarau P. Textrank: bringing order into texts. In: Proceedings of the 2004 Conference on Empirical Methods in Natural Language Processing. 2004, 404–411

[43] Zhao J, Dong L,Wu J, Xu K. Moodlens: an emoticon-based sentiment analysis system for Chinese tweets. In: Proceedings of the 18th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 2012, 1528–1531

[44] Ioffe S. Improved consistent sampling, weighted minhash, l1 sketching. In: Proceedings of IEEE International Conference on Data Mining. 2010, 246–255

[45] Palla G, Derényi I, Farkas I, Vicsek T. Uncovering the overlapping community structure of complex networks in nature and society. Nature, 2005, 435(7043): 814

[46] Nallapati R, Feng A, Peng F, Allan J. Event threading within news topics. In: Proceedings of the 13th ACM International Conference on Information and Knowledge Management. 2004, 446–453

[47] Devlin J, Chang M, Lee K, Toutanova K. Bert: pre-training of deep bidirectional transformers for language understanding. 2018, arXiv preprint arXiv:1810.04805

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag GmbH Germany, part of Springer Nature