Artificial neural network-based merging score for Meta search engine

Abstract

Several users use metasearch engines directly or indirectly to access and gather data from more than one data sources. The effectiveness of a metasearch engine is majorly determined by the quality of the results and it returns and in response to user queries. The rank aggregation methods which have been proposed until now exploits very limited set of parameters such as total number of used resources and the rankings they achieved from each individual resource. In this work, we use the neural network to merge the score computation module effectively. Initially, we give a query to different search engines and the top n list from each search engine is chosen for further processing our technique. We then merge the top n list based on unique links and we do some parameter calculations such as title based calculation, snippet based calculation, content based calculation, domain calculation, position calculation and co-occurrence calculation. We give the solutions of the calculations with user given ranking of links to the neural network to train the system. The system then rank and merge the links we obtain from different search engines for the query we give. Experimentation results reports a retrieval effectiveness of about 80%, precision of about 79% for user queries and about 72% for benchmark queries. The proposed technique also includes a response time of about 76 ms for 50 links and 144 ms for 100 links.

Keywords

metasearch engine / neural network / retrieval of documents / ranking list

References

[1] SugiuraA, EtzioniO. Query routing for Web search engines: architecture and experiments [J]. Computer Networks, 2000, 33(1-6): 417-429

[2] ManningC D, RaghavanP, SchutzeHIntroduction to Information Retrieval [M], 2008New York, USACambridge University Press

[3] MengW, YuC, LiuK L. Building efficient and effective metasearch engines [J]. ACM Computing Surveys, 2002, 34(1): 48-89

[4] SpinkA, JansenB J, BlakelyC, KoshmanS. Overlap among major Web search engines. Proceedings of the IEEE International Conference on Information Technology: New Generations (ITNG), 2006370-374

[5] MukhopadhyayD, SharmaM, JoshiG, PagareT, PalweA. Experience of developing a meta-semantic search engine [C]// International Conference on Cloud and Ubiquitous Computing and Emerging Technologies. Pune, India, 2013167-171

[6] VogtC CAdaptive combination of evidence for information retrieval [D], 1999

[7] FangQ-z, XiaoH, ZhuS-feng. Top-d rank aggregation in web meta-search engine. Proceedings of Fourth International Conference on Frontiers in algorithmic, 201035-44

[8] LiL, XuG-d, ZhangY-c, KitsuregawaM. Random walk based rank aggregation to improving web search [J]. Knowledge-Based Systems, 2011, 24: 943-951

[9] IshiiH, TempoR, BaiE W. A web aggregation approach for distributed randomized pagerank algorithms [J]. IEEE Transactions on Automatic Control, 2012, 57(11): 2703-2717

[10] CoppersmithD, FleischerL, RudraA. Ordering by weighted number of wins gives a good ranking for weighted tournaments [J]. ACM Transactions on Algorithms (TALG), 2010, 6(3): 1-13

[11] SudeepthiG, AnuradhaG, BabuM S P. A survey on semantic web search engine [J]. IJCSI International Journal of Computer Science Issues, 2012, 9(2): 241-245

[12] TanP N, JinR. Ordering patterns by combining opinions from multiple sources. Proceedings of the ACM International Conference on Knowledge Discovery and Data Mining (SIGKDD), 2004695-700

[13] LiuY T, LiuT Y T, MaQ, LiZ M H. Supervised rank aggregation. Proceedings of the ACM International Conference on World Wide Web (WWW), 2007481-489

[14] RendaM E, StracciaU. Web metasearch: rank vs score based rank aggregation methods. Proceedings of the ACM International Symposium on Applied Computing (SAC), 2003841-846

[15] AliR, NaimI. Neural network based supervised rank aggregation. Proceedings of International Conference on Multimedia, Signal Processing and Communication Technologies, 201172-75

[16] ShokouhiM. Segmentation of search engine results for effective data-fusion. Proceedings of the European Conference on Information Retrieval (ECIR), 2007185-197

[17] OztekinB U, KarypisG, KumarV. Expert agreement and content based reranking in ametasearch environment using Mearf [C]// Proceedings of the ACM International Conference on World Wide Web (WWW). Honolulu, USA, 2002333-344

[18] LambertiF, SannaA, DemartiniC. A relation-based page rank algorithm for semantic web search engines [J]. IEEE Transactions on Knowledge and Data Engineering, 2009, 21: 123-136

[19] RashidA, SufyanB M M. Aggregating subjective and objective measures of web search quality using modified shimura technique [J]. Studies in Fuzziness and Soft Computing-Forging New Frontiers: Fuzzy Pioneers II, 2008, 218: 269-293

[20] EndrullisS, ThorA, RahmE. WETSUIT: An efficient mashup tool for searching and fusing web entities [J]. Proceedings of the VLDB Endowment, 2012, 5(12): 1970-1973

[21] RashidA, SufyanB M M. Automatic performance evaluation of web search systems using rough set based rank aggregation [C]// Proceedings of the First International Conference on Intelligent Human Computer Interaction. Allahabad, India, 2009344-358

[22] D’AmatoC, FanizziN, LawrynowiczA. Deductive aggregation of semantic web query results [J]. Research and Applications Lecture Notes in Computer Science, 2010, 6088: 91-105

[23] ArzanianB, AkhlaghianF, MoradiP. A multi-agent based personalized meta-search engine using automatic fuzzy concept networks. Third International Conference on Knowledge Discovery and Data Minning, 2010208-211

[24] SantosR L T, MacdonaldC, OunisI. Mimicking web search engines for expert search [J]. Information Processing and Management, 2011, 47: 467-481

[25] SteinmetzN, LausenH. Ontology-based feature aggregation for multi-valued ranking [J]. Lecture Notes in Computer Science-Service-Oriented Computing. ICSOC/ServiceWave 2009 Workshops, 2010, 6275: 258-268

[26] SkoutasD, SacharidisD, SimitsisA, SellisT. Ranking and clustering web services using multicriteria dominance relationships [J]. IEEE Transactions on Services Computing, 2010, 3(3): 163-177

[27] CeriS, AbidA, HelouM A, BarbieriD, BozzonA, BragaD, BrambillaM, CampiA, CorcoglionitiF, ValleE D, EynardD, FraternaliP, GrossniklausM, MartinenghiD, RonchiS, TagliasacchiM, VadaccaS. Search computing managing complex search queries [J]. IEEE Internet Computing, 2010, 14(6): 14-22

[28] TelangA, LiC, ChakravarthyS. One size does not fit all: Toward user-and query-dependent ranking for web databases [J]. IEEE Transactions on Knowledge and Data Engineering, 2012, 24(9): 1671-1685

[29] AkritidisL, KatsarosD, BozanisP. Effective rank aggregation for metasearching [J]. The Journal of Systems and Software, 2011, 84: 130-143

[30] IshiiH, TempoR, BaiE W. A web aggregation approach for distributed randomized pagerank algorithms [J]. IEEE Transactions on Automatic Control, 2012, 57(11): 2703-2717

[31] KeyhanipourA H, MoshiriB, KazemianM, PiroozmandM, LucasC. Aggregation of web search engines based on users' preferences in WebFusion [J]. Journal Knowledge-Based Systems, 2007, 20(4): 321-328

[32] AminG R, EmrouznejadA. Optimizing search engines results using linear programming [J]. Expert Systems with Applications, 2011, 38: 11534-11537

[33] LiL, XuG-d, ZhangY-c, MasaruK. Random walk based rank aggregation to improving web search [J]. Knowledge-Based Systems, 2011, 24: 943-951

[34] FangQ-z, XiaoH, ZhuS-feng. Top-d rank aggregation in Web meta-search engine [C]// Proceeding FAW'10 Proceedings of the 4th international conference on Frontiers in algorithmics. Berlin, Heidelberg, Germany, 201035-44

[35] LiL, YangZ, KitsuregawaM. Using ontology-based user preferences to aggregate rank lists in web search. Computer Science-Advances in Knowledge Discovery and Data Mining, 2008923-931