Utilizing Ant Colony Optimization for Result Merging in Federated Search
Received: 20 March 2024 | Revised: 16 April 2024 | Accepted: 18 April 2024 | Online: 2 August 2024
Corresponding author: Shah Khalid
Abstract
Federated search or distributed information retrieval routes the user's search query to multiple component collections and presents a merged result list in ranked order by comparing the relevance score of each returned result. However, the heterogeneity of the component collections makes it challenging for the central broker to compare these relevance scores while fusing the results into a single ranked list. To address this issue, most existing approaches merge the returned results by converting the document ranks to their ranking scores or downloading the documents and computing their relevance score. However, these approaches are not efficient enough, because the former methods suffer from limited efficacy of result merging due to the negligible number of overlapping documents and the latter are resource intensive. The current paper addresses this problem by proposing a new method that extracts features of both documents and component collections from the available information provided by the collections at query time. Each document and its collection features are exploited together to establish the document relevance score. The ant colony optimization is used for information retrieval to create a merged result list. The experimental results with the TREC 2013 FedWeb dataset demonstrate that the proposed method significantly outperforms the baseline approaches.
Keywords:
information retrieval, distributed information retrieval, federated search, result merging, ant colony optimizationDownloads
References
A. Garba and S. Wu, "Snippet-based result merging in federated search," Journal of Information Science, Jan. 2023, Art. no. 01655515221144864.
B. Nethravathi, G. Amitha, A. Saruka, T. P. Bharath, and S. Suyagya, "Structuring Natural Language to Query Language: A Review," Engineering, Technology & Applied Science Research, vol. 10, no. 6, pp. 6521–6525, Dec. 2020.
M. Shokouhi and L. Si, "Federated Search," Foundations and Trends® in Information Retrieval, vol. 5, no. 1, pp. 1–102, Mar. 2011.
V. Stamatis, M. Salampasis, and K. Diamantaras, "Machine learning methods for results merging in patent retrieval," Data Technologies and Applications, Jan. 2023.
J. Callan and M. Connell, "Query-based sampling of text databases," ACM Transactions on Information Systems, vol. 19, no. 2, pp. 97–130, Dec. 2001.
A. Garba, S. Khalid, I. Ullah, S. Khusro, and D. Mumin, "Embedding based learning for collection selection in federated search," Data Technologies and Applications, vol. 54, no. 5, pp. 703–717, Jan. 2020.
L. Li, Z. Zhang, and S. Wu, "LDA-Based Resource Selection for Results Diversification in Federated Search," in 15th International Conference on Web Information Systems and Applications, Taiyuan, China, 2018, pp. 147–156.
H. T. Vo, "New Re-ranking Approach in Merging Search Results," Informatica, vol. 43, no. 2, pp. 235–242, Jun. 2019.
D. Hong and L. Si, "Mixture model with multiple centralized retrieval algorithms for result merging in federated search," in 35th international ACM SIGIR conference on Research and development in information retrieval, Portland, OR, USA, Aug. 2012, pp. 821–830.
T. Wu, X. Liu, and S. Dong, "LTRRS: A Learning to Rank Based Algorithm for Resource Selection in Distributed Information Retrieval," in 25th China Conference on Information Retrieval, Fuzhou, China, Sep. 2019, pp. 52–63.
M. Ibrahim and M. Carman, "Comparing Pointwise and Listwise Objective Functions for Random-Forest-Based Learning-to-Rank," ACM Transactions on Information Systems, vol. 34, no. 4, Dec. 2016, Art. no. 20.
P. Mohapatra, M. Rolinek, C. V. Jawahar, V. Kolmogorov, and M. P. Kumar, "Efficient Optimization for Rank-Based Loss Functions," in IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA, Jun. 2018, pp. 3693–3701.
K. Tjin-Kam-Jet and D. Hiemstra, "Learning to merge search results for efficient Distributed Information Retrieval," in 10th Dutch-Belgian Information Retrieval Workshop, DIR 2010, Nijmegen, Netherlands, Jan. 2010.
B. Ghansah, S. Wu, and N. Ghansah, "Rankboost-Based Result Merging," in IEEE International Conference on Computer and Information Technology; Ubiquitous Computing and Communications; Dependable, Autonomic and Secure Computing; Pervasive Intelligence and Computing, Liverpool, UK, Oct. 2015, pp. 907–914.
H. Li, "A Short Introduction to Learning to Rank," IEICE TRANSACTIONS on Information and Systems, vol. E94-D, no. 10, pp. 1854–1862, Oct. 2011.
J. R. Koza, Genetic programming: on the programming of computers by means of natural selection. Cambridge, MA, USA: MIT Press, 1992.
Y. Rasolofo, D. Hawking, and J. Savoy, "Result merging strategies for a current news metasearcher," Information Processing & Management, vol. 39, no. 4, pp. 581–609, Jul. 2003.
S. T. Kirsch, "Document retrieval over networks wherein ranking and relevance scores are computed at the client for multiple database documents," US5659732A, Aug. 19, 1997.
P. Ogilvie and J. Callan, "The effectiveness of query expansion for distributed information retrieval," in 10th international conference on Information and knowledge management, Atlanta, GA, USA, Oct. 2001, pp. 183–190.
M. Shokouhi and J. Zobel, "Robust result merging using sample-based score estimates," ACM Transactions on Information Systems, vol. 27, no. 3, Feb. 2009, Art. no. 14.
C. He, D. Hong, and L. Si, "A weighted curve fitting method for result merging in federated search," in 34th international ACM SIGIR conference on Research and development in Information Retrieval, Beijing, China, Jul. 2011, pp. 1177–1178.
T. Demeester, D. Trieschnigg, D. Nguyen, D. Hiemstra, and K. Zhou, "Overview of the TREC 2014 Federated Web Search Track," in Twenty-Third Text REtrieval Conference, Gaithersburg, MD, USA, Nov. 2014, pp. 1–14.
E. Di Buccio and M. Melucci, "University of Padua at TREC 2014: Federated Web Search Track," in Twenty-Third Text REtrieval Conference (TREC 2014), Gaithersburg, MD, USA, Nov. 2014.
[24] A. Mourao, F. Martins, and J. Magalhaes, "NovaSearch at TREC 2013 Federated Web Search Track: Experiments with rank fusion," in The Twenty-Second Text REtrieval Conference, Gaithersburg, MD, USA, Nov. 2013, pp. 1–8.
D. Pal and M. Mitra, "ISI at the TREC 2013 Federated task," in Proceedings of the Twenty-Second Text Retrieval Conference, Trec 2013, Gaithersburg, MD, USA, 2013.
G. V. Cormack, C. L. A. Clarke, and S. Buettcher, "Reciprocal rank fusion outperforms condorcet and individual rank learning methods," in 32nd International ACM SIGIR conference on research and development in Information Retrieval, Boston, MA, USA, Jul. 2009, pp. 758–759.
F. Guan, Y. Xue, X. Yu, Y. Liu, and X. Cheng, "ICTNET at Federated Web Search Track 2013," in Twenty-Third Text REtrieval Conference (TREC 2014), Gaithersburg, MD, USA, Nov. 2014.
A. K. Ponnuswami, K. Pattabiraman, Q. Wu, R. Gilad-Bachrach, and T. Kanungo, "On composition of a federated web search result page: using online users to provide pairwise preference for heterogeneous verticals," in Fourth ACM International Conference on Web Search and Data Mining, Hong Kong, China, Feb. 2011, pp. 715–724.
R. Takanobu, T. Zhuang, M. Huang, J. Feng, H. Tang, and B. Zheng, "Aggregating E-commerce Search Results from Heterogeneous Sources via Hierarchical Reinforcement Learning," in The World Wide Web Conference, San Francisco, CA, USA, Dec. 2019, pp. 1771–1781.
Y. Freund, R. Iyer, R. E. Schapire, and Y. Singer, "An Efficient Boosting Algorithm for Combining Preferences," Journal of Machine Learning Research, vol. 4, pp. 933–969, 2003.
P. Shunmugapriya and S. Kanmani, "A hybrid algorithm using ant and bee colony optimization for feature selection and classification (AC-ABC Hybrid)," Swarm and Evolutionary Computation, vol. 36, pp. 27–36, Oct. 2017.
M. Dorigo and G. Di Caro, "Ant colony optimization: a new meta-heuristic," in Congress on Evolutionary Computation-CEC99 (Cat. No. 99TH8406), Washington, DC, USA, Jul. 1999, vol. 2, pp. 1470-1477 Vol. 2.
T. Demeester, D. Trieschnigg, D. Nguyen, D. Hiemstra, and K. Zhou, "FedWeb Greatest Hits: Presenting the New Test Collection for Federated Web Search," in 24th International World Wide Web Conference, Florence, Italy, Dec. 2015, pp. 27–28.
D. Trieschnigg, T. Demeester, A. Zhou, D. Nguyen, and D. Hiemstra, "FedWeb Greatest Hits." [Online]. Available: https://fedwebgh.intec.ugent.be/.
C.-J. Lee, Q. Ai, W. B. Croft, and D. Sheldon, "An Optimization Framework for Merging Multiple Result Lists," in 24th ACM International on Conference on Information and Knowledge Management, Melbourne, VIC, Australia, Oct. 2015, pp. 303–312.
M. Shokouhi, "Central-Rank-Based Collection Selection in Uncooperative Distributed Information Retrieval," in 29th European Conference on IR Research, Rome, Italy, Apr. 2007, pp. 160–172.
C. L. A. Clarke et al., "Novelty and diversity in information retrieval evaluation," in 31st Annual International ACM SIGIR Conference, Singapore, Asia, Jul. 2008, pp. 659–666.
S. Khalid, S. Khusro, I. Ullah, and G. Dawson-Amoah, "On The Current State of Scholarly Retrieval Systems," Engineering, Technology & Applied Science Research, vol. 9, no. 1, pp. 3863–3870, Feb. 2019.
S. Khalid and S. Wu, "Supporting Scholarly Search by Query Expansion and Citation Analysis," Engineering, Technology & Applied Science Research, vol. 10, no. 4, pp. 6102–6108, Aug. 2020.
I. Ullah, S. Alam, Z. Ali, M. Khan, F. Jabeen, and S. Khusro, "On the current state of query formulation for book search," Artificial Intelligence Review, vol. 56, no. 10, pp. 12085–12130, Oct. 2023.
A. Garba, S. Khalid, H. Shah, I. Ullah, N. M. Tairan, and D. Mumin, "Using Ant Colony Optimization for Results Merging in Federated Search." researchsquare, Jul. 17, 2023.
Downloads
How to Cite
License
Copyright (c) 2024 Adamu Garba, Shah Khalid, Aliya Aleryni, Irfan Ullah, Nasser Mansoor Tairan, Habib Shah, Diyawu Mumin
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
