Deep Learning-Driven Ontology Learning: A Systematic Mapping Study
Received: 28 October 2024 | Revised: 18 November 2024 and 26 November 2024 | Accepted: 27 November 2024 | Online: 2 February 2025
Corresponding author: Asma Amalki
Abstract
Today, ontologies are the widely accepted framework for managing knowledge in a manner that supports sharing, reuse, and automatic interpretation. Ontologies are fundamental to various Artificial Intelligence (AI) applications, including smart information retrieval, knowledge management, and contextual organization. However, the rapid growth of data in various domains has made ontology acquisition and enrichment, time-consuming, labor-intensive, and expensive. Consequently, there is a need for automated methods for this task, commonly referred to as ontology learning. Deep learning models have made significant advancements in this field, as they can extract concepts from vast corpora and infer semantic relationships from wide-ranging datasets. This paper aims to explore and synthesize existing research on the application of deep learning techniques to ontology learning. To achieve this, a Systematic Mapping Study (SMS) was conducted, encompassing 2765 papers published between 2015 and September 2024, from which 47 research papers were selected for review and analysis. The studies were systematically categorized according to eight refined criteria: publication year, type of contribution, empirical study design, type of data used, deep learning techniques implemented, domain of application, focused ontology learning tasks, and evaluation metrics and benchmarks.
Keywords:
ontology, ontology learning, , deep learning, systematic mapping study, knowledge representationDownloads
References
V. T. da Silva, J. S. dos Santos, R. Thiago, E. Soares, and L. G. Azevedo, "OWL ontology evolution: understanding and unifying the complex changes," The Knowledge Engineering Review, vol. 37, 2022, Art. no. e10.
Z. A. Mora-Alvarez, O. Hernandez-Uribe, R. A. Luque-Morales, and L. A. Cardenas-Robledo, "Modular Ontology to Support Manufacturing SMEs Toward Industry 4.0," Engineering, Technology & Applied Science Research, vol. 13, no. 6, pp. 12271–12277, Dec. 2023.
L. E. Chan et al., "The Environmental Conditions, Treatments, and Exposures Ontology (ECTO): connecting toxicology and exposure to human health and beyond," Journal of Biomedical Semantics, vol. 14, no. 1, Feb. 2023, Art. no. 3.
A. Haller, J. D. Fernández, M. R. Kamdar, and A. Polleres, "What Are Links in Linked Open Data? A Characterization and Evaluation of Links between Knowledge Graphs on the Web," Journal of Data and Information Quality, vol. 12, no. 2, pp. 1–34, May 2020.
A. Donkers, D. Yang, B. de Vries, and N. Baken, "Semantic Web Technologies for Indoor Environmental Quality: A Review and Ontology Design," Buildings, vol. 12, no. 10, Oct. 2022, Art. no. 1522.
R. Thirumahal, G. Sudha Sadasivam, and P. Shruti, "Semantic Integration of Heterogeneous Data Sources Using Ontology-Based Domain Knowledge Modeling for Early Detection of COVID-19," SN Computer Science, vol. 3, no. 6, Aug. 2022, Art. no. 428.
Y. He, J. Chen, D. Antonyrajah, and I. Horrocks, "BERTMap: A BERT-Based Ontology Alignment System," Proceedings of the AAAI Conference on Artificial Intelligence, vol. 36, no. 5, pp. 5684–5691, Jun. 2022.
M. Wang et al., "Big Data Health Care Platform With Multisource Heterogeneous Data Integration and Massive High-Dimensional Data Governance for Large Hospitals: Design, Development, and Application," JMIR Medical Informatics, vol. 10, no. 4, Apr. 2022, Art. no. e36481.
H. Babaei Giglou, J. D’Souza, and S. Auer, "LLMs4OL: Large Language Models for Ontology Learning, " in Proceedings of the 22nd International Semantic Web Conference, Part I, Athens, Greece, 2023, pp. 408–427.
P. Rathee and S. K. Malik, "Merging Operation for Domain Ontologies in Semantic Web: Some Issues," in Proceedings of Third Doctoral Symposium on Computational Intelligence, Lucknow, India, 2022, pp. 551–560.
B. G. Humm et al., "New directions for applied knowledge-based AI and machine learning," Informatik Spektrum, vol. 46, no. 2, pp. 65–78, Apr. 2023.
L. Zemmouchi-Ghomari, "Ontology and Machine Learning: A Two-Way Street to Improved Knowledge Representation and Algorithm Accuracy," in Proceedings of International Conference on Paradigms of Communication, Computing and Data Analytics, New Delhi, India, 2023, pp. 181–189.
B. Kitchenham, O. Pearl Brereton, D. Budgen, M. Turner, J. Bailey, and S. Linkman, "Systematic literature reviews in software engineering – A systematic literature review," Information and Software Technology, vol. 51, no. 1, pp. 7–15, Jan. 2009.
E. Schumacher, A. Mulyar, and M. Dredze, "Clinical Concept Linking with Contextualized Neural Representations," in Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Online, 2020, pp. 8585–8592.
I. Cohen, E. David, and N. S. Netanyahu, "Supervised and Unsupervised End-to-End Deep Learning for Gene Ontology Classification of Neural In Situ Hybridization Images," Entropy, vol. 21, no. 3, Mar. 2019, Art. no. 221.
J. Chen and J. Gu, "ADOL: a novel framework for automatic domain ontology learning," The Journal of Supercomputing, vol. 77, no. 1, pp. 152–169, Jan. 2021.
E. Amador-Domínguez, P. Hohenecker, T. Lukasiewicz, D. Manrique, and E. Serrano, "An Ontology-Based Deep Learning Approach for Knowledge Graph Completion with Fresh Entities," in 16th International Conference on Distributed Computing and Artificial Intelligence, Ávila, Spain, 2019, pp. 125–133.
M. Muscetti, A. M. Rinaldi, C. Russo, and C. Tommasino, "Multimedia ontology population through semantic analysis and hierarchical deep features extraction techniques," Knowledge and Information Systems, vol. 64, no. 5, pp. 1283–1303, May 2022.
K. Sanju Saravanan and V. Bhagavathiappan, "Innovative agricultural ontology construction using NLP methodologies and graph neural network," Engineering Science and Technology, an International Journal, vol. 52, Apr. 2024, Art. no. 101675.
C. Saetia, J. Phruetthiset, T. Chalothorn, M. Lertsutthiwong, S. Taerungruang, and P. Buabthong, "Financial Product Ontology Population with Large Language Models," in Proceedings of TextGraphs-17: Graph-based Methods for Natural Language Processing, Bangkok, Thailand, 2024, pp. 53–60.
V. K. Kommineni, B. König-Ries, and S. Samuel, "From human experts to machines: An LLM supported approach to ontology and knowledge graph construction." arXiv, Mar. 13, 2024.
A. Mukanova et al., "LLM-Powered Natural Language Text Processing for Ontology Enrichment," Applied Sciences, vol. 14, no. 13, Jun. 2024, Art. no. 5860.
M. Glauer, A. Memariani, F. Neuhaus, T. Mossakowski, and J. Hastings, "Interpretable ontology extension in chemistry," Semantic Web, vol. 15, no. 4, pp. 937–958, Oct. 2024.
J. Chen, Y. He, Y. Geng, E. Jiménez-Ruiz, H. Dong, and I. Horrocks, "Contextual semantic embeddings for ontology subsumption prediction," World Wide Web, vol. 26, no. 5, pp. 2569–2591, Sep. 2023.
P. Manda, S. SayedAhmed, and S. D. Mohanty, "Automated ontology-based annotation of scientific literature using deep learning," in Proceedings of The International Workshop on Semantic Big Data, Portland, OR, USA, 2020, pp. 1–6.
M.-H. Su, C.-H. Wu, and P.-C. Shih, "Automatic Ontology Population Using Deep Learning for Triple Extraction," in 2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, Lanzhou, China, 2019, pp. 262–267.
H. M. Zahera et al., "Tab2Onto: Unsupervised Semantification with Knowledge Graph Embeddings," in Proceedings of the 19th Extended Semantic Web Conference, ESWC 2022 Satellite Events, Hersonissos, Greece, 2022, pp. 47–51.
A. V. Semenova and V. M. Kureichik, "Ensemble of classifiers for ontology enrichment," Journal of Physics: Conference Series, vol. 1015, no. 3, May 2018, Art. no. 032123.
L. M. Sanagavarapu, V. Iyer, and R. Reddy, "A Deep Learning Approach for Ontology Enrichment from Unstructured Text." arXiv, Dec. 16, 2021.
Y. Geng et al., "Disentangled Ontology Embedding for Zero-shot Learning," in Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA, 2022, pp. 443–453.
H. Dong, J. Chen, Y. He, Y. Gao, and I. Horrocks, "A Language Model Based Framework for New Concept Placement in Ontologies," in Proceedings of the 21st International Conference on The Semantic Web, ESWC 2024, Part I, Hersonissos, Greece, 2024, pp. 79–99.
J. Wang, J. Liu, and L. Kong, "Ontology Construction Based on Deep Learning," in Proceedings of the 12th KIPS International Conference on Ubiquitous Information Technologies and Applications and the 9th International Conference on Computer Science and its Applications, Taichung, Taiwan, 2017, pp. 505–510.
C.-S. Lee et al., "A Study on AI-FML Robotic Agent for Student Learning Behavior Ontology Construction," in 2020 International Symposium on Community-centric Systems, Tokyo, Japan, 2020, pp. 1–6.
H. Gasmi, J. Laval, and A. Bouras, "Cold-start cybersecurity ontology population using information extraction with LSTM," in 2019 International Conference on Cyber Security for Emerging Technologies, Doha, Qatar, 2019, pp. 1–6.
P. Manda, L. Beasley, and S. D. Mohanty, "Taking a Dive: Experiments in Deep Learning for Automatic Ontology-based Annotation of Scientific Literature." bioRxiv, Jul. 10, 2018, Art. no. 365874.
S. Althubaiti, Ş. Kafkas, M. Abdelhakim, and R. Hoehndorf, "Combining lexical and context features for automatic ontology extension," Journal of Biomedical Semantics, vol. 11, no. 1, Jan. 2020, Art. no. 1.
X. Xue, J. Guo, M. Ye, and J. Lv, "Similarity Feature Construction for Matching Ontologies through Adaptively Aggregating Artificial Neural Networks," Mathematics, vol. 11, no. 2, Jan. 2023, Art. no. 485.
W. H. Bangyal et al., "Constructing Domain Ontology for Alzheimer Disease Using Deep Learning Based Approach," Electronics, vol. 11, no. 12, Jun. 2022, Art. no. 1890.
F. Zhang et al., "A Deep Learning Framework for Gene Ontology Annotations With Sequence- and Network-Based Information," IEEE/ACM Transactions on Computational Biology and Bioinformatics, vol. 18, no. 6, pp. 2208–2217, Nov. 2021.
A. Balali, M. Asadpour, and S. H. Jafari, "COfEE: A comprehensive ontology for event extraction from text," Computer Speech & Language, vol. 89, Jan. 2025, Art. no. 101702.
Y. Ren, J. Han, Y. Lin, X. Mei, and L. Zhang, "An Ontology-Based and Deep Learning-Driven Method for Extracting Legal Facts from Chinese Legal Texts," Electronics, vol. 11, no. 12, Jun. 2022, Art. no. 1821.
L. Korel, U. Yorsh, A. S. Behr, N. Kockmann, and M. Holeňa, "Text-to-Ontology Mapping via Natural Language Processing with Application to Search for Relevant Ontologies in Catalysis," Computers, vol. 12, no. 1, Jan. 2023, Art. no. 14.
C. Chen and L. Luo, "GOGCN: using deep learning to support insertion of new concepts into gene ontology," in 5th International Conference on Information Science, Electrical, and Automation Engineering, Wuhan, China, 2023, pp. 641–647.
Downloads
How to Cite
License
Copyright (c) 2024 Asma Amalki, Khalid Tatane, Ali Bouzit
This work is licensed under a Creative Commons Attribution 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain the copyright and grant the journal the right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) after its publication in ETASR with an acknowledgement of its initial publication in this journal.
