Location
Hilton Waikoloa Village, Hawaii
Event Website
https://hicss.hawaii.edu/
Start Date
7-1-2025 12:00 AM
End Date
10-1-2025 12:00 AM
Description
The process of creating and maintaining domain ontologies is a time- and resource-intensive activity, given the dynamic nature of domain knowledge and the regular introduction of new terms. This study aims to determine the effectiveness of large language models (LLMs) in augmenting the domain ontology authoring process. We fine-tuned state-of-the-art pre-trained LLMs and evaluated their performance on two tasks: synonym identification and parent-child relationship identification. The models achieved 98% accuracy in the first task and 75.4% accuracy in the second, demonstrating significant capabilities in automating synonym identification and relationship classification. In addition to providing a methodological basis for further extending and improving these results, we demonstrate that LLMs can be effectively used in ontology development and maintenance. This can save time and effort in the process.
Recommended Citation
Pham, Tran Van Anh; Huettemann, Sebastian; and Mueller, Roland M., "Enhancing Ontologies with Large Language Models: A Semi-Automated Approach" (2025). Hawaii International Conference on System Sciences 2025 (HICSS-58). 3.
https://aisel.aisnet.org/hicss-58/da/nlp_and_llms/3
Enhancing Ontologies with Large Language Models: A Semi-Automated Approach
Hilton Waikoloa Village, Hawaii
The process of creating and maintaining domain ontologies is a time- and resource-intensive activity, given the dynamic nature of domain knowledge and the regular introduction of new terms. This study aims to determine the effectiveness of large language models (LLMs) in augmenting the domain ontology authoring process. We fine-tuned state-of-the-art pre-trained LLMs and evaluated their performance on two tasks: synonym identification and parent-child relationship identification. The models achieved 98% accuracy in the first task and 75.4% accuracy in the second, demonstrating significant capabilities in automating synonym identification and relationship classification. In addition to providing a methodological basis for further extending and improving these results, we demonstrate that LLMs can be effectively used in ontology development and maintenance. This can save time and effort in the process.
https://aisel.aisnet.org/hicss-58/da/nlp_and_llms/3