<link rel="stylesheet" href="styles.f3b1fba60ec7970c.css">

Method for constructing a cognitive map of processes in a dynamic system using cooperation of large language models

Ескіз

Файли

187421.pdf (1,22 MB)

Дата

2025

Автори


Назва журналу

Номер ISSN

Назва тому

Видавець

Vinnytsia National Technical University

DOI

https://doi.org/10.63341/vitce/1.2025.69

Анотація

In the context of growing demands for rapid decision-making and in-depth analysis of complex dynamic systems – particularly when available data are limited and the involvement of experienced experts is either impractical or prohibitively expensive – the development of new methods for the construction of the model becomes especially relevant. The use of large language models (LLMs) as expert systems offers significant reductions in resource expenditure and accelerates the modelling of complex technical, environmental, and socio-economic systems. This study aimed to investigate and demonstrate the potential and capabilities of LLMs as expert systems in constructing cognitive maps. The article proposes and substantiates an architecture for the cooperation of LLM ensembles to formally generate vertices-variables and weight coefficients in cognitive maps, thereby enabling the automation of the modelling process without the involvement of human experts. A typical prompt for an LLM was decomposed into structural components: context description (D), model role instruction (R), instruction (I), conditions (C), and response format (F). A method for determining these components through expert-based analysis is proposed. A prompt system was developed to enable structured data processing and the identification of interrelationships among system elements. The practical effectiveness of the approach was demonstrated using a case study on forecasting water quality in the Sabarivske Reservoir near Vinnytsia. For most physicochemical indicators, the modelling showed low error rates (2.09-4.6%), even with a minimal amount of input data. The proposed method is promising for modelling and forecasting tasks in complex systems with limited data availability, particularly in environmental, socio-economic, and engineering contexts, where the speed of obtaining reliable results is critical for informed decision-making.

Опис

Ключові слова

LLM , cognitive map , large language models , generative artificial intelligence , intelligent technology , decomposition , systems analysis , modeling , forecasting , prompt system , automation , dynamic system

УДК

004.8

Тип документа

Article, professional native edition
Article

Мова

en_US

Є частиною

Information Technologies and Computer Engineering. № 1 (22) : 69-78.

ISSN

1999-9941

Бібліографічний опис

Varer B., Mokin V. Method for constructing a cognitive map of processes in a dynamic system using cooperation of large language models // Information Technologies and Computer Engineering. 2025. № 1 (22). С. 69-78. DOI: https://doi.org/10.63341/vitce/1.2025.69.

URI

https://ir.lib.vntu.edu.ua/handle/123456789/49882

Зібрання

Інформаційні технології та комп'ютерна інженерія. 2025. № 1
Наукові видання каф. САІТ

Схвалення

Рецензія

Доповнено

Цитується в

Список використаної літератури (23)

  1. Akiba, T., Shing, M., Tang, Y. & Ha, D. (2025). Evolutionary optimization of model merging recipes. Nature Machine Intelligence, 7(2), 195-204. doi: 10.1038/s42256-024-00975-8.
  2. Bender, E.M., & Koller, A. (2020). Climbing towards NLU: On meaning, form, and understanding in the age of data. In Proceedings of the 58th annual meeting of the association for computational linguistics (pp. 5185-5198). Stroudsburg: Association for Computational Linguistics. doi: 10.18653/v1/2020.acl-main.463.
  3. Bender, E.M., Gebru, T., McMillan-Major, A., & Shmitchell, S. (2021). On the dangers of stochastic parrots: Can language models be too big? In Proceedings of the 2021 ACM conference on fairness, accountability, and transparency (FAccT‘21) (pp. 610-623). Stroudsburg: Association for Computing Machinery. doi: 10.1145/3442188.3445922
  4. Cao, H., Ma, R., Zhai, Y., & Shen, J. (2024). LLM-Collab: A framework for enhancing task planning via chain-of-thought and multi-agent collaboration. Applied Computing and Intelligence, 4(2), 328-348. doi: 10.3934/aci.2024019.
  5. Chen, S.-W., & Hsu, H.-J. (2023). MisCaltral: Reducing numeric hallucinations of mistral with precision numeric calculation. Research Square. doi: 10.21203/rs.3.rs-3789011/v1.
  6. Cherniuk, O. (2023). Modeling the impact of AI-based chatbots on the quality of higher education using system analysis methods. Information Technologies and Society, 3(9), 80-90. doi: 10.32689/maup.it.2023.3.11.
  7. Das, S., & Srihari, R. (2024). Compos mentis at SemEval2024 Task6: A multi-faceted role-based large language model ensemble to detect hallucination. In Proceedings of the 18th international workshop on semantic evaluation (SemEval-2024) (pp. 1449-1454). Mexico City: Association for Computational Linguistics. doi: 10.18653/v1/2024. semeval-1.208.
  8. Feleki, A., Apostolopoulos, I.D., Moustakidis, S., Papageorgiou, E.I., Papathanasiou, N., Apostolopoulos, D., & Papandrianos, N. (2023). Explainable deep fuzzy cognitive map diagnosis of coronary artery disease: Integrating myocardial perfusion imaging, clinical data, and natural language insights. Applied Sciences, 13(21), article number 11953. doi: 10.3390/app132111953.
  9. Godoy, W.F., Fabri, J.A., Palácios, R.H.C., Mendonça, M., Gonçalves, J.F.S., & Moraes, L.O.M. (2024). Using fuzzy cognitive maps and chatbots to evaluate student satisfaction in a university: A comparison between strong and weak AI. In Proceedings of the eighteenth international conference on mobile ubiquitous computing, systems, services and technologies (pp. 16-20). Wilmington: IARIA Press
  10. Huang, L., et al. (2025). A survey on hallucination in large language models: Principles, taxonomy, challenges, and open questions. ACM Transactions on Information Systems, 43(2), article number 42. doi: 10.1145/3703155.