Multimodal RAG using text and visual data

• Veröffentlicht in: PROBLEMS IN PROGRAMMING
• Datum: 2025
• Heft: 3
• Сторінки: 66-78
• ISSN: 1727-4907
• Автори та афіліації: M.H. Shevchenko — National University "Kyiv-Mohyla Academy"; M.V. Androshchuk — National University "Kyiv-Mohyla Academy"
• Hauptverfasser: Shevchenko, M.H., Androshchuk, M.V.
• Format: Artikel
• Sprache: Ukrainisch
• Veröffentlicht: PROBLEMS IN PROGRAMMING 2025
• Schlagworte: Retrieval-Augmented Generation; multimodality; medical imaging; report generation; deep learning; large language models; UDC 004.8
• Online Zugang: https://pp.isofts.kiev.ua/index.php/ojs1/article/view/859
• Назва журналу: Problems in programming

This paper presents the development and investigation of a multimodal Retrieval-Augmented Generation system designed for the analysis and interpretation of medical images. The research focuses on chest X-ray images and their corresponding radiology reports. The primary goal was to create a system ca...