Multimodal RAG using text and visual data

• Date: 2025
• Main Authors: Shevchenko, M.H., Androshchuk, M.V.
• Format: Article
• Language: Ukrainian
• Published: PROBLEMS IN PROGRAMMING 2025
• Subjects: Retrieval-Augmented Generation; multimodality; medical imaging; report generation; deep learning; large language models; UDC 004.8
• Online Access: https://pp.isofts.kiev.ua/index.php/ojs1/article/view/859
• Journal Title: Problems in programming

This paper presents the development and investigation of a multimodal Retrieval-Augmented Generation system designed for the analysis and interpretation of medical images. The research focuses on chest X-ray images and their corresponding radiology reports. The primary goal was to create a system ca...