Modelling videocard memory performance for LLM neural networks

• Datum: 2024
• Hauptverfasser: Rahozin, D.V., Doroshenko, A.Yu.
• Format: Artikel
• Sprache: Ukrainian
• Veröffentlicht: PROBLEMS IN PROGRAMMING 2024
• Schlagworte: videocard; large language model; computing performance; neural network; computational capability; UDC 681.3
• Online Zugang: https://pp.isofts.kiev.ua/index.php/ojs1/article/view/617
• Назва журналу: Problems in programming

The paper covers the analysis of performance characteristics of neural network-based algorithms class Generative pre-trained transformer, also known as Large Language Model, for contemporary videocards. The goal is to check the application limitations for this class of neural networks for mobile com...