Про еволюцію рекурентних нейронних систем

• Date: 2024
• Main Authors: Abramov, Gennadii, Gushchin, Ivan, Sirenka, Tetiana
• Format: Article
• Language: English
• Published: The National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute" 2024
• Subjects: рекурентні нейронні мережі; технологія трансформер; KAN
• Online Access: http://journal.iasa.kpi.ua/article/view/322523
• Journal Title: System research and information technologies

The evolution of neural network architectures, first of the recurrent type and then with the use of attention technology, is considered. It shows how the approaches changed and how the developers’ experience was enriched. It is important that the neural networks themselves learn to understand the de...