Про еволюцію рекурентних нейронних систем

• Datum: 2024
• Hauptverfasser: Abramov, Gennadii, Gushchin, Ivan, Sirenka, Tetiana
• Format: Artikel
• Sprache: Englisch
• Veröffentlicht: The National Technical University of Ukraine "Igor Sikorsky Kyiv Polytechnic Institute" 2024
• Schlagworte: рекурентні нейронні мережі; технологія трансформер; KAN
• Online Zugang: http://journal.iasa.kpi.ua/article/view/322523
• Назва журналу: System research and information technologies

The evolution of neural network architectures, first of the recurrent type and then with the use of attention technology, is considered. It shows how the approaches changed and how the developers’ experience was enriched. It is important that the neural networks themselves learn to understand the de...