Algorithm for word segmentation based on the shortest path algorithm inside a graph

• Datum: 2017
• Hauptverfasser: Lande, D. V., Berezin, B. A., Pavlenko, O. Yu.
• Format: Artikel
• Sprache: Russian
• Veröffentlicht: Інститут проблем реєстрації інформації НАН України 2017
• Schlagworte: words segmentation; word segmentation quality; web resources monitoring; shortest path search; wave algorithm
• Online Zugang: http://drsp.ipri.kiev.ua/article/view/142917
• Назва журналу: Data Recording, Storage & Processing

The features of word segmentation algorithms from such texts are considered. There are two main models, namely, statistical one and the one using a dictionary. For models with a dictionary, a variant of the maximal matching algorithm is noted for which there are modifications such as Forward Maximal...