Algorithm for word segmentation based on the shortest path algorithm inside a graph

• Date: 2017
• Main Authors: Lande, D. V., Berezin, B. A., Pavlenko, O. Yu.
• Format: Article
• Language: Russian
• Published: Інститут проблем реєстрації інформації НАН України 2017
• Subjects: words segmentation; word segmentation quality; web resources monitoring; shortest path search; wave algorithm
• Online Access: http://drsp.ipri.kiev.ua/article/view/142917
• Journal Title: Data Recording, Storage & Processing

The features of word segmentation algorithms from such texts are considered. There are two main models, namely, statistical one and the one using a dictionary. For models with a dictionary, a variant of the maximal matching algorithm is noted for which there are modifications such as Forward Maximal...