Improving text generation through introducing coherence metrics

• Дата: 2020
• Автори: Marchenko, O.O., Radyvonenko, O.S., Ignatova, T.S., Titarchuk, P.V., Zhelezniakov, D.V.
• Формат: Стаття
• Мова: English
• Опубліковано: Інститут кібернетики ім. В.М. Глушкова НАН України 2020
• Назва видання: Кибернетика и системный анализ
• Теми: Кібернетика
• Онлайн доступ: http://dspace.nbuv.gov.ua/handle/123456789/190337
• Назва журналу: Digital Library of Periodicals of National Academy of Sciences of Ukraine
• Цитувати: Improving text generation through introducing coherence metrics / O.O. Marchenko, O.S. Radyvonenko, T.S. Ignatova, P.V. Titarchuk, D.V. Zhelezniakov // Кибернетика и системный анализ. — 2020. — Т. 56, № 1. — С. 16–25. — Бібліогр.: 22 назв. — англ.

Text-based interaction using mobile devices is now ubiquitous, its main outlets being social networks, messengers, email conversations, virtual assistants, accessibility applications, etc. Its status implies the need to facilitate text input by the user and to devise ways to provide verbal feedback. In this paper, we discuss a method of unique text generation for mobile devices and its evaluation methodology as a solution for both stated challenges. We consider the opportunities given by the use of context (location, weather, scheduled events, etc.), the limitations in terms of computational resources and data usage, and the inherent subjectivity of creative task assessment given the number variety of possibly acceptable outputs. The comparison with other text generation approaches shows that the use of coherence metrics helps to achieve higher quality in terms of human perception. The Spearman correlation between the values of the proposed coherence metric and the human assessment of text readability is 0.86, which indicates the high quality of the metrics and the effectiveness of the method as a whole.