Citation

Romanov A, Kurtukova A, Shelupanov A, Fedotova A, Goncharov V. Future Internet 2021; 13(1): 1-16.

Copyright

(Copyright © 2021, MDPI: Multidisciplinary Digital Publishing Institute)

DOI

10.3390/fi13010003

PMID

unavailable

Abstract

The article explores approaches to determining the author of a natural language text and the advantages and disadvantages of these approaches. The importance of the considered problem is due to the active digitalization of society and reassignment of most parts of the life activities online. Text authorship methods are particularly useful for information security and forensics. For example, such methods can be used to identify authors of suicide notes, and other texts are subjected to forensic examinations. Another area of application is plagiarism detection. Plagiarism detection is a relevant issue both for the field of intellectual property protection in the digital space and for the educational process. The article describes identifying the author of the Russian-language text using support vector machine (SVM) and deep neural network architectures (long short-term memory (LSTM), convolutional neural networks (CNN) with attention, Transformer). The results show that all the considered algorithms are suitable for solving the authorship identification problem, but SVM shows the best accuracy. The average accuracy of SVM reaches 96%. This is due to thoroughly chosen parameters and feature space, which includes statistical and semantic features (including those extracted as a result of an aspect analysis). Deep neural networks are inferior to SVM in accuracy and reach only 93%. The study also includes an evaluation of the impact of attacks on the method on models' accuracy. Experiments show that the SVM-based methods are unstable to deliberate text anonymization. In comparison, the loss in accuracy of deep neural networks does not exceed 20%. Transformer architecture is the most effective for anonymized texts and allows 81% accuracy to be achieved. © 2020 by the authors. Licensee MDPI, Basel, Switzerland.

Language: en

Keywords

Forensic science; Semantics; Authorship; Attribution; Support vector machines; Neural networks; Machine learning; Convolutional neural networks; Deep learning; Long short-term memory; Network architecture; Deep neural networks; Authorship identification; Educational process; Forensic examinations; Forensic intelligence; Intellectual property; Intellectual property protection; Natural language text; Plagiarism detection; Security of data; Semantic features; SVM-based methods; Text mining; Transformer protection