Volume 14 Number 4 (Apr. 2019)
Home > Archive > 2019 > Volume 14 Number 4 (Apr. 2019) >
JCP 2019 Vol.14(4): 311-317 ISSN: 1796-203X
doi: 10.17706/jcp.14.4.311-317

Chinese Text Similarity Algorithm Based on Part-of-Speech Tagging and Word Vector Model

Zhixin Ma, Mengguang Li
College of Information Science and Engineering, Lanzhou University, Lanzhou, China.
Abstract—Based on the unique structure of Chinese text data in the field of building materials, this paper proposes a Chinese text similarity calculation method based on part-of-speech tagging and word vector model. By analyzing the special structure of Chines text data in the building materials field, the method realizes specific part-of-speech tagging by using the machine, which saves a lot of manpower and time consumption required for manual labeling. Then, combined with the word vector model, the text similarity calculation is realized by these steps: Chinese word segmentation, syntactic analysis, and similar matching of the annotated text. This paper comprehensively compares the word level similarity calculation method based on the vector space model. Through analysis and experimental comparison, the algorithm in this paper obtains an average F value of 72.0%, which is improved by 20.67% compared with the method based on vector space model, and has achieved better test results.

Index Terms—Chinese text similarity, word vector model, part-of-speech tagging, vector space model.

[PDF]

Cite: Zhixin Ma, Mengguang Li, "Chinese Text Similarity Algorithm Based on Part-of-Speech Tagging and Word Vector Model," Journal of Computers vol. 14, no. 4, pp. 311-317, 2019.

General Information

ISSN: 1796-203X
Frequency: Monthly
Editor-in-Chief: Prof. Liansheng Tan
Executive Editor: Ms. Nina Lee
Abstracting/ Indexing: DBLP, EBSCO,  ProQuest, INSPEC, ULRICH's Periodicals Directory, WorldCat, CNKI,etc
E-mail: jcp@iap.org
  • Sep 13, 2018 News!

    Vol 13, No 10 has been published with online version   [Click]

  • Apr 28, 2019 News!

    Vol 14, No 4 has been published with online version 8 papers are published in this issue after peer review   [Click]

  • Mar 20, 2019 News!

    Vol 14, No 3 has been published with online version   [Click]

  • Feb 22, 2019 News!

    Vol 14, No 2 has been published with online version 8 papers are published in this issue after peer review   [Click]

  • Jan 04, 2019 News!

    Vol 14, No 1 has been published with online version   [Click]

  • Read more>>