An online health community user intention identification method based on BERT-BiGRU-Attention

1.Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming Yunnan;2.Yunnan Nantian Electronic Information Industry Co,Ltd,Kunming Yunnan

Clc Number:


Fund Project:

  • Article
  • |
  • Figures
  • |
  • Metrics
  • |
  • Reference
  • |
  • Related
  • |
  • Cited by
  • |
  • Materials
  • |
  • Comments

    To understand the user"s query intention is an important task in the field of QA. Traditional user intention recognition mainly uses methods based on template matching or artificial feature set, aiming at its high cost and low scalability, a hybrid neural network intention recognition model based on BERT word embedding and BiGRU-Attention is proposed. The model treats intention recognition as a classification problem. Firstly, the word embedding pre-trained by BERT is used as the input. Secondly, complete context learning is carried out through BiGRU network and the final representation of continuous statements is obtained. Through the attention mechanism, the neural network can be assisted to give more weight to the words that have a direct effect on intention recognition in sentences, making intention recognition more explicit. Finally, user intention recognition is realized through classification. Experimental results show that the proposed method can effectively improve the accuracy of intention recognition accuracy.

    Cited by
Get Citation
Article Metrics
  • Abstract:
  • PDF:
  • HTML:
  • Cited by:
  • Received:April 17,2020
  • Revised:May 27,2020
  • Adopted:June 02,2020
  • Online:
  • Published: