LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching

Abstract: Chinese short text matching is a fundamental task in natural language processing. Existing approaches usually take Chinese characters or words as input tokens. They have two limitations: 1) Some Chinese words are polysemous, and semantic information is not fully utilized. 2) Some models suffer potential issues caused by word segmentation. Here we introduce HowNet as an external knowledge base and propose a Linguistic knowledge Enhanced graph Transformer (LET) to deal with word ambiguity. Additionally, we adopt the word lattice graph as input to maintain multi-granularity information. Our model is also complementary to pre-trained language models. Experimental results on two Chinese datasets show that our models outperform various typical text matching approaches. Ablation study also indicates that both semantic information and multi-granularity information are important for text matching modeling.

08/12/2020

LET: Linguistic Knowledge Enhanced Graph Transformer for Chinese Short Text Matching

Boer Lyu, Lu Chen, Su Zhu, Kai Yu

Comments

Similar Papers

Multi-grained Chinese Word Segmentation with Weakly Labeled Data

Chen Gong, Zhenghua Li, Bowei Zou, Min Zhang

Keywords Abstract Paper

Joint Chinese Word Segmentation and Part-of-speech Tagging via Two-way Attentions of Auto-analyzed Knowledge

Yuanhe Tian, Yan Song, Xiang Ao and Fei Xia, Xiaojun Quan, Tong Zhang, Yonggang Wang

Keywords Abstract Paper

Chinese Segmentation, Part-of-speech Tagging, Chinese processing, joint tagging

Neural Graph Matching Networks for Chinese Short Text Matching

Lu Chen, Yanbin Zhao, Boer Lv and Lesheng Jin, Zhi Chen, Su Zhu, Kai Yu

Keywords Abstract Paper

Chinese Matching, Chinese segmentation, matching, Neural Networks

Synonym Knowledge Enhanced Reader for Chinese Idiom Reading Comprehension

Siyu Long, Ran Wang, Kun Tao and Jiali Zeng, Xinyu Dai

Keywords Abstract Paper

A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing

Hang Yan, Xipeng Qiu, Xuanjing Huang

Keywords Abstract Paper

Joint Segmentation, Joint Parsing, Chinese segmentation, dependency parsing

Bridging the Domain Gap: Improve Informal Language Translation via Counterfactual Domain Adaptation

Ke Wang, Guandan Chen, Zhongqiang Huang and Xiaojun Wan, Fei Huang

Keywords Abstract Paper

Joint Chinese Word Segmentation and Part-of-speech Tagging via Multi-channel Attention of Character N-grams

Yuanhe Tian, Yan Song, Fei Xia

Keywords Abstract Paper

Chinese Paragraph-level Discourse Parsing with Global Backward and Local Reverse Reading

Feng Jiang, Xiaomin Chu, Peifeng Li and Fang Kong, Qiaoming Zhu

Keywords Abstract Paper

A Joint Multiple Criteria Model in Transfer Learning for Cross-domain Chinese Word Segmentation

Kaiyu Huang, Degen Huang, Zhuang Liu, Fengran Mo

Keywords Abstract Paper

natural, chinese segmentation, chinese, chinese tasks

2kenize: Tying Subword Sequences for Chinese Script Conversion

- Pranav A, Isabelle Augenstein

Keywords Abstract Paper

Chinese Conversion, Chinese NLP, mapping sequences, topic classification

Don’t change me! User-controllable selective paraphrase generation

Mohan Zhang, Luchen Tan, Zihang Fu and Kun Xiong, Jimmy Lin, Ming Li, Zhengkai Tu

Keywords Abstract Paper

Incorporating Uncertain Segmentation Information into Chinese NER for Social Media Text

Shengbin Jia, Ling Ding, Xiaojun Chen and Shijia E, Yang Xiang

Keywords Abstract Paper

SpellGCN: Incorporating Phonological and Visual Similarities into Language Models for Chinese Spelling Check

Xingyi Cheng, Weidi Xu, Kunlong Chen and Shaohua Jiang, Feng Wang, Taifeng Wang, Wei Chu, Yuan Qi

Keywords Abstract Paper

Chinese Check, spelling errors, spelling language, CSC

Diverse and Informative Dialogue Generation with Context-Specific Commonsense Knowledge Awareness

Sixing Wu, Ying Li, Dawei Zhang and Yang Zhou, Zhonghai Wu

Keywords Abstract Paper

Diverse Generation, dialogue generation, Context-Specific Awareness, Generative systems

Improving the Efficiency of Grammatical Error Correction with Erroneous Span Detection and Correction

Mengyun Chen, Tao Ge, Xingxing Zhang and Furu Wei, Ming Zhou

Keywords Abstract Paper

erroneous detection, erroneous correction, inference, language-independent approach

Knowledge-Aware Dialogue Generation via Hierarchical Infobox Accessing and Infobox-Dialogue Interaction Graph Network

Sixing Wu, Minghui Wang, Dawei Zhang and Yang Zhou, Ying Li, Zhonghai Wu

Keywords Abstract Paper

Natural Language Processing, Dialogue, Natural Language Generation

Try to Substitute: An Unsupervised Chinese Word Sense Disambiguation Method Based on HowNet

Bairu Hou, Fanchao Qi, Yuan Zang and Xurui Zhang, Zhiyuan Liu, Maosong Sun

Keywords Abstract Paper

Enhancing Pre-trained Chinese Character Representation with Word-aligned Attention

Yanzeng Li, Bowen Yu, Xue Mengge, Tingwen Liu

Keywords Abstract Paper

segmentation propagation, Pre-trained Representation, Chinese models, word-aligned attention

Pre-training via Leveraging Assisting Languages for Neural Machine Translation

Haiyue Song, Raj Dabre, Zhuoyuan Mao and Fei Cheng, Sadao Kurohashi, Eiichiro Sumita

Keywords Abstract Paper

Neural Translation, S2S tasks, LOI, low-resource translation

Glyph2Vec: Learning Chinese Out-of-Vocabulary Word Embedding from Glyphs

Hong-You Chen, SZ-HAN YU, Shou-de Lin

Keywords Abstract Paper

Chinese Embedding, Chinese applications, Chinese problem, out-of-vocabulary embedding

English-to-Chinese transliteration with phonetic auxiliary task

Yuan He, Shay B. Cohen

Keywords Abstract Paper

XREF: Entity Linking for Chinese News Comments with Supplementary Article Reference

Keywords Paper

Yuanhe Tian, Yan Song, Xiang Ao and
Fei Xia, Xiaojun Quan, Tong Zhang, Yonggang Wang

Keywords Paper

Lu Chen, Yanbin Zhao, Boer Lv and
Lesheng Jin, Zhi Chen, Su Zhu, Kai Yu

Keywords Paper

Siyu Long, Ran Wang, Kun Tao and
Jiali Zeng, Xinyu Dai

Keywords Paper

Keywords Paper

Ke Wang, Guandan Chen, Zhongqiang Huang and
Xiaojun Wan, Fei Huang

Keywords Paper

Keywords Paper

Feng Jiang, Xiaomin Chu, Peifeng Li and
Fang Kong, Qiaoming Zhu

Keywords Paper

Keywords Paper

Keywords Paper

Mohan Zhang, Luchen Tan, Zihang Fu and
Kun Xiong, Jimmy Lin, Ming Li, Zhengkai Tu

Keywords Paper

Shengbin Jia, Ling Ding, Xiaojun Chen and
Shijia E, Yang Xiang

Keywords Paper

Xingyi Cheng, Weidi Xu, Kunlong Chen and
Shaohua Jiang, Feng Wang, Taifeng Wang, Wei Chu, Yuan Qi

Keywords Paper

Sixing Wu, Ying Li, Dawei Zhang and
Yang Zhou, Zhonghai Wu

Keywords Paper

Mengyun Chen, Tao Ge, Xingxing Zhang and
Furu Wei, Ming Zhou

Keywords Paper

Sixing Wu, Minghui Wang, Dawei Zhang and
Yang Zhou, Ying Li, Zhonghai Wu

Keywords Paper

Bairu Hou, Fanchao Qi, Yuan Zang and
Xurui Zhang, Zhiyuan Liu, Maosong Sun

Keywords Paper

Keywords Paper

Haiyue Song, Raj Dabre, Zhuoyuan Mao and
Fei Cheng, Sadao Kurohashi, Eiichiro Sumita

Keywords Paper

Keywords Paper

Keywords Paper

Keywords Paper

Keywords Paper

Keywords Paper

Feng Jiang, Yaxin Fan, Xiaomin Chu and
Peifeng Li, Qiaoming Zhu, Fang Kong

Keywords Paper

Keywords Paper

Wenyu Du, Zhouhan Lin, Yikang Shen and
Timothy J. O'Donnell, Yoshua Bengio, Yue Zhang

Keywords Paper

Keywords Paper

Keywords Paper

Keywords Paper

Wenhui Han, Xinlin Ren, Hangyu Lin and
Yanwei Fu, Xiangyang Xue

Keywords Paper

Ruotian Ma, Minlong Peng, Qi Zhang and
Zhongyu Wei, Xuanjing Huang

Keywords Paper

Ning Ding, Dingkun Long, Guangwei Xu and
Muhua Zhu, Pengjun Xie, Xiaobin Wang, Haitao Zheng

Keywords Paper

Keywords Paper

Keywords Paper

Hanqing Tao, Shiwei Tong, Kun Zhang and
Tong Xu, Qi Liu, Enhong Chen, Min Hou

Keywords Paper