ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information
arXiv:2106.16038v3 Announce Type: replace Abstract: Recent pretraining models in Chinese neglect two important aspects specific to the Chinese language: glyph and pinyin, which carry significant synta