基于依存距离惩罚的泰汉神经机器翻译方法
Communications Technology（2022）
昆明理工大学
Abstract
在"一带一路"倡议的背景下,泰国与我国的沟通日益密切,泰汉机器翻译具有很高的应用需求.作为低资源语言机器翻译,泰汉之间缺乏大规模、高质量的平行语料,导致翻译效果不佳.融入依存句法知识可以使译文更符合句法约束,弥补没有大规模平行语料的缺陷,但泰语缺少成熟的依存解析工具和依存标注训练集.针对以上问题,基于无监督迁移获取泰语依存句法结构知识,并提出依存距离惩罚机制以减少依存噪声对翻译性能的干扰,并通过基于依存感知注意力机制的Transformer架构将所提方法融入翻译.实验结果表明,该方法能有效提升泰汉神经机器翻译的效果.
More求助PDF
上传PDF
View via Publisher
AI Read Science
AI Summary
AI Summary is the key point extracted automatically understanding the full text of the paper, including the background, methods, results, conclusions, icons and other key content, so that you can get the outline of the paper at a glance.
Example
Background
Key content
Introduction
Methods
Results
Related work
Fund
Key content
- Pretraining has recently greatly promoted the development of natural language processing (NLP)
- We show that M6 outperforms the baselines in multimodal downstream tasks, and the large M6 with 10 parameters can reach a better performance
- We propose a method called M6 that is able to process information of multiple modalities and perform both single-modal and cross-modal understanding and generation
- The model is scaled to large model with 10 billion parameters with sophisticated deployment, and the 10 -parameter M6-large is the largest pretrained model in Chinese
- Experimental results show that our proposed M6 outperforms the baseline in a number of downstream tasks concerning both single modality and multiple modalities We will continue the pretraining of extremely large models by increasing data to explore the limit of its performance
Upload PDF to Generate Summary
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Data Disclaimer
The page data are from open Internet sources, cooperative publishers and automatic analysis results through AI technology. We do not make any commitments and guarantees for the validity, accuracy, correctness, reliability, completeness and timeliness of the page data. If you have any questions, please contact us by email: report@aminer.cn
Chat Paper
Summary is being generated by the instructions you defined