Study on evaluation method of machine translation quality based on questionnaires and data analysis

DOI

10.2991/icmemtc-16.2016.300How to use a DOI?

Keywords

Evaluation; machine translation; questionnaires; Euclidean distance

Abstract

In order to do a global evaluation of translation software and compare their differences within specific indicators, the study applied Euclidean distance and cosine similarity to evaluate 4 commonly used translation software tools, based on the analysis of the data from the questionnaire. The results suggest that software A and B are good in general, especially at the vocabulary translation. However, there are still some shortcomings in the discourse translation. Therefore, they should accumulate more materials in the Chinese corpus. It is concluded that Euclidean distance covers the shortage of randomness and the limitations to the micro level of the present evaluation methods such as BLEU. Meanwhile, Euclidean distance has higher accuracy and more convenient calculation than the cosine similarity. It can be used to evaluate translation software effectively.

Copyright

© 2016, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Yiqun Sun
AU  - Minkang Zhou
PY  - 2016/04
DA  - 2016/04
TI  - Study on evaluation method of machine translation quality based on questionnaires and data analysis
BT  - Proceedings of the 2016 3rd International Conference on Materials Engineering, Manufacturing Technology and Control
PB  - Atlantis Press
SP  - 1565
EP  - 1570
SN  - 2352-5401
UR  - https://doi.org/10.2991/icmemtc-16.2016.300
DO  - 10.2991/icmemtc-16.2016.300
ID  - Sun2016/04
ER  -