What is the translation accuracy of DeepL for Korean?

On January 31, DeepL translation added support for Korean and Norwegian. Korean, in particular, was highly requested by our customers. We promptly evaluated the translation accuracy of DeepL for Korean and compared it with Google and Microsoft.

Evaluation Method

Translated documents: 221 IT-related texts
Translation languages: Japanese→Korean, Korean→Japanese, English→Korean, Korean→English
Evaluation metric: BLEU (Note)

Note:
BLEU mechanically compares the machine-translated text with a human-created reference translation and calculates a similarity score. The range is from 0 to 1, with values closer to 1 indicating greater similarity to the reference translation. Even if the meaning is the same, the score decreases if words or expressions differ. It correlates with human evaluation, and higher values indicate higher machine translation accuracy. (In the graphs below, the values are multiplied by 100)

Results

DeepL ranked first in English-Korean and Korean-English, and second in Japanese-Korean and Korean-Japanese. Among the companies providing automatic translation services, it was the last to support Korean, but it has launched its service with sufficiently high translation accuracy.

Please note that translation accuracy also varies depending on the field of the translation subject. The following blog article summarizes translation accuracy by field for English-Japanese and Japanese-English, so please refer to it.

Latest Trends in Machine Translation and Comparison between "DeepL" and "Google Translate"
https://www.science.co.jp/nmt/blog/32334/

Please consider using different automatic translation services depending on the type and field of the documents. For a reliable assessment of translation accuracy, we recommend translating and evaluating documents you have yourself.

Summary

DeepL now supports Korean translation. It offers sufficiently high translation accuracy compared to other automatic translation services. When you need automatic translation for Korean, DeepL can be considered a viable option. However, since the quality of automatic translation services varies depending on the document and field, we recommend using multiple automatic translation services.

Our automatic translation product MTrans was among the first to support DeepL's Korean translation. In addition to DeepL, you can use multiple automatic translation services such as Google and Microsoft, allowing you to choose according to the document or field. Please try it with a two-week free trial. You can use DeepL with MTrans for Office, which enables one-click translation from Microsoft 365 apps (Outlook/Word/Excel/PowerPoint), and with MTrans for Phrase TMS/Trados, designed for professional translators.

For trial applications and product inquiries,
https://www.science.co.jp/localization/contact/index.html please contact us through this page.

Related Services