Vol. 14 (2025)
Language and Law

Research Articles

A Comparative Study of Accuracy in Human vs. AI Translation of Legal Documents into Arabic

Published 05.04.2025

  • Abdel Rahman Mitib Altakhaineh
    • ,
  • Ghazi Ayed Alghathian
    • ,
  • Mashal Mufleh Jarrah

Abdel Rahman Mitib Altakhaineh
The University of Jordan

Ghazi Ayed Alghathian
The University of Jordan

Mashal Mufleh Jarrah
The University of Jordan

Abstract

This study investigates the comparative accuracy of human and AI-generated translations of legal documents into Arabic, focusing specifically on the performance of ChatGPT against human translations. This study employs a comparative research design, where a corpus of words 20,000 words from legal texts, including contracts and agreements, translated by both AI and professional human translators. The research aimed to assess three primary dimensions: correct legal terminology usage, clarity of expression, and adherence to the Arabic legal framework. Through a structured evaluation process, key findings revealed that human translations significantly outperformed AI-generated versions in all assessed criteria. Human translators demonstrated superior mastery of legal terminology and clarity in complex legal constructs, as well as adherence to formal legal standards and cultural differences inherent in Arabic legal contexts. While AI tools like ChatGPT show promise in producing contextually relevant translations for simpler texts, they often fall short in capturing the precise legal terminology and complex constructs required for effective legal communication. This research highlights the continued necessity of skilled human translators in the legal field and suggests a hybrid approach that leverages AI tools to augment human expertise in translation processes.

Cite as: Altakhaineh et al., JLL 14 (2025), 63-80, DOI: 10.14762/jll.2025.063

Keywords

translation accuracy, human translation, AI translation, legal documents, Arabic language, translation evaluation, corpus analysis

PDF

References

  1. Al-Romany, Hussein; Tahseen, Ali & Maryam Jawad, Kadhim (2024). Artificial intelligence impact on human translation: Legal texts as a case study. International Journal of Linguistics, Literature and Translation, 7(5), 89–95.
  2. Alwazna, Rafat (2013). Testing the precision of legal translation: The case of translating Islamic legal terms into English. International Journal for the Semiotics of Law-Revue Internationale de Sémiotique Juridique, 26, 897–907. DOI: 10.14762/jll.2025.063 79
  3. Altakhaineh et al. A Comparative Study of Accuracy JLL 14 (2025): 63–80
  4. Awadh, Awadh Nasser Munassar (2024). Challenges and strategies of translating scientific texts: A comparative study of human translation and artificial intelligence. Educational Administration: Theory and Practice, 30(4), 9898–9909.
  5. Benbada, Mohamed Lamine & Nesrine Benaouda (2023). Investigation of the Role of Artificial Intelligence in Developing Machine Translation Quality. Case Study: Reverso Context and Google Translate Translations of Expressive and Descriptive Texts. Language Combination: Arabic-English/English-Arabic (Doctoral dissertation, Faculty of Letters and Languages-Department of English).
  6. Berūkštienė, Donata (2016). Legal discourse reconsidered: Genres of legal texts. Comparative Legilinguistics, 28(1), 89–119.
  7. Diaz, Maria(2023).How to use Chat GPT: Everything you need to know. ZDNET. Availableatzdnet.com/ar- ticle/howto-use-chatgpt (accessed 12 March 2025).
  8. Ding, Lijie (2024). A comparative study on the quality of English-Chinese translation of legal texts between ChatGPT and neural machine translation systems. Theory and Practice in Language Studies, 14(9), 2823–2833.
  9. Guo, Yunyun & Yu, Hao (2023). The importance of discourse types in translation from the perspective of discourse analysis. Lecture Notes on Language and Literature, 6(9), 37–44.
  10. Kit, Chunyu & Tak Ming Wong (2008). Comparative evaluation of online machine translation systems with legal texts. Law Libr. J., 100, 401.
  11. Moneus, Ahmed Mohammed & Yousef Sahari (2024). Artificial intelligence and human translation: A con- trastive study based on legal texts. Heliyon, 10(6), 1–14.
  12. Moorkens, Joss; Sheila, Castilho; Federico, Gaspari & Stephen, Doherty (2018). Translation quality assessment. Machine Translation: Technologies and Applications Ser. Cham: Springer International Publishing, 1, 299.
  13. O'Brien, Sharon (2012). Translation as human–computer interaction. Translation Spaces, 1(1), 101–122. O'Hagan, Minako (2016). Translations| massively open translation: Unpacking the relationship between
  14. technology and translation in the 21st Century. International Journal of Communication, 10, 18.
  15. Omar, Lamis Ismail & Abdelrahman Abdalla Salih (2024). Systematic review of English/Arabic machine translation postediting: Implications for AI application in translation research and pedagogy. Informatics, 11(2), 23.
  16. Rahim, Noor Riyadh (2024). Google and legal translation: The case study of contracts. AWEJ for Translation & Literary Studies, 8(2), 196–210.
  17. Soriano Barabino, Guadalupe (2020). Cultural, textual and linguistic aspects of legal translation: A model of text analysis for training legal translators. International Journal of Legal Discourse, 5(2), 285–300.
  18. Tahseen, Wesam Mohsen & Hussein, Shifa'a Hadi (2024). Investigating Machine Translation Errors in Rendering English Literary Texts into Arabic. Integrated Journal for Research in Arts and Humanities, 4(1), 68–81.
  19. Yang, Chaoying (2022). The application of artificial intelligence in translation teaching. Proceedings of the 4th International Conference on Intelligent Science and Technology, 56–60.