article

An Analysis of Syntactic Complexity in Texts Translated by Google Translate and Human Translator from Arabic into English

  • Aziz Mohammed Abdo Saeed 1
  1. 1. Master of English Linguistics, English Department, Faculty of Arts, Thamar University, Republic of Yemen
Issue: Vol. 7 No. 1 (2025)
Pages: 694-710
Published: 2025-02-26
DOI: 10.53286/arts.v7i1.2305
PDF

Abstract

This paper compared the syntactic complexity of translations from Arabic into English produced by Google Translate with human translation of the same texts using the web-based L2 Syntactic Complexity Analyzer (L2SCA). Syntactic complexity is an important aspect of writing quality and language proficiency in general. Understanding how machine translation tools deal with syntactic complexity when translating texts from Arabic into English will offer insights for their efficacy. The study analyzed the syntactic complexity of translations of five text samples collected from an Arabic book “Hiwar Ma’a Sadeeqi Almulhid” [Dialogue with An Atheist] by Mostafa Mahmoud. The output of Google Translate is compared with human translation for the same texts by Mohammed Yahia. The results showed that Google Translate output has lower syntactic complexity ratios for most of the 10 indices measured. The paper highlighted key findings that have implications for developing machine translation quality. This paper contributes to the ongoing development of machine translation.

Keywords

Syntactic Complexity Human Translation Machine Translation Google Translate

Downloads

Download data is not yet available.

References (35)

  1. Ai, H., & Lu, X. (2013). A Corpus-based Comparison of Syntactic Complexity in NNS and NS University Students' Writing. Amsterdam: John Benjamins.
  2. Alnasery, I. H. S. (2024). Reducing the Ambiguity in Translating Prepositions from English into Arabic. Arts for Linguistic & Literary Studies, 6(2), 541–555. https://doi.org/10.53286/arts.v6i2.1959
  3. Alsahlanee, A., & Jaganathan, P. (2023). Phrasal Syntactic Complexity Measures in Linguistics Research Articles Written by Iraqi and English L1 Writers. 3L the Southeast Asian Journal of English Language Studies, 29(1), 154–168. https://doi.org/10.17576/3l-2023-2901-11.
  4. Ashuja’a, A., & Jibreel, I. (2024). Translator Praxis: An Investigation into the Practical Component in BA Translation Programs at Yemeni Universities. Arts for Linguistic & Literary Studies, 6(3), 574–604. https://doi.org/10.53286/arts.v6i3.2085
  5. Ataman, D., Negri, M., Turchi, M., & Federico, M. (2017). Linguistically Motivated Vocabulary Reduction for Neural Machine Translation from Turkish to English. the Prague Bulletin of Mathematical Linguistics, 108(1), 331–342. https://doi.org/10.1515/pralin-2017-0031
  6. Bulté, B., & Housen, A. (2014). "Conceptualizing and measuring short-term changes in L2 writing complexity." Journal of Second Language Writing 26, 42-65.
  7. Cancino, M., & Panes, J. (2021). The impact of Google Translate on L2 writing quality measures: Evidence from Chilean EFL high school learners. System, 98, 102464. https://doi.org/10.1016/j.system.2021.102464
  8. Dagan, I., Glickman, O., & Magnini, B. (2006). The PASCAL Recognising Textual Entailment Challenge. In Lecture notes in computer science (pp. 177–190). https://doi.org/10.1007/11736790_9
  9. Deng, Y., Lei, L., & Liu, D. (2019). Calling for More Consistency, Refinement, and Critical Consideration in the Use of Syntactic Complexity Measures for Writing. Applied Linguistics, 42(5), 1021–1028. https://doi.org/10.1093/applin/amz069
  10. Elmahdi, O. E. H. & Mohamad, H. M. H. (2024). Developing Translation and Interpretation Skills: An Analysis of Students' Linguistic Needs, Arts for Linguistic & Literary Studies, 6(4): 652 -671
  11. Google Translate. (2024, October 1). In Wikipedia. https://en.m.wikipedia.org/wiki/Google_translate.
  12. Ha, M.J. (2023). Computer-Aided Analysis of Syntactic Elaboration of Written Argumentation Across Topics and L1s. Computer Assisted Language Learning Electronic Journal CALL-EJ), 24(1), 242-268
  13. Hwang, H., Jung, H., & Kim, H. (2020). Effects of Written Versus Spoken Production Modalities on Syntactic Complexity Measures in Beginning‐Level Child EFL Learners. Modern Language Journal, 104(1), 267-283. https://doi.org/10.1111/modl.12626
  14. Inoue, C. (2016). A comparative study of the variables used to measure syntactic complexity and accuracy in task-based research. Language Learning Journal, 44(4), 487–505. https://doi.org/10.1080/09571736.2015.1130079
  15. Jagaiah, T., Olinghouse, N. G., & Kearns, D. M. (2020). Syntactic complexity measures: variation by genre, grade-level, students’ writing abilities, and writing quality. Reading and Writing, 33(10), 2577–2638. https://doi.org/10.1007/s11145-020-10057-x
  16. Kisselev, O., Klimov, A., & Kopotev, M. (2021). Syntactic Complexity Measures as Indices of Language Proficiency in Writing: Focus on Heritage Learners of Russian. Heritage Language Journal, 18(3), 1–30. https://doi.org/10.1163/15507076-12340016
  17. Kisselev, O., Klimov, A., & Kopotev, M. (2022a). Syntactic complexity measures as linguistic correlates of proficiency level in learner Russian. In Studies in corpus linguistics (pp. 51–80). https://doi.org/10.1075/scl.104.03kis
  18. Kisselev, O., Klimov, A., & Kopotev, M. (2022b). Syntactic complexity measures as linguistic correlates of proficiency level in learner Russian. In Studies in corpus linguistics (pp. 51–80). https://doi.org/10.1075/scl.104.03kis
  19. Kyle, K., & Crossley, S. A. (2018). Measuring Syntactic Complexity in L2 Writing Using
  20. Fine-Grained Clausal and Phrasal Indices. Modern Language Journal, 102(2), 333–349. https://doi.org/10.1111/modl.12468
  21. Kyle, K., Crossley, S., & Verspoor, M. (2020). MEASURING LONGITUDINAL WRITING DEVELOPMENT USING INDICES OF SYNTACTIC COMPLEXITY AND SOPHISTICATION. Studies in Second Language Acquisition, 43(4), 781–812. https://doi.org/10.1017/s0272263120000546
  22. Larsson, T. & Kaatari, H. (2020). Syntactic complexity across registers: Investigating (in)formality in second-language writing. Journal of English for Academic Purposes 45, 1-16 https://doi.org/10.1016/j.jeap.2020.100850
  23. Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics 15(4): 474–496.
  24. Lu, X. (2011). A Corpus‐Based Evaluation of Syntactic Complexity Measures as Indices of College‐Level ESL Writers’ Language Development. TESOL Quarterly, 45(1), 36–62. https://doi.org/10.5054/tq.2011.240859
  25. Lu, X. (2017). Automated measurement of syntactic complexity in corpus-based L2 writing research and implications for writing assessment. Language Testing, 34(4), 493–511. https://doi.org/10.1177/0265532217710675
  26. Machine translation. (2024, May 18). In Wikipedia. https://en.m.wikipedia.org/wiki/Machine_translation.
  27. Mahmoud, M. (1986). Hiwar Ma'a Sadeeqi Amulhid [Dialogue With An Atheist]. Dar Ala'awda, Beirut.
  28. Mahmoud, M. (2000). Dialogue With An Atheist (M, Yehia, Trans.). Dar Al Taqwa. (1986).
  29. Norris, J.M. and Ortega, L. (2009), “Measurement for understanding: An organic approach to investigating complexity, accuracy, and fluency in SLA”, Applied Linguistics, 30, 555–578.
  30. Ortega, L. (2003). Syntactic Complexity Measures and their Relationship to L2 Proficiency: A Research Synthesis of College-level L2 Writing. Applied Linguistics, 24(4), 492–518. https://doi.org/10.1093/applin/24.4.492
  31. Park, S. (2012). A Corpus-Based Study of Syntactic Complexity Measures as Developmental Indices of College-Level L2 Learners’ Proficiency in Writing. Korean Journal of Applied Linguistics, 28(3), 139. https://doi.org/10.17154/kjal.2012.09.28.3.139
  32. Yang, W., Lu, X., & Weigle, S. C. (2015). Different topics, different discourse: Relationships among writing topic, measures of syntactic complexity, and judgments of writing quality. Journal of Second Language Writing, 28, 53–67. https://doi.org/10.1016/j.jslw.2015.02.002
  33. Yu, Q. (2019). An Organic Syntactic Complexity Measure for the Chinese Language: The TC-Unit. Applied Linguistics, 42(1), 60–92. https://doi.org/10.1093/applin/amz064
  34. Zeng, X. (2023). Comparing Syntactic Complexity: Research Papers Written by Undergraduate Researchers and Published Research Papers. Journal of Education, 203(1) 129-138. https://doi.org/10.1177/00220574211016435
  35. Zindela, N. (2023). Comparing Measures of Syntactic and Lexical Complexity in Artificial Intelligence and L2 Human-Generated Argumentative Essays. International Journal of Education and Development using Information and Communication Technology (IJEDICT) 19(3), 50-68

Similar Articles

1-10 of 133

You may also start an advanced similarity search for this article.