A Deeper Look into Metrics for Translation Quality Assessment (TQA): A Case Study
DOI:
https://doi.org/10.26754/ojs_misc/mj.20148792Keywords:
Translation Quality Assessment (TQA), quantitative methods, metrics, Quality Assessment Tool (QAT), fit-for-purpose, reliabilityAbstract
In spite of the professionalization of translators and their central role in international relations, there is yet no widely accepted methodology available for professional Translation Quality Assessment (TQA). At the same time, there exists a pressing need to standardize TQA criteria to mitigate the subjectivity prevailing over quality assessment. Evaluating the quality of a translation first requires defining concepts of Quality and Translation, which inevitably parallels the approach characteristic of a translation theory (House, 1997). In this case, the functionalist approach is embraced. The aim of this article is to review some of the most representative models for TQA with a view to lay the foundations to develop an alternative model. I begin by analyzing a selection of outstanding quantitative-oriented models of TQA (metrics), identifying their strengths and weaknesses as viable and efficient assessment tools. Having surveyed these models, I then propose suitable forms for refinement and for the polishing of existing metrics so as to establish a basis for the structuring of a new theoretical model for TQA. The result is a mixed approach to TQA that takes up an integrated view embedding both top-down (rubrics) and bottom-up (metrics) tools.
Downloads
References
Aenor. 2006. Norma Española UNE-EN 15038. Servicios de traducción. Requisitos para la prestación del Servicio. Madrid: AENOR.
Bowker, Lynne. 2000. “Towards a Methodology for Exploiting Specialized Target Language Corpora as Translation Resources”. International Journal of Corpus Linguistics 5: 17-52.
Brunette, Louise. 2000. “Towards a Terminology for Translation Quality Assessment— A Comparison for TQA Practices”. The Translator 6: 169-182.
Colina, Sonia. 2008. “Translation Quality Evaluation: Empirical evidence for a functionalist approach”. The Translator 14: 97-134.
—. 2009. “Further Evidence for a Functionalist Approach to Translation Quality Evaluation”. Target 21: 235–264.
Conde Ruano, José Tomás. 2008. Proceso y Resultado de la Evaluación de Traducciones. (Doctoral Dissertation, Universidad de Granada, Spain). Retrieved from http://digibug.ugr.es/handle/10481/2309 (Accessed 20 March, 2011).
Crosby, Philip Bayard. 1979. Quality is Free. New York: McGraw-Hill.
De Rooze, Bart. 2006. La Traducción, contra Reloj. Consecuencias de la Presión por Falta de Tiempo en el Proceso de Traducción. (Unpublished Doctoral Dissertation, Universidad de Granada, Spain). Retrieved from: http://isg.urv.es/library/papers/DeRooze-DissDraft03.pdf (Accessed 4 June, 2011)
Doyle, M. S. 2003. “Translation Pedagogy and Assessment: Adopting ATA’s Framework for Standard ErrorMarking”. The ATA Chronicle November/December 2003.
Gómez Gónzalez Jover, Adelina. 2002. “La Equivalencia como Cuestión Central de la Traducción en las instituciones de la Unión Europea”. In VV. AA. El español, lengua de traducción. I Congreso Internacional. Almagro: Comisión Europea y Agencia EFE: 438-457.
Gouadec, Daniel. 1981. “Paramètres de l’Evaluation des Traductions”. Meta 26: 96-116.
Hönig, Hans G. 1998. “Positions, Power and Practice: Functionalist Approaches and Translation Quality Assessment”. In Schäffner C. (ed.) Translation and Quality. Clevedon, UK: Multilingual Matters: 6-34.
Horguelin, Paul and Louise Brunette. 1998. Practique de la Revisión, 3ème Edition Revue et Augmenteé. Québec: Linguatech éditeur.
House, Juliane. 1997. Translation Quality Assessment: A Model Revisited. Tübingen, Germany: Gunter Narr.
Hurtado Albir, Amparo. 2004. Traducción y Traductología. Introducción a la Traductología. Madrid: Cátedra.
Japanese Industrial Standards Committee (JISC). 1981. Retrieved from http://www.jisc.go.jp/eng/index.html
Jiménez Crespo, Miguel Angel. 2009. “The Evaluation of Pragmatic and Functionalist Aspects in Localization: Towards a Holistic Approach to Quality Assurance”. The Journal of Internationalization and Localization 1: 60-93.
—. 2011. “A Corpus-Based Error Typology: Towards a More Objective Approach to Measuring Quality in Localization”. Perspectives, Studies in Translatology 19: 315-338.
Juran, Joseph M. 1990. Jurán y el Liderazgo para la Calidad. Un Manual para Directivos. México: Edición Díaz de Santos, S.A.
Larose, R. 1998. “Méthodologie de l’Évaluation des Traductions”. [A Method for Assessing Translation Quality]. Meta 43: 163-86.
Lisa. 2004. LISA Best Practice Guide: Quality Assurance — The Client Perspective. Geneva: The Localization Industry Standards Association (LISA).
—. 2007. The Globalization Industry Primer: An Introduction to Preparing your Business and Products for Success in International Markets. Geneva: The Localization Industry Standards Association (LISA).
Martínez Melis, Nicole and Amparo, Hurtado Albir. 2001. “Assessment in Translation Studies: Research Needs”. Meta 46: 272-287.
Martínez, Roberto and Silvia Montero. 2010. “Calidad y Traducción: El Caso de la DGT”. PuntoyComa 118. Boletín de los traductores españoles de las instituciones de la Unión Europea 118: 3-9.
Montero, Silvia, Pamela Faber and Miriam Buendía. 2011. Terminología para Traductores e Intérpretes: Una perspectiva integradora. (2nd ed.) Granada: Ediciones Tragacanto.
Moskal, Barbara M. 2000. “Scoring Rubrics: What, When and How”. Practical Assessment, Research & Evaluation 7. Retrieved from http://pareonline.net/getvn.asp?v=7&n=3 (Accessed 12 September, 2012)
Mossop, Brian. 2007. Revising and Editing for Translators. Manchester, UK: St. Jerome.
Muzii, Luigi. 2006. “Quality Assessment and Economic Sustainability of Translation”. Rivista Internazionale di Tecnica della Traduzione/International Journal of Translation 9:15-38.
Nord, Christiane. 1997. Translation as a Purposeful Activity. Manchester, UK: St. Jerome.
—. 2009. “El Funcionalismo en la Enseñanza de la Traducción”. Mutatis Mutandis 2: 209-243.
O’Brien, Sharon. 2012. “Towards a Dynamic Quality Evaluation Model for Translation”. Jostrans: The Journal of Specialized Translation 17. Retrieved from http://www.jostrans.org/issue17/art_obrien.php (Accessed 21 October, 2012)
Parra Galiano, Silvia. 2005. La Revisión de Traducciones en la Traductología: Aproximación a la Práctica de la Revisión en el Ámbito Profesional Mediante el Estudio de Casos y Propuestas de Investigación. (Doctoral Dissertation, Universidad de Granada, Spain). Retrieved from http://digibug.ugr.es/handle/ 10481/660 (Accessed 5 February, 2010)
Rothe-Neves, Rui. 2002. “Translation Quality Assessment for Research Purposes: An Empirical Approach”. Cuadernos de Tradução 10: 113-131.
Sae. The Engineering Society for Advancing Mobility Land Sea Air and Space. 2001. Surface Vehicle Recommended Practice. Retrieved from http://www.apex-translations.com/documents/sae_j2450.pdf (Accessed 3 July, 2011)
Schäffner, Christina. 1998. “From ‘Good’ to ‘Functionally Appropriate’: Assessing Translation Quality”. In Schäffner, C. (ed.) Translation and Quality. Clevedon, UK: Multilingual Matters: 1-5.
Secâra, Alina. 2005. Translation Evaluation – A State of the Art Survey. eCoLoRe/MeLLANGE Workshop Proceedings. Leeds, UK: University of Leeds Press: 39-44.
Stejskai, Jiri. 2006. “Quality Assessment in Translation”. MultiLingual (June) 80 (17): 41-44.
Waddington, Christopher. 2000. Estudio Comparativo de Diferentes Métodos de Evaluación de Traducción General (Inglés–Español). Madrid, Spain: Universidad Pontificia de Comillas.
Williams, Malcolm. 1989. “The Assessment of Professional Translation Quality: Creating Credibility out of Chaos”. TTR: Traduction, Terminologie, Redaction 2: 13-33.
—. 2001. “The Application of Argumentation Theory to Translation Quality Assessment”. Meta 46: 327-344.
—. 2004. Translation Quality Assessment: An Argumentation-Centred Approach. Ottawa, Canada: University of Ottawa Press.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2014 Roberto Martínez Mateo
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
