Transifex Quality Index (TQI) is our approach for a comprehensive translation quality scoring index. Integrated with Transifex AI, TQI leverages machine learning algorithms to provide a comprehensive framework for real-time translation quality assessment.
It is calculated for each AI translation and evaluates its accuracy, grammatical and syntactical quality, and adherence to linguistic style, ensuring it aligns with your brand's tone of voice. This robust system enhances focused post-edits, automates quality assurance, and facilitates rapid content deployment across multiple languages, streamlining your localization process.
TQI calculation
TQI is being calculated in real-time upon generating translations either through AI Tasks or AI Fillups; it is then displayed right next to each translation in the Editor:
📝 Note: Please keep in mind that if you edit an AI translation and save your changes, the TQI will no longer be displayed for that translation.
Using TQI
To locate AI translations within a specific TQI range, utilize the available filters (under 'More'). You can specify a threshold to filter TQIs that are either lower or higher for further review.
📝 Note: Upcoming features will allow you to set up advanced automation to enhance the localization workflow, such as automatically approving translations that meet or exceed a designated TQI score threshold.
TQI Insights and Breakdown
To provide better transparency and actionable insights, you can now view a detailed breakdown of how each TQI score is calculated, including recommendations on improving translations.
Accessing Detailed Analysis
When checking a translation generated by Transifex AI, you can view a detailed breakdown by clicking the TQI score in the editor. Alternatively, use the shortcut Ctrl+T for quick access.
The modal window that opens displays the score for each TQI component:
Translation Consistency: Measures similarity between translations generated by multiple LLMs, indicating alignment, context clarity, and manageable complexity.
Structural Integrity: Verifies adherence to formatting, glossary use, and structural elements like HTML tags to ensure technical correctness.
Semantic Quality: Assesses the translation’s quality using the MQM framework, evaluating how closely it resembles human-level accuracy.
Further down in this view, you’ll see the issues identified in the translation according to MQM standards, with each issue colour-coded by severity level (critical, major, minor). This layout allows you to focus on areas needing improvement without any guesswork.
Here are a few examples:
If you find an issue helpful and informative (or not), you can provide immediate feedback by clicking the respective 👍 or 👎 icon. This feedback will help us continuously improve Transifex AI and the algorithm for calculating TQI.
⚠️Warning: TQI analysis is available for AI-generated translations created after November 5th, 2024.
💡Tip
Looking for more help? Get support from our Transifex Community Forum!
Find answers or post to get help from Transifex Support and our Community.