Microsoft Translations Pivot Language

Pepe 0 Reputation points
2026-10-28T17:31:46.8233333+00:00

Hi,

I use all 24 European languages translations. I would like to know what are the pairs that use English as pivot language and which languages translate directly.

For instance in English is pivot language for Slovenian- Italian, it'd mean that Azure does Slovenian-English / English- Italian

I would also like to have a matrix of translation quality for English to and from all 23 European languages.

Thanks a lot

Azure Translator in Foundry Tools
0 comments No comments

2 answers

Sort by: Most helpful
  1. Hemant Bharadwaj 340 Reputation points Microsoft Employee
    2026-10-28T19:32:10.68+00:00

    Likely cause: the measured quality delta may be from dataset/domain effects rather than pivot language itself.

    1. Compare direct vs pivot paths on the same controlled corpus and same configuration.
    2. Use multiple metrics (BLEU plus chrF/COMET or human adequacy) because BLEU alone can be unstable for some language pairs.
    3. Keep API settings identical across runs (version, category/custom model, profanity/formality options).
    4. Check language-pair coverage and expected quality characteristics for your specific pair.
    5. Perform error-bucket analysis (terminology, named entities, omissions, morphology) to identify systematic pivot impact.

    Validation checks:

    • Expected: reproducible quality delta across repeated runs with fixed settings.
    • If variation is high run-to-run, stabilize corpus/noise before concluding pivot effect.

    References:

    “If you find this answer helpful, please upvote it. If this resolves your issue, please mark it as the accepted answer so that it can help others in the community.”

    Was this answer helpful?


  2. AI answer

    2026-10-28T17:32:35.47+00:00

    Azure Translator does not publish a fixed direct-versus-pivot routing matrix or an English-to-European-language quality matrix; routing is selected automatically, so the supported approach is to benchmark each required direction with representative data.

    Direct translation versus English pivoting

    Translator can use:

    • A bilingual model for a particular pair.
    • A multilingual model covering related languages.
    • A route through a third language, potentially English.

    The service selects what it considers the optimal path for each translation request. Microsoft illustrates this with Swahili → English → Hindi, but does not identify which European pairs currently follow that pattern.^1^

    Consequently:

    • There is no published list confirming whether Slovenian → Italian is direct or Slovenian → English → Italian.
    • The supported-language table indicates whether a language is available for cloud translation, containers, Custom Translator, and related features; it is not a pair-routing matrix.^2^
    • The documented public interface does not expose the internal route chosen for a translation.
    • Routing should not be assumed to remain fixed, because it is selected according to model quality rather than exposed as part of the API contract.

    If routing visibility is a contractual or architectural requirement, raise an Azure support request asking whether Microsoft can provide guidance for the specific language pairs. Public documentation is insufficient to construct that matrix reliably.

    Translation-quality matrix

    Microsoft does not publish absolute quality scores for its standard translation systems. Translation quality depends on the language pair, domain, style, register, and test set; there is no established universal test set. Microsoft recommends evaluating a representative test set for the intended scenario and states that human evaluation provides the most significant and reliable scores.^1^

    Build the requested 46-direction matrix—English to and from 23 languages—as follows:

    1. Create a separate test set for each direction.
      Use production-like sentences and professionally prepared reference translations. Keep test material separate from any customization training data.
    2. Preserve domain and content type.
      Do not combine, for example, product manuals, support conversations, and marketing text into one undifferentiated score.
    3. Run all translations within the same evaluation window.
      Record the API version, date, source and target language codes, and whether standard or custom translation was used.
    4. Calculate at least two automatic metrics.
      • BLEU for overlap with human references.
      • COMET or another contextual metric to account better for valid paraphrases.
    5. Perform blinded human review on a representative sample.
      Score accuracy and fluency separately, and record critical terminology errors. Use human review as the primary criterion for high-impact content.
    6. Report confidence and sample size.
      A useful matrix cell would contain:
      Direction BLEU COMET Human accuracy Human fluency Critical error rate Samples
      en → sl … … … … … …
      sl → en … … … … … …

    BLEU ranges from 0 to 100 and measures similarity to a reference translation, but it should not be treated as a universal percentage of correctness. Custom Translator exposes both a custom-model BLEU score and a baseline BLEU score so that models can be compared on the same test set.^3^

    Use the current language-support table to validate the exact language codes and applicable capabilities before generating the matrix. Note particularly that pt defaults to pt-br; choose the required Portuguese variant explicitly where relevant.^2^


    References

    1. Azure Translator in Foundry Tools Transparency Note
    2. Azure Translator in Foundry Tools language support
    3. Test your Custom Translator
    AI-generated content may be incorrect. Read our transparency notes for more information.

    Was this answer helpful?

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.