Machine Translation Competitions

Competition BLEU Human Evaluation
IWSLT 16 Ranked 1st for the pairs:
  • Arabic<->English (ted-2015)
  • Arabic<->English (ted-2015)
  • Arabic<->English (qed-2015)
NIST 15 Ranked 2nd for the pairs:
  • Egyptian->English (SMS)
  • Egyptian->English (CHT)
  • Egyptian->English (CTS)
Ranked 2nd for the pairs:
  • Egyptian->English (SMS)
  • Egyptian->English (CHT)
  • Egyptian->English (CTS)
IWSLT 14 Ranked 2nd for the pairs:
  • English->French (test-2014)
  • English->German (test2014)
Ranked 3rd for the pairs:
  • English->French (test-2013)
  • English->German (test2013)
  • German->English (test-2013)
  • English->German (test2012)
Ranked 1st for the pair:
  • English->German (Official Test)
Ranked 3rd for the pair:
  • English->French (Official Test)
WMT 14 Ranked 1st for the pairs:
  • French-English (Constrained)
  • English-French (Constrained)
  • Czech-English (Constrained)
  • English-Czech (Unconstrained)
  • English-German (Unconstrained)
  • Russian-English (Constrained)
  • English-Russian (Unconstrained)
  • English-Hindi (Unconstrained)
Ranked 2nd for the pairs:
  • English-Russian (Constrained)
Ranked 3rd for the pairs:
  • Hindi-English (Unconstrained)
Ranked 1st for the pair:
  • French-English (Constrained)
Ranked 2nd for the pair:
  • English-Czech (Unconstrained)
  • Czech-English (Constrained)
  • English-French (Constrained)
Ranked 3rd for the pair:
  • English-Hindi (Unconstrained)
Best constrained systems:
  • Czech<->English
  • French<->English
  • Russian<->English
  • English->Hindi
IWSLT 13 Ranked 1st for the pairs:
  • English-German (test2011)
Ranked 2nd for the pairs:
  • English-French (test2011-12)
Ranked 3rd for the pairs:
  • English-French (test2013)
  • English-German (test2012)
Ranked 2nd for the pairs:
  • English->French (Official Test)
WMT 13 Ranked 1st for the pairs:
  • French-English (Unconstrained)
  • Spanish-English (Unconstrained)
  • Czech-English (Unconstrained)
  • English-French (Constrained)
  • English-German (Constrained)
  • English-Spanish (Constrained)
Ranked 2nd for the pairs:
  • Czech-English (Constrained)
  • Spanish-English (Constrained)
  • French-English (Constrained)
Ranked 3rd for the pairs:
  • Czech-English (Constrained) (MES)
  • English-Spanish (Constrained) (MES)
  • Russian-English (Constrained)
  • English-Russian (Constrained)
Ranked 1st for the pair:
  • French-English (Unconstrained)
  • Spanish-English (Unconstrained)
  • Czech-English (Unconstrained)
  • English-French (Constrained)
Ranked 2nd for the pair:
  • French-English (Best Constrained)
Ranked 3rd for the pair:
  • Spanish-English (Best Constrained)
  • English-Spanish (Best Constrained)
  • Czech-English (MES) (Best Constrained)
Best constrained systems:
  • Czech-English (MES)
  • English-Czech
  • French<->English
  • Spanish<->English