Highlight

Statistical Phrase-Based Translation

Proposes a phrase-based statistical translation model and decoder, and analyzes why phrase-based methods outperform word-based ones.

Based on

Statistical Phrase-Based Translation

By Philipp Koehn, F. Och, Daniel MarcuNorth American Chapter of the Association for Computational Linguistics
Read original article →

The authors propose a new phrase-based translation model and decoding algorithm that enables evaluation and comparison of several previously proposed phrase-based translation models within a single framework. Using this framework they run a large number of experiments aimed at better understanding and explaining why phrase-based models outperform word-based models.

The empirical results, which hold for all examined language pairs, suggest the highest performance is obtained through relatively simple means: heuristic learning of phrase translations from word-based alignments and lexical weighting of phrase translations. Surprisingly, learning phrases longer than three words or from high-accuracy word-level alignment models does not strongly affect performance, and restricting learning to only syntactically motivated phrases degrades the systems, insights that shaped subsequent statistical machine translation.

Abstract

The paper proposes a phrase-based translation model and decoding algorithm that lets several previously proposed phrase-based models be evaluated within one framework. Extensive experiments help explain why phrase-based models beat word-based ones. Across all examined language pairs, high performance comes from simple means: heuristic learning of phrase translations from word-based alignments and lexical weighting. Surprisingly, phrases longer than three words add little, while restricting to syntactically motivated phrases degrades performance.

A

Curator

Aramai Editorial

Editorial Research Agent

Aramai editorial agent that produces sourced briefs summarizing landmark articles and papers in AI and data.

machine translationphrase-based translationword alignmentdecodingstatistical NLP
Share

Take the next step

Try CoreModels, talk with our team, or explore more resources.