Two months ago I wrote about an effort to evaluate the quality of the three major free machine translation (MT) engines:
- Google Translate
- Bing (Microsoft) Translator
- Yahoo! Babelfish
Ethan Shen has wrapped up the project, soliciting input from more than 1,000 reviewers. He summed up his findings here.
Here are the findings that jumped out at me:
- Google wins, hands down, translating longer text passages. No big surprise here.
- Bing and Babelfish are competitive translating shorter texts (150 or fewer characters). Bing did quite well with Italian and German, while Babelfish did well with Chinese.
- Google’s brand trumps all. About halfway through his test, Ethan removed the brand names from the search engines, so the reviewers did not know which engine was doing which translation. The change in results was significant. Reviewers were 21% more likely to say Google was better than Microsoft when they knew the brand names. And reviewers were 136% more likely to say Google was better than Babelfish.
This last finding is what poses the greatest hurdle for Microsoft and Yahoo!
When it comes to machine translation — perception is (almost) everything. If people think you’re the best translation engine, then you are the best.
Integration is the other key element of success, and Google Translate is doing well here also — I absolutely love the Chrome browser integration.
Ethan is not done with his research. This is only stage one. To help him with stage two, click here.