My model has higher BLEU, can I ship it?: The Joel Test for machine learning systems

Invited workshop talk proposing a 'Joel Test' style checklist for shipping machine-learning systems, using MT/BLEU as the running example.