I'm one of the authors on the paper. Actually, sentence-by-sentence translation is important in a machine translation system because in many cases users will only provide single sentences. We also test document-level translation in Section 5, and find large improvements (but it isn't the focus of our paper).
