Right, so I just realized there’s some confusion with the names of the metrics. There’s GLEU for grammatical error correction 1 and there’s GLEU for machine translation 2 (aka Google BLEU). They’re completely unrelated.
I was actually looking for the second one for my current task. There’s an NLTK implementation for that one. It seems that it should be easy enough to add it to datasets. After all, nltk is already used by rouge metric, for example. The question, however, is how to distinguish these two GLEUs?
That said, I’m also interested in fixing the GEC GLEU as well (although after the MT one).