I am not sure why those 2 changes are needed. In fact, it is necessary to set reduce = False. The default ptb example runs fine for me (only slightly faster than ce because the vocabulary size is only 10K).