I really like this project idea!
Do you think you will be able to write jax transformer code with conditional random fields in 3,4 days for the project @sh0416 ? Maybe just use FlaxBERT and add the conditional random field layer on top? Think we should keep it as simple as possible 
Also we probably don’t need to pretrain the whole model from scratch, but we can just use a pretrained BERT model and adapt it for fast non-autoregressive generation no?
Think this project could give a really nice demo for fast gneration!
Think this is not the easiest project, but definitely one of the interesting ones! Finalizing it