Hi @paws
Feel free to make any improvements you want. You could see how FlaxBart is implemented and try to keep the same API  (i.e __call__, save_pretrained and from_pretrained), that way the model will be compatible with HF API. And for now,  you could create new repo, we could always modify the code later to make it compatible with HF API.