ahh, so you are using tensorflow-metal to accelerate the training on AMD GPUs.
Well, I am sure its not very different than the standard tensorflow we use, unfortunately, it doesn’t seem to be open source.
I am not from Huggingface, so I can’t clarify but having a fork not being open source makes it quite difficult to work it; hence the lack of integration of HF+TF_metal. It doesn’t make sense for them to invest in a framework used by so few. You would have to do customizations yourself and figure out how to do that  - which I think is a pretty daunting task.
Someone else might be able to explain better I suppose; I don’t know much about the Mac ecosystem unfortunately