I think it might be easier to find help for this specifically on the CoreML forum.
Are you trying to run the model on an iOS device? can’t you run using TFLite interpreter 1? I don’t think that would need the conversion and maybe the CoreML delegate 1 might help with the performance