No, base_model is not an internal attribute and since it’s unused you could remove it.
If I understand your issue correctly, the error is only raised, if you remove self.base_model?
Could you rerun the code with CUDA_LAUNCH_BLOCKING=1 python script.pt args and post the stack trace here?
Also, could you check, if you are running out of memory on the used GPU?