Yes, it depends on the dataset size and model size you use it ran run quickly out oom.
Your error ClientError: Artifact upload failed:Error 5: Received a failed archive status is this appearing at the end of the training?
Do you have more insights than this?