Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
samples not showing
#9
by
d14945921
- opened
I've set it to generate samples every 100 steps, but the samples aren't being displayed.
Do you see checkpoints show up on your training runs? That's more upsetting imho......had 3 trains error due to timeout after 3k steps.....per settings it'd have made at least 5 checkpoints by that point the last of which would have likely been close enough....
ugh.
Thinking maybe HF is just incapable of providing anything but the safetensors?
Samples are not yet activated, and intermediary checkpoints are only uploaded at the end of the training run. Sorry for the inconvenience, this is still a beta usage of the new jobs AP. Trying shorter jobs that don't time-out is the way to go here