max_lr and lr_scheduler
#4
by
colourful-tree
- opened
Hi, I'm working on continuing pretraining, and I'd like to know some information about this model, such as the max_lr and lr_scheduler during the pretraining phase.