thank you for your reply, maybe I should clarify. everything you say is true but I was wondering, if I am supposed to pass in model.parameters() although they are only randomly initialized weights at that point and some default lr only to be overwritten later when the actual state is loaded… Seems cumbersome