the way I declared my optimizers adn criterion is this :
please let me know if I make a mistake here?
criterion1 = torch.nn.MSELoss(size_average=False)
optimizer1 = torch.optim.Adam(modelFCNN.parameters(), 
                            lr=HP1['LEARNING_RATE']) 
                            #momentum=HP['NUM_MOMENTUM'], 
                            #weight_decay=HP['WEIGHT_DECAY'], 
                            #)
scheduler = torch.optim.lr_scheduler.LambdaLR(optimizer1, lr_lambda=[epoch_smooth_decay])  # select the