hyperparam search libs are a bit overkill for two independent parameters (you only need to perform two line searches).
also, some hyperparams are tunable with reduced dataset and/or epoch count
for LR it is common to do warmup & decay scheduling instead; early peak LR can be set as high as possible, and decay parameters are tuned instead (alternatively, ReduceLROnPlateau scheduler does an auto decrease)