I use lr 1e-3 ,SGD with 10 batch size,weight init follows the xavier_normal and bias sets to 0.
Are there any other hyperparameter solution from ur perspective,or emperically setting? the loss reaches 0.049 for best ever.but it seems still too high.