@G.M
Thanks a lot, and this weight should be connected with any layers of the model or just implemented as you tell me.
Another thing if I want to accelerate my model I use ReLU activation function and dropout layers and Increase the hidden layers this makes the loss to decrease and the accuracy increase but slowly due you have ideas how can I increase them rapidly