Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
network, θ stands for the network parameters and x stands for input. When bias term is removed, fully connected neural networks and CNNs that use ReLU or LeakyReLU as activations are homogeneous, and the order L equals to the number of layers. The assumption of Exponential-type Loss Function