Neural Network Algorithm, Neural Networks, Julialang, Editors Pick, Thoughts And Theory.
AbstractMatrix , B} weight :: M bias::B sigma::F end The second key part is the function that expresses the forward step computation as follows: function (a::Dense)(x:: AbstractVecOrMat) W, b, sigma = a.weight , a.bias , a.sigma return sigma.(W*x .+ b) end The implementation I have developed