That’s might be a better solution. I used input[input < 0] = 0 (don’t know how to use inline code) for ReLU
And input[input < 0] = 0, input[input > 0] = 1 for ReLU prime. Will check which one’s faster.
Thanks