Hi ptrblck,
Thank you for the reply.
I tested streams, it looks like the speed up is not significant. Say I want to change weights in 10 different ways and run forward() as fast as possible 10 times with same inputs, what would you recommend to implement this?
Thank you.