Thanks for the answer I forgot to mention I use 50-150 hidden neurons and 1-3 layers. The test I posted the numbers for was with the maximum of those numbers.
I am not experienced in pytorch, so I am not sure if my code allows for parallelization.
Also I am not sure if my installation works well. I tried to find an example online to compare my cpu vs gpu speed, but couldn’t find on I can execute myself in pytorch.
Lastly I am quite surprised why my code was slowed down by 33% when I just added .to(“cpu”) commands…