Solved by Shisho_Sama in post #2 
              
              
                Thanks to dear God I found the issue at last! 
As the error is stating (now obviously!), my model was on cpu but my input was on cuda. setting the data to be on cpu as well fixed this issue.