So the input to my network is a depth image (64 x 64) and the robot position (x, y, z). I used torch.cat to combine them and feed them into fully connected layers. After I trained my model for 2000 episodes, it looks to me that my network is straight-up ignoring the position data. Maybe it is because the position data is only 3 x 1? How do I make sure my network recognizes the importantness of my position data?
Any recommendations will be appreciated, thank you!