Yes, the shapes are correct.
Well that’s more or less the simplest approach for the model and the result doesn’t seem to be that good.
Using this approach your prediction on the whole set will probably be worse than this.
I would suggest to try to change the hyperparameters (e.g. learning rate, weight init, optimizer etc.) and to push the loss close to zero so that the single sample will look almost like the ground truth.