Congrats! That doesn’t look all that bad! And I do think that implementing things yourself is one of the best ways to learn.
Now regarding your question: vgg does have “implied” or learned length scales, so maybe your images are too large to have the same length scale?
I think I saw someone experiment with rescaling and style transfer, maybe on the fast.ai forum?
Best regards
Thomas