This looks good. Is the “conv model” performing better in every run?
You could use different seeds and check if it’s a random issue or systematic.
At the moment I don’t see any reason the conv layer should perform better than the linear layer.