They are initialized with train=True by default.
However, the difference only lies on a few things: batch nom layers and dropout layers. It has nothing to do with the weights being trained or not… So if you have batch norm or dropout layers, setting the eval flag will modify them accordingly, so that you can have correct values in the output! The weights of the model are unchanged, though.