two_Two:

,does this mean all weights could be set before the whole model is created?


Once you create a layer, you can directly initialize its parameters, as they will be created immediately.
Let me know, if I misunderstood your question.