What is meta_in? What shape does it have?
The backbone_output_shape = (512,3) determines 512 as batch_size and 3 as output.
The meta_in should be (512, ?), so batch_size should be the same and then:
nn.Linear(?, 3),
nn.BatchNorm1d(3),

Where ? is any number.