Hey @pumplerod
I did some digging and I think this should be your best option:
single_layer = torch.randn((1,10))
batch = torch.randn((100,5))

single = single_layer.repeat(100,10)
input_layer = torch.cat([batch,single],dim=1)

Hope this helps