Yes. And I’m using nn.Sequential with .to(device)
self.middle_fc = nn.Sequential(
            nn.Linear(35,1024), 
            nn.ReLU(),
            nn.Linear(1024,248),
            nn.ReLU(),
            nn.Linear(248,128),
            nn.ReLU()
        ).to(device)