So I actually figured out where the error was happening. I was getting different outputs between the following two ways I formatted the input:
feature1 = torch.as_tensor([feature]).to(DEVICE)
feature2 = torch.as_tensor(feature).unsqueeze(0).to(DEVICE)
Although torch.all(feature1 == feature2) would return true, the outputs would differ quite a bit. Do you have an idea of why this would be the case? The shapes all seemed to match.