Bega:

device = torch::kCUDA;


You did not use the variable “device” anywhere in your code.
Try this:
 // Loading your model
    const std::string s_model_name = argv[1];
    std::cout << " >>> Loading " << s_model_name << std::endl;
    auto module = torch::jit::load(s_model_name, torch::kCUDA); // **This is what you should use** 
    assert(module != nullptr);

And then your tensor:
inputs.emplace_back(input_tensor.to(torch::kCUDA)); /