Something like this is discussed in Issue 27878 3.
The thing is that it introduces a global context which isn’t regarded that faviourably. Also there are concerns about backward compatibility.
If you want to show off your non-conforming hacker nature, you could do
def force_device(device):
    for name in [n for n, f in inspect.getmembers(torch) if inspect.isbuiltin(f) and f.__doc__ is not None and 'device=' in f.__doc__]
        oldfn = getattr(torch, name)
        def factory(*args, **kwargs):
            if kwargs.get('device') is None:
                kwargs['device'] = device
            return oldfn(*args, **kwargs)
        functools.update_wrapper(factory, oldfn)
        setattr(torch, name, factory)

Best regards
Thomas