As a form of masochism, tinkered with this briefly.
It is possible if you go the other way: reconstruct full vector, then replace each Parameter with one constructed from a tensor view. See this notebook for code + example (much longer / more complex than Evan’s sln):
EricCousineau-TRI/repro/blob/77942acfda/python/torch/torch_view_alias_no_backprop_tho.ipynb 5
However, the backprop / grad_fn gets lost b/c nn.Parameter must be a leaf tensor. See:
https://pytorch.org/docs/1.8.1/_modules/torch/nn/modules/module.html#Module.register_parameter
EDIT: Also, dunno how device transfer may affect aliasing views.