Solved by ptrblck in post #6 
              
              
                I think this use case should be possible if you make sure the shapes are as expected. 
Here is a small example, which concatenates a new tensor to the internal buffer and checks that it’s also added to the state_dict: 
class MyModel(nn.Module):
    def __init__(self):
        super().__init__()
    …