I am not entirely sure, but since ALBERT applies parameter sharing across layers (see the documentation for AlbertConfig num_hidden_groups (int, optional, defaults to 1) – Number of groups for the hidden layers, parameters in the same group are shared.), selectively updating a layer might not be possible.