text: Title: model.parameters() return [Parameter containing: tensor([], device='cuda:0', dtype=torch.bfloat16, requires_grad=True)] when using zero3
  Body: ### System Info
  
  transformers             4.44.2
  accelerate               1.2.1
  deepspeed                0.12.2
  torch                    2.2.2
  torchaudio               2.2.2
  torchvision              0.17.2
  
  ### Who can help?
  
  _No response_
  
  ### Information
  
  - [ ] The official example scripts
  - [x] My own modified scripts
  
  ### Tasks
  
  - [ ] An officially supported task in the `examples` folder (such as GLUE/SQuAD, ...)
  - [x] My own task or dataset (give details below)
  
  ### Reproduction
  
  Try to print **model.parameters()**  in transfomers trainer(), but get **Parameter containing: tensor([], device='cuda:0', dtype=torch.bfloat16, requires_grad=True)** for all layers
  In fact, I am trying to return the correct **model.parameters()** in DeepSpeed Zero-3 mode and use the EMA model. Could you suggest any ways to solve the above issue, or any other methods to use the EMA model under Zero-3?
  
  ### Expected behavior
  
  expect to see the gathered parameters