text: Title: DeepSpeed inference load the whole model to cpu numerous times
  Body: Hi when I use DeepSpeed to inference ,when running GPU = 4,model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype=torch.float16) will be loaded four times. This takes up a lot of CPU memory.Is there a way to load the model only once? 