text: Title: [Feature]: [V1] Validate / Fix Load Formats on V1
  Body: ### 🚀 The feature, motivation and pitch
  
  We are not sure if `--load-format sharded_state` of `--load-format tensorizer` work with V1
  
  This issue asks to look into it and fix any issues that occur, including for TP>1
  
  ### Alternatives
  
  _No response_
  
  ### Additional context
  
  _No response_
  
  ### Before submitting a new issue...
  
  - [x] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the [documentation page](https://docs.vllm.ai/en/latest/), which can answer lots of frequently asked questions.