Intel OpenVINO inference backend
# 🚀 Feature request

Hi all! We (Intel team) would like to contribute in Hugging Face by integration of optimized deep learning inference framework OpenVINO. According to the contribution guidelines, we should discuss it with community and developers to match the expectations. Let me share what we have as this moment:

* New format for the [models hub](https://huggingface.co/) - a pair of `ov_model.xml` and `ov_model.bin` which is OpenVINO IR
* New class `OVAutoModel` which downloads `ov_model.xml/.bin` by default or framework specific checkpoint (PyTorch, TensorFlow) with on-the-fly conversion. Example:
  ```python
  from transformers import OVAutoModel
  model = OVAutoModel.from_pretrained("dkurt/test_openvino")
  ```
  (see https://huggingface.co/dkurt/test_openvino)
  or
  ```python
  # Downloads PyTorch weights and converts to OpenVINO in runtime
  model = OVAutoModel.from_pretrained("albert-base-v2", from_pt=True)
  ```
  or
  ```python
  # Downloads TensorFlow weights and converts to OpenVINO in runtime
  model = OVAutoModel.from_pretrained("distilbert-base-uncased", from_tf=True)
  ```

## Motivation

Expected efficiency improvement as well as utilization of Intel hardware (CPU/iGPU/VPU and others supported)

## Your contribution

Will do our best to complete this feature request. Looking forward for feedback from developers and experienced users.

Hi, @mfuntowicz and @LysandreJik. Just wanted to let you know that there is a PR with my proposal at https://github.com/huggingface/transformers/pull/14203. I would be very happy to get any feedback from you and understand if it goes in a right direction.<|||||>This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the [contributing guidelines](https://github.com/huggingface/transformers/blob/master/CONTRIBUTING.md) are likely to be ignored.