Create README.md

README.md

@@ -0,0 +1,78 @@
+---
+license: apache-2.0
+language:
+- en
+tags:
+- chat
+- audio
+---
+
+# Qwen2-Audio-7B
+
+## Introduction
+
+Qwen2-Audio is the new series of Qwen large audio-language models. Qwen2-Audio is capable of accepting various audio signal inputs and performing audio analysis or direct textual responses with regard to speech instructions. We introduce two distinct audio interaction modes:
+
+* voice chat: users can freely engage in voice interactions with Qwen2-Audio without text input;
+
+* audio analysis: users could provide audio and text instructions for analysis during the interaction;
+
+We release Qwen2-Audio-7B and Qwen2-Audio-7B-Instruct, which are pretrained model and chat model respectively. 
+
+For more details, please refer to our [blog](https://qwenlm.github.io/blog/qwen2/), [GitHub](https://github.com/QwenLM/Qwen2-Audio), and [Report](https://www.arxiv.org/abs/2407.10759).
+<br>
+
+
+## Requirements
+The code of Qwen2-Audio has been in the latest Hugging face transformers and we advise you to install `transformers>=4.44.0`, or you might encounter the following error:
+```
+KeyError: 'qwen2-audio'
+```
+
+## Quickstart
+
+Here provides offers a code snippet illustrating the process of loading both the processor and model, alongside detailed instructions on executing the pretrained Qwen2-Audio base model for content generation.
+
+
+```python
+import requests
+from transformers import AutoProcessor, Qwen2AudioForConditionalGeneration
+from transformers.pipelines.audio_utils import ffmpeg_read
+
+model = Qwen2AudioForConditionalGeneration.from_pretrained("Qwen/Qwen2-Audio-7B" ,trust_remote_code=True)
+processor = AutoProcessor.from_pretrained("Qwen/Qwen2-Audio-7B" ,trust_remote_code=True)
+
+prompt = "<|audio_bos|><|AUDIO|><|audio_eos|>Generate the caption in English:"
+url = "https://qianwen-res.oss-cn-beijing.aliyuncs.com/Qwen-Audio/glass-breaking-151256.mp3"
+audio = ffmpeg_read(requests.get(url).content, sampling_rate=processor.feature_extractor.sampling_rate)
+
+inputs = processor(text=prompt, audios=audio, return_tensors="pt")
+
+# Generate
+generated_ids = model.generate(**inputs, max_length=256)
+generated_ids = generated_ids[:, inputs.input_ids.size(1):]
+response = processor.batch_decode(generated_ids, skip_special_tokens=True, clean_up_tokenization_spaces=False)[0]
+# Glass is breaking.
+```
+
+## Citation
+
+If you find our work helpful, feel free to give us a cite.
+
+```BibTeX
+@article{Qwen2-Audio,
+  title={Qwen2-Audio Technical Report},
+  author={Chu, Yunfei and Xu, Jin and Yang, Qian and Wei, Haojie and Wei, Xipin and Guo,  Zhifang and Leng, Yichong and Lv, Yuanjun and He, Jinzheng and Lin, Junyang and Zhou, Chang and Zhou, Jingren},
+  journal={arXiv preprint arXiv:2407.10759},
+  year={2024}
+}
+```
+
+```BibTeX
+@article{Qwen-Audio,
+  title={Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Models},
+  author={Chu, Yunfei and Xu, Jin and Zhou, Xiaohuan and Yang, Qian and Zhang, Shiliang and Yan, Zhijie  and Zhou, Chang and Zhou, Jingren},
+  journal={arXiv preprint arXiv:2311.07919},
+  year={2023}
+}
+```