lightmate commited on
Commit
b2454e0
·
verified ·
1 Parent(s): 0201e74

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -12
README.md CHANGED
@@ -1,12 +1,38 @@
1
- ---
2
- title: Llm Chatbot
3
- emoji: 👀
4
- colorFrom: indigo
5
- colorTo: red
6
- sdk: gradio
7
- sdk_version: 5.4.0
8
- app_file: app.py
9
- pinned: false
10
- ---
11
-
12
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # LLM-Based Chat Application
2
+
3
+ This is a language model-based chat application that provides users with relevant, up-to-date, and easy-to-understand responses by leveraging web search and a powerful language model. The basic flow involves performing a web search using DuckDuckGo, followed by generating a response using the Qwen2.5-0.5b-Instruct language model.
4
+
5
+ ## Features
6
+
7
+ - **Web Search**: Performs real-time searches using DuckDuckGo to retrieve the latest relevant information.
8
+ - **Language Model Integration**: Uses the `qwen2.5-0.5b-instruct` model for generating accurate and coherent responses.
9
+ - **Simple Interface**: Built with Gradio to offer an easy-to-use web interface for users to interact with the model.
10
+ - **Efficient and Scalable**: Optimized for performance using Intel-specific optimizations via `optimum-intel` and other acceleration libraries.
11
+
12
+ ## Dependencies
13
+
14
+ The following dependencies are required for running this application:
15
+
16
+ - `openvino>=2024.2.0`
17
+ - `openvino-tokenizers[transformers]`
18
+ - `torch>=2.1`
19
+ - `datasets`
20
+ - `duckduckgo-search`
21
+ - `langchain-community`
22
+ - `accelerate`
23
+ - `gradio>=4.19`
24
+ - `onnx<=1.16.1` (For Windows platform `sys_platform=='win32'`)
25
+ - `einops`
26
+ - `transformers>=4.43.1`
27
+ - `transformers_stream_generator`
28
+ - `tiktoken`
29
+ - `bitsandbytes`
30
+ - `optimum-intel` (installed via `git+https://github.com/huggingface/optimum-intel.git`)
31
+ - `nncf` (installed via `git+https://github.com/openvinotoolkit/nncf.git`)
32
+
33
+ ## Installation
34
+
35
+ To install the required dependencies, you can use the following command:
36
+
37
+ ```bash
38
+ pip install -r requirements.txt