Spaces:
Running
Running
Update README_model_stats.md
Browse files- README_model_stats.md +11 -1
README_model_stats.md
CHANGED
|
@@ -3,7 +3,17 @@
|
|
| 3 |
This document outlines the methodology used for testing various LLM models through Ollama on a GPU Poor setup.
|
| 4 |
|
| 5 |
## Hardware Specifications
|
| 6 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
- Testing Environment: Ollama with ROCm backend
|
| 8 |
|
| 9 |
## Testing Methodology
|
|
|
|
| 3 |
This document outlines the methodology used for testing various LLM models through Ollama on a GPU Poor setup.
|
| 4 |
|
| 5 |
## Hardware Specifications
|
| 6 |
+
|
| 7 |
+
### GPU
|
| 8 |
+
- Model: AMD Radeon RX 7600 XT 16GB
|
| 9 |
+
- Note: Currently the most affordable (GPU-poorest) graphics card with 16GB VRAM on the market, making it an excellent choice for budget-conscious AI enthusiasts
|
| 10 |
+
|
| 11 |
+
### System Specifications
|
| 12 |
+
- CPU: AMD Ryzen 7 5700X (16) @ 4.66 GHz
|
| 13 |
+
- Motherboard: B550 Pro4
|
| 14 |
+
- RAM: 64GB
|
| 15 |
+
- OS: Debian 12 Bookworm
|
| 16 |
+
- Kernel: Linux 6.8.12-8
|
| 17 |
- Testing Environment: Ollama with ROCm backend
|
| 18 |
|
| 19 |
## Testing Methodology
|