GGUF
English
Inference Endpoints
conversational
brooketh commited on
Commit
23d8cfc
1 Parent(s): 3b93950

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -24,7 +24,7 @@ parameter_count: 8030261312
24
  - **Original:** [Llama 3.1 Stheno V3.4 8B](https://huggingface.co/Sao10K/Llama-3.1-8B-Stheno-v3.4)
25
  - **Date Created:** 2024-08-19
26
  - **Trained Context:** 131072 tokens
27
- - **Description:** Version 3.4 of the popular Stheno series of Llama-3.1-based roleplay models. Finetuned in two passes: first, over a multi-turn Conversational-Instruct dataaset; second, over a Creative Writing/Roleplay dataset along with some Creative-based Instruct datasets. Source data contains a mixture of Human and Claude Data.
28
  ***
29
  ## What is a GGUF?
30
  GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.
 
24
  - **Original:** [Llama 3.1 Stheno V3.4 8B](https://huggingface.co/Sao10K/Llama-3.1-8B-Stheno-v3.4)
25
  - **Date Created:** 2024-08-19
26
  - **Trained Context:** 131072 tokens
27
+ - **Description:** Version 3.4 of the popular Stheno series of Llama-3.1-based roleplay models. Finetuned in two passes: first, over a multi-turn Conversational-Instruct dataaset; second, over a Creative Writing/Roleplay dataset along with some Creative-based Instruct datasets. Source data contains a mixture of human and Claude data.
28
  ***
29
  ## What is a GGUF?
30
  GGUF is a large language model (LLM) format that can be split between CPU and GPU. GGUFs are compatible with applications based on llama.cpp, such as Backyard AI. Where other model formats require higher end GPUs with ample VRAM, GGUFs can be efficiently run on a wider variety of hardware.