Description
GGML Format model files for This project.
inference
import ctransformers
from ctransformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("Aspik101/trurl-2-7b-GGML",model_type="llama")
prompt = "Yesterday, when I was"
llm(prompt_input,
max_new_tokens=256,
temperature=0.9,
top_p= 0.7)
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.