Hugging Face's logo

BricksDisplay
/
TinyLlama-1.1B-Chat-v1.0-q4

Text Generation
Transformers.js
ONNX
llama
conversational
Model card Files Community
Edit model card

Convert from TinyLlama/TinyLlama-1.1B-Chat-v1.0 and 4 bits quantized.

Require onnxruntime>=0.17.0

Downloads last month
7
Inference Examples
Text Generation
Inference API (serverless) is not available, repository is disabled.

Model tree for BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4

Base model

TinyLlama/TinyLlama-1.1B-Chat-v1.0
Quantized
this model

Collection including BricksDisplay/TinyLlama-1.1B-Chat-v1.0-q4