yeirr
/

phi3-mini-128k-instruct-awq-g128-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Introduction

A quantized version of instruct-tuned model.

Downloads last month: 2

Safetensors

Model size

682M params

Tensor type

I32

·

FP16

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for yeirr/phi3-mini-128k-instruct-awq-g128-4bit

Base model

microsoft/Phi-3-mini-128k-instruct

Quantized

(63)

this model