RedHatAI
/

Llama-3.3-70B-Instruct-quantized.w4a16

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions Community

jennyyyi commited on 8 days ago

Commit

2f6cd4a

·

verified ·

1 Parent(s): b08a314

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -221,7 +221,7 @@ oc apply -f qwen-inferenceservice.yaml
 curl https://<inference-service-name>-predictor-default.<domain>/v1/chat/completions
         -H "Content-Type: application/json" \
         -d '{
-    "model": "Llama-4-Maverick-17B-128E-Instruct-FP8",
     "stream": true,
     "stream_options": {
         "include_usage": true

 curl https://<inference-service-name>-predictor-default.<domain>/v1/chat/completions
         -H "Content-Type: application/json" \
         -d '{
+    "model": "llama-3-3-70b-instruct-quantized-w4a16",
     "stream": true,
     "stream_options": {
         "include_usage": true