Hugging Face's logo
Robert Shaw's picture
17 6 4

Robert Shaw

robertgshaw2
21world's profile picture rgreenberg1's profile picture herMaster's profile picture
·

AI & ML interests

None yet

Recent Activity

updated a model about 1 month ago
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-Dynamic
published a model about 1 month ago
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-Dynamic
new activity 2 months ago
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic:Update tokenizer_config.json
View all activity

Organizations

HeavyAI's profile picture Neural Magic's profile picture Revel Labs's profile picture NM Testing's profile picture Red Hat AI's profile picture wut?'s profile picture

robertgshaw2's activity

New activity in RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic 2 months ago

Update tokenizer_config.json

5
#3 opened 2 months ago by
erichartford
New activity in nm-testing/pixtral-12b-w4a16-actorder-group 4 months ago

What is an actorder group and what are the advantages of running this in vLLM?

4
#1 opened 4 months ago by
nickandbro
New activity in RedHatAI/Sparse-Llama-3.1-8B-2of4 4 months ago

Can I apply a LoRA?

2
#1 opened 4 months ago by
RonanMcGovern
New activity in nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic 4 months ago

Nice model, any info on scripts used to quantize?

1
#1 opened 4 months ago by
RonanMcGovern
New activity in RedHatAI/Meta-Llama-3-8B-Instruct-FP8 6 months ago

How to download the model with transformer library

5
#6 opened 6 months ago by
Rick10
New activity in mistralai/Pixtral-12B-2409 6 months ago

Update README.md

3
#25 opened 6 months ago by
robertgshaw2
New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8 7 months ago

Issue running on vLLM using FP8

2
#3 opened 7 months ago by
ffleandro
New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 8 months ago

vllm says the requested model does not exist

2
#1 opened 8 months ago by
shivams101
New activity in RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 8 months ago

Storage format differs from other w4a16 models

2
#2 opened 8 months ago by
timdettmers
New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 8 months ago

Model weights are not loaded

4
#3 opened 8 months ago by
MarvelousMouse
New activity in RedHatAI/Mistral-Nemo-Instruct-2407-FP8 9 months ago

Can not be inferenced with vllm openai server

1
#1 opened 9 months ago by
jjqsdq
New activity in RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w4a16 10 months ago

Code example request with vllm

2
#1 opened 10 months ago by
ShiningJazz
New activity in RedHatAI/Mistral-7B-Instruct-v0.3-GPTQ-4bit 10 months ago

4bit quantisation does not reduce vram usage.

1
#2 opened 10 months ago by
fu-man
New activity in RedHatAI/Meta-Llama-3-70B-Instruct-FP8 10 months ago

How to run Meta-Llama-3-70B-Instruct-FP8 using several devices?

5
#3 opened 10 months ago by
Fertel
New activity in open-llm-leaderboard/open_llm_leaderboard 10 months ago

Reproduction

2
#792 opened 10 months ago by
robertgshaw2
New activity in RedHatAI/Meta-Llama-3-8B-Instruct-FP8 12 months ago

Fails to run with nm-vllm

1
#1 opened 12 months ago by
clintonruairi
New activity in RedHatAI/Llama-2-7b-ultrachat200k-pruned_50 about 1 year ago

Update chart template
#2 opened about 1 year ago by
robertgshaw2