Hugging Face's logo
Robert Shaw's picture
17 6 4

Robert Shaw

robertgshaw2
21world's profile picture shubhrapandit's profile picture rgreenberg1's profile picture
·

AI & ML interests

None yet

Recent Activity

updated a model about 1 month ago
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-Dynamic
published a model about 1 month ago
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-Dynamic
new activity 2 months ago
RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic:Update tokenizer_config.json
View all activity

Organizations

HeavyAI's profile picture Neural Magic's profile picture Revel Labs's profile picture NM Testing's profile picture Red Hat AI's profile picture wut?'s profile picture

robertgshaw2's activity

updated a model about 1 month ago
published a model about 1 month ago
New activity in RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic 2 months ago

Update tokenizer_config.json

5
#3 opened 2 months ago by
erichartford
New activity in nm-testing/pixtral-12b-w4a16-actorder-group 4 months ago

What is an actorder group and what are the advantages of running this in vLLM?

4
#1 opened 4 months ago by
nickandbro
New activity in RedHatAI/Sparse-Llama-3.1-8B-2of4 4 months ago

Can I apply a LoRA?

2
#1 opened 4 months ago by
RonanMcGovern
New activity in nm-testing/Llama-3.3-70B-Instruct-FP8-dynamic 4 months ago

Nice model, any info on scripts used to quantize?

1
#1 opened 4 months ago by
RonanMcGovern
updated a model 5 months ago
upvoted a paper 6 months ago
New activity in RedHatAI/Meta-Llama-3-8B-Instruct-FP8 6 months ago

How to download the model with transformer library

5
#6 opened 6 months ago by
Rick10
New activity in mistralai/Pixtral-12B-2409 6 months ago

Update README.md

3
#25 opened 6 months ago by
robertgshaw2
updated a model 7 months ago
upvoted a collection 7 months ago
New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8 7 months ago

Issue running on vLLM using FP8

2
#3 opened 7 months ago by
ffleandro
updated a model 7 months ago
New activity in RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 8 months ago

vllm says the requested model does not exist

2
#1 opened 8 months ago by
shivams101
New activity in RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 8 months ago

Storage format differs from other w4a16 models

2
#2 opened 8 months ago by
timdettmers
New activity in RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a16 8 months ago

Model weights are not loaded

4
#3 opened 8 months ago by
MarvelousMouse
updated 2 models 9 months ago
New activity in RedHatAI/Mistral-Nemo-Instruct-2407-FP8 9 months ago

Can not be inferenced with vllm openai server

1
#1 opened 9 months ago by
jjqsdq