Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
13.5
TFLOPS
37
42
68
Marc Sun
marcsun13
Follow
klebster's profile picture
david-thrower's profile picture
atabeyunlu's profile picture
111 followers
·
151 following
_marcsun
SunMarc
AI & ML interests
LLM, Quantization, Training, Inference
Recent Activity
updated
a model
15 days ago
marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
published
a model
15 days ago
marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
published
a model
24 days ago
marcsun13/paligemma_vqav2
View all activity
Organizations
Articles
7
Article
39
Introducing SynthID Text
Article
223
Fine-tuning LLMs to 1.58bit: extreme quantization made easy
View all Articles
models
16
Sort:Â Recently updated
marcsun13/Llama-3.2-1B-Instruct-SpinQuant_INT4_EO8
Updated
15 days ago
•
9
marcsun13/paligemma_vqav2
Updated
24 days ago
marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only
Updated
Oct 18, 2024
•
13
marcsun13/sft_openassistant-guanaco
Text Generation
•
Updated
Jul 5, 2024
•
25
marcsun13/gemma-2-27b-it-bnb-colab
Text Generation
•
Updated
Jul 4, 2024
•
20
marcsun13/gemma-2-9b-it-GPTQ
Text Generation
•
Updated
Jul 3, 2024
•
303
•
3
marcsun13/test_push_checkpoint
Fill-Mask
•
Updated
Jun 28, 2024
•
142
marcsun13/Mixtral-8x7B-v0.1-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
35
marcsun13/Mixtral-tiny-GPTQ
Text Generation
•
Updated
Dec 11, 2023
•
108
marcsun13/Llama-2-13B-AWQ
Text Generation
•
Updated
Nov 6, 2023
•
86
Expand 16 models
datasets
None public yet