Article
GaLore: Advancing Large Model Training on Consumer-grade Hardware
By
and 8 others
•
•
29Sourab Mangrulkar
smangrul
AI & ML interests
Machine Learning, Deep Learning, Natural Language Processing, Natural Language Generation, Computer Vision, Reinforcement Learning
Recent Activity
liked
a model
3 days ago
Qwen/Qwen3-1.7B
liked
a model
about 1 month ago
Qwen/Qwen2.5-Omni-7B
liked
a model
about 2 months ago
intfloat/multilingual-e5-large-instruct
Organizations
smangrul's activity
published
an
article
about 1 year ago
published
an
article
about 1 year ago
Article
🤗 PEFT welcomes new merging methods
By
and 1 other
•
•
18
published
an
article
over 1 year ago
Article
Mixture of Experts Explained
By
and 5 others
•
•
605
published
an
article
over 1 year ago
Article
Personal Copilot: Train Your Own Coding Assistant
By
and 1 other
•
•
53
published
an
article
over 1 year ago
Article
Fine-tuning Llama 2 70B using PyTorch FSDP
By
and 3 others
•
•
23
published
an
article
almost 2 years ago
Article
The Falcon has landed in the Hugging Face ecosystem
By
and 7 others
•
•
13
published
an
article
almost 2 years ago
Article
Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA
By
and 4 others
•
•
144
published
an
article
about 2 years ago
Article
Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU
By
and 5 others
•
•
54
published
an
article
over 2 years ago
Article
🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware
By
and 1 other
•
•
80
published
an
article
almost 3 years ago
Article
Accelerate Large Model Training using DeepSpeed
By
and 1 other
•
•
6
published
an
article
about 3 years ago
Article
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
By
and 1 other
•
•
4