16 6 186

Sourab Mangrulkar

smangrul

https://www.linkedin.com/in/sourab-m/

pacman100

AI & ML interests

Machine Learning, Deep Learning, Natural Language Processing, Natural Language Generation, Computer Vision, Reinforcement Learning

Articles

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

May 24, 2023

• 90

Fine-tuning 20B LLMs with RLHF on a 24GB consumer GPU

Mar 9, 2023

• 33

🤗 PEFT: Parameter-Efficient Fine-Tuning of Billion-Scale Models on Low-Resource Hardware

Feb 10, 2023

• 37

Accelerate Large Model Training using DeepSpeed

Jun 28, 2022

• 2

Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel

May 2, 2022

• 1

Organizations

smangrul's activity

liked a model about 2 months ago

BlinkDL/rwkv-4-pile-169m

Text Generation • Updated Mar 13, 2023 • 10

liked a model 2 months ago

meta-llama/Llama-3.1-8B-Instruct

Text Generation • Updated Sep 25 • 5.13M • • 3.01k

liked 2 models 3 months ago

microsoft/Phi-3.5-mini-instruct

Text Generation • Updated Sep 18 • 681k • • 613

microsoft/Phi-3-mini-128k-instruct

Text Generation • Updated Aug 20 • 604k • 1.6k

liked a model 4 months ago

microsoft/Phi-3-mini-4k-instruct

Text Generation • Updated Sep 20 • 1.36M • • 1.07k

liked a dataset 6 months ago

internlm/Agent-FLAN

Preview • Updated Mar 20 • 99 • 65

liked a space 6 months ago

Running

🐠

Nexus Function Calling Leaderboard

liked a model 6 months ago

gorilla-llm/gorilla-openfunctions-v2

Text Generation • Updated Apr 18 • 11.7k • 209

liked a dataset 7 months ago

smangrul/hug_stack

Viewer • Updated Feb 2 • 6.58k • 92 • 3

liked 4 models 7 months ago

smangrul/falcon-180B-chat-asst-ds-lora

Updated Oct 2, 2023 • 9 • 1

smangrul/llama-3-8B-instruct-function-calling

Updated Apr 21 • 57 • 28

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 87.8k • 128

meta-llama/Meta-Llama-3-8B-Instruct

Text Generation • Updated Sep 27 • 2.17M • • 3.6k

liked a dataset 7 months ago

glaiveai/glaive-code-assistant-v3

Viewer • Updated May 20 • 950k • 508 • 43

liked 2 models 7 months ago

HuggingFaceH4/zephyr-orpo-141b-A35b-v0.1

Text Generation • Updated Apr 18 • 622 • 260

mistralai/Mixtral-8x22B-Instruct-v0.1

Text Generation • Updated Oct 3 • 154k • 686

liked 2 datasets 7 months ago

ai4bharat/indic-align

Viewer • Updated Jul 25 • 97.4M • 806 • 10

ai4bharat/sangraha

Viewer • Updated 20 days ago • 268M • 13.5k • 29

liked a dataset 8 months ago

GenVRadmin/Samvaad-Mixed-Language-2

Viewer • Updated Mar 1 • 14.3k • 42 • 4

liked a model 8 months ago

bigcode/starcoder2-3b

Text Generation • Updated Mar 4 • 177k • • 146

Sourab Mangrulkar

AI & ML interests

Articles

GaLore: Advancing Large Model Training on Consumer-grade Hardware

🤗 PEFT welcomes new merging methods

Mixture of Experts Explained

Personal Copilot: Train Your Own Coding Assistant

Fine-tuning Llama 2 70B using PyTorch FSDP

The Falcon has landed in the Hugging Face ecosystem