FasterDecoding

community

https://github.com/FasterDecoding

Activity Feed Request to join this org

AI & ML interests

Making model inference more efficient by model-system codesign.

Recent Activity

tianlecai authored a paper about 1 month ago

FutureX: An Advanced Live Benchmark for LLM Agents in Future Prediction

tianlecai authored a paper over 1 year ago

SnapKV: LLM Knows What You are Looking for Before Generation

tianlecai authored a paper over 1 year ago

JetMoE: Reaching Llama2 Performance with 0.1M Dollars

View all activity

FasterDecoding 's models 8

FasterDecoding/BitDelta_Mistral_combo

Updated Feb 14, 2024

FasterDecoding/medusa-1.0-vicuna-13b-v1.5

Text Generation • Updated Jan 25, 2024 • 10 • 1

FasterDecoding/medusa-1.0-vicuna-33b-v1.3

Text Generation • Updated Dec 18, 2023 • 5

FasterDecoding/medusa-1.0-zephyr-7b-beta

Text Generation • Updated Dec 18, 2023 • 35 • 1

FasterDecoding/medusa-v1.0-vicuna-7b-v1.5

Text Generation • Updated Oct 29, 2023 • 111

FasterDecoding/medusa-vicuna-33b-v1.3

Updated Sep 11, 2023 • 8 • 4

FasterDecoding/medusa-vicuna-13b-v1.3

Updated Sep 11, 2023 • 62 • 5

FasterDecoding/medusa-vicuna-7b-v1.3

Updated Sep 11, 2023 • 1.45k • 16