Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
Doctor-Shotgun 's Collections
Doc's Choice
Doc's Diffusion
Doc's LLM
Doc's LLM Loras
LLM Speculative Decoding Experiments
Doc's Graveyard

LLM Speculative Decoding Experiments

updated 2 days ago

Tiny language models meant to serve as draft models for speculative decoding.

Upvote
3

  • Doctor-Shotgun/TinyLlama-1.1B-32k

    Text Generation • Updated Feb 2, 2024 • 75 • 29

  • Doctor-Shotgun/TinyLlama-1.1B-32k-Instruct

    Text Generation • Updated Jun 7, 2024 • 8.14k • 12

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta

    Text Generation • Updated Jan 10, 2024 • 7 • 1

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft

    Text Generation • Updated Jan 10, 2024 • 8 • 2

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-theta-sft-limarp

    Text Generation • Updated Jan 10, 2024 • 10

  • Doctor-Shotgun/smol_llama-220M-GQA-32k-linear

    Text Generation • Updated Jan 10, 2024 • 12
Upvote
3
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs