Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
crumb 's Collections
reasoning
MoLora-v1
MoLora-v2
GPT2-Linear
Shrink Llama - V1
Cramp(ed) Models
MoAT (More Artificial Tokens)

MoLora-v1

updated Sep 9, 2023

Model assets for the first Mixture-of-Lora technique applied to Llama. https://bit.ly/48bqshl

Upvote
-

  • crumb/llama2-7b-moe-text-exp0-4

    Updated Jul 19, 2023 • 11

  • crumb/llama2-7b-moe-text-exp1-4

    Updated Jul 19, 2023 • 13 • 2

  • crumb/llama2-7b-moe-text-exp2-4

    Updated Jul 19, 2023 • 11

  • crumb/llama2-7b-moe-text-exp3-4

    Updated Jul 19, 2023 • 39

  • crumb/llama2-7b-moe-text-exp-control-4

    Updated Jul 19, 2023 • 8
Upvote
-
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs