Configurable Safety Tuning of Language Models with Synthetic Preference Data
Paper
•
2404.00495
•
Published
•
2
Configurable Safety Tuning ⚙️
CST allows for configurable inference-time control of LLM safety levels, so users can dictate model behavior based on the system prompt
-
-
vicgalle/configurable-system-prompt-multitask
Viewer • Updated • 1.95k • 113 • 26 -
vicgalle/ConfigurableHermes-7B
Text Generation • Updated • 1.02k • 3 -
vicgalle/ConfigurableSOLAR-10.7B
Text Generation • Updated • 1.03k • 3 -
vicgalle/ConfigurableBeagle-11B
Text Generation • Updated • 1.04k • 3 -
vicgalle/Configurable-Llama-3-8B-v0.3
Text Generation • Updated • 1.03k • 15 -
vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B
Text Generation • Updated • 6.44k • 6 -
vicgalle/Configurable-Yi-1.5-9B-Chat
Text Generation • Updated • 1.49k • 3 -
vicgalle/Configurable-SmolLM-1.7B
Text Generation • Updated • 7 • 1 -
vicgalle/Configurable-Llama-3.1-8B-Instruct
Text Generation • Updated • 1.31k • • 17 -
vicgalle/Configurable-Hermes-3-Llama-3.1-8B
Text Generation • Updated • 20 • 4