how many steps needed ?
#3
by
pikkaa
- opened
if still at 20+ steps , would make a merge or dev and schnell , lite and gguf that can run with only 4 steps ?
Yes, this is a regular model, so it needs 20+ steps to sample correctly.
Merges should always be done on the full precision models before quantizing, so I think this question is better fit for the original repo. In theory, you could merge it with the full schnell model, but you'd have to remap the block names so they actually line up when merging (there's no 8B schnell model to merge with).
city96
changed discussion status to
closed