FLUX.1 Merged Models - Several different Schnell:Dev ratios

This repository includes merged models from black-forest-labs/FLUX.1-dev and black-forest-labs/FLUX.1-schnell, in different ratios. The licenses of both models apply to these merged models.

Inspired by: https://huggingface.co/sayakpaul/FLUX.1-merged

Motivation

The goal is to create modeld which balance generation speed - allowing near-Dev generations in more like 4-16 generations.

Results

Based on these results, I saved and uploaded models for the ratios 10:1, 4:1, and 2.5:1.

I recommend the following number of generation steps for these models:

Model Steps
10:1 4-8
4:1 8-16(+)
2.5:1 8-16+

Procedure

I modified sayakpaul's merge code to do merges at various ratios (weights), rather than simply averaging the two 1:1, and generated a series of images with those models, and the originals. See merge_compare.py.

I first did a series of ratios ranging from mostly Schnell to mostly Dev. Based on those results, I did more tests with larger images in ratios favoring Schnell more.

From these tests, I saved and uploaded a few of my favorite ratios, namely 10:1, 4:1, and 2.5:1. Then I did some additional generations* using those models, see infer.py.

Single-file safetensor models are available on CivitAI: https://civitai.com/models/628669

*And here they are. All images generated at 1280x1024, with CFG=3.5. The test/grid images were done with seed=0, and the images of the two women with seed=42 (best of a batch of 4).

Prompt1: "Impressionistic tableau medium shot painting with soft, blended brushstrokes and muted colors complemented by sporadic vibrant highlights.", Prompt2: "Impressionistic tableau painting with soft brushstrokes and muted colors, accented by vibrant highlights, of a tranquil courtyard surrounded by wildflowers. Madison, a 19-year-old woman with light dirty blond hair and bubblegum-pink highlights in a ponytail, brown eyes, and soft facial features, stands beside Amelia, a tall mid-20s woman with deep auburn hair in a messy bun, summer sky-blue eyes, and pronounced cheekbones. Together, they exude harmony and intrigue, their contrasting features complementing each other."

10:1, 6 steps:

4:1, 10 steps:

2.51:1, 12 steps:

Prompt: A macro photograph of a small, armored creature making its way across a vibrant green leaf. Its shell is a spiral, swirling pattern of protective plating, while its body is soft and slimy, with a pair of antennae on its head. Sturdy claws grip the leaf as it moves. A tiny, beady eye peers out from beneath the shell.

10:1, 6 steps:

4:1, 10 steps:

2.51:1, 12 steps:

Prompt: A surreal image of a pink, multi-headed bird-like creature basking in warm, golden light. Its main body is slender and elongated, with soft feathers, while five additional heads sprout from its shoulders, each with its own long neck and beak. The heads seem to move in a slow, underwater motion. A soft focus blur of reeds and water lilies fills the background.

10:1, 6 steps:

4:1, 10 steps:

2.51:1, 12 steps:

Prompt: A photograph of a large, winged canine perched atop a snow-capped mountain peak. Its body is covered in thick, gray fur, while its wings and talons are feathered and sharp. The wingspan is impressive, at least 10 feet wide. The eyes burn with a fierce gaze, surveying the kingdom below. A breathtaking mountain vista stretches out to the horizon.

10:1, 6 steps:

4:1, 10 steps:

2.51:1, 12 steps:

Downloads last month
0
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.