--- tags: - text-to-image - lora - diffusers - template:diffusion-lora widget: - text: 'Sketch paint, An eye-level perspective, a medium-sized portrait of a woman, is depicted in a blue and white monochromatic fashion. The womans head is adorned with a large, fluffy, fuzzy hat, adorned with white flowers. Her hair is pulled back, framing her face, adding a touch of depth to the composition. She is wearing a black dress with a white scarf draped over her shoulders. Her dress is draped in a low-angle pattern, adding texture to the overall composition. The background is a dark blue, creating a stark contrast to the womans face.' output: url: images/1.png - text: 'Sketch paint, An abstract painting of a woman with a yellow duck perched on her head. The womans face is painted white, with black dots all over it. Her hair is dark brown, and she is wearing a white headscarf. The duck is a bright yellow color, with a black beak and feet. The background is a dark blue, and there are small red dots scattered across it.' output: url: images/2.png - text: 'Sketch paint, A medium-sized painting of a woman and a cat. The womans face is painted white, with long dark hair. Her eyes are squinted, and her lips are painted black. Her hair is pulled back in a ponytail, and she is wearing a white headband. Her dress is black, with a white collar, and the cat is a vibrant orange color. The cats eyes are a piercing blue, while the cats tail is a darker shade of red. The background is a dark blue, with white lines and dots all over it.' output: url: images/3.png - text: 'Sketch paint, A medium-sized sketch of a woman and a cat. The womans face is painted white, while the cats body is painted in shades of gray. The cats eyes are blue, and its nose is pointed towards the right side of the image. The background is a light brown, and there are small white stars scattered throughout the image, adding a touch of color to the scene.' output: url: images/4.png - text: 'Sketch paint, A medium-sized painting of a man wearing a red jacket and a white scarf. His face is painted in shades of pale gray, with dark, intense eyes and a short beard. His hair is dark brown and slightly tousled. In his hand, he holds a small bluebird with vibrant feathers. The background is a deep green, with soft, swirling patterns that give the painting a dreamlike quality.' output: url: images/5.png - text: 'Sketch paint, A whimsical painting of a llama standing in a vibrant meadow. The llama is painted in shades of white and gray, with a long neck adorned by colorful, woven patterns resembling a blanket. Its large, expressive eyes are painted in deep brown, with a soft pink nose. The background is a bright turquoise sky with fluffy white clouds and hints of mountains in the distance.' output: url: images/6.png - text: 'Sketch paint, A dramatic painting of a SpaceX Falcon 9 rocket during liftoff. The rocket is painted in sleek white and black, with the SpaceX logo prominently displayed. Flames and smoke in vibrant shades of orange and gray burst from the base, creating dynamic motion. The background is a mix of dark blue and purple, with faint stars and a glowing crescent moon visible in the upper corner.' output: url: images/7.png - text: 'Sketch paint, A futuristic painting of Wall-E holding a tiny plant in his claw. Wall-E is painted in yellow and gray, with rust and scratches adding texture to his body. His eyes, large and round, are painted in reflective silver, showing a faint reflection of stars. The background is a dark navy blue with small, twinkling stars and a faint glow of Earth in the distance.' output: url: images/8.png - text: 'Sketch paint, A whimsical painting of a woman holding an umbrella under a rain of colorful stars. The womans face is painted in a soft lavender hue, with her curly hair blending shades of purple and silver. She is wearing a pale yellow coat with large buttons. The umbrella is striped in red and white, contrasting against the dark indigo background filled with multicolored stars and small silver clouds.' output: url: images/9.png base_model: black-forest-labs/FLUX.1-dev instance_prompt: Sketch paint license: creativeml-openrail-m --- ![asfsdfsd.png](https://cdn-uploads.huggingface.co/production/uploads/65bb837dbfb878f46c77de4c/HrGLF33rDjOsQxfwH2MDZ.png) # Model description for Flux-Sketch-Paint-LoRA Image Processing Parameters | Parameter | Value | Parameter | Value | |---------------------------|--------|---------------------------|--------| | LR Scheduler | constant | Noise Offset | 0.03 | | Optimizer | AdamW | Multires Noise Discount | 0.1 | | Network Dim | 64 | Multires Noise Iterations | 10 | | Network Alpha | 32 | Repeat & Steps | 25 & 3070 | | Epoch | 17 | Save Every N Epochs | 1 | Labeling: florence2-en(natural language & English) Total Images Used for Training : 19 ## Best Dimensions & Inference | **Dimensions** | **Aspect Ratio** | **Recommendation** | |-----------------|------------------|---------------------------| | 1280 x 832 | 3:2 | Best | | 1024 x 1024 | 1:1 | Default | ### Inference Range - **Recommended Inference Steps:** 30–35 ## Setting Up ```python import torch from pipelines import DiffusionPipeline base_model = "black-forest-labs/FLUX.1-dev" pipe = DiffusionPipeline.from_pretrained(base_model, torch_dtype=torch.bfloat16) lora_repo = "strangerzonehf/Sketch-paint" trigger_word = "Sketch paint" pipe.load_lora_weights(lora_repo) device = torch.device("cuda") pipe.to(device) ``` ## Trigger words You should use `Sketch paint` to trigger the image generation. ## Download model Weights for this model are available in Safetensors format. [Download](/strangerzonehf/Sketch-Paint/tree/main) them in the Files & versions tab.