FLUX.1-Kontext RefControl LORA(reference + control input)
Collection
5 items β’ Updated β’ 2
How to use thedeoxen/refcontrol-flux-kontext-reference-lineart-lora with Diffusers:
pip install -U diffusers transformers accelerate
import torch
from diffusers import DiffusionPipeline
# switch to "mps" for apple devices
pipe = DiffusionPipeline.from_pretrained("black-forest-labs/FLUX.1-Kontext-dev", dtype=torch.bfloat16, device_map="cuda")
pipe.load_lora_weights("thedeoxen/refcontrol-flux-kontext-reference-lineart-lora")
prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k"
image = pipe(prompt).images[0]A LoRA for Flux Kontext Dev that fuses a reference image (left) with a lineart map (right).
It preserves identity and style from the reference while following the lines and contours from the control.
Trigger word: `refcontrollineart`
This LoRA was primarily trained on human characters and objects, but it works well with stylized art too.
The main goal is to preserve identity β facial features, clothing, or style β from the reference image, while adapting them to the structure given by the lineart map.
refcontrolcanny, change ineart to photo with reference from left
Download them in the Files & versions tab.
Base model
black-forest-labs/FLUX.1-Kontext-dev