README.md

metadata

license: other
license_name: flux-1-dev-non-commercial-license
license_link: https://huggingface.co/black-forest-labs/FLUX.1-dev/blob/main/LICENSE.md
tags:
  - Text-to-Image
  - ControlNet
  - Stable Diffusion
  - diffusers
pipeline_tag: text-to-image
base_model: black-forest-labs/FLUX.1-dev
language:
  - en

This repository provides a checkpoint with trained ControlNet Canny model for FLUX.1-dev model by Black Forest Labs

ComfyUI

See our github for comfy ui workflows.

Training details

XLabs AI team is happy to publish fune-tuning Flux scripts, including:

• LoRA 🔥
• ControlNet 🔥

See our github for train script and train configs.

Training dataset

Dataset has the following format for the training process:

├── images/
│    ├── 1.png
│    ├── 1.json
│    ├── 2.png
│    ├── 2.json
│    ├── ...

A .json file contains "caption" field with a text prompt.

Inference

To test our checkpoints, use commands presented below.

python3 demo_controlnet_inference.py \
    --checkpoint controlnet.safetensors \
    --control_image "input_image.jpg" \
    --prompt "a handsome viking man with white hair, cinematic, MM full HD"

python3 demo_controlnet_inference.py \
    --checkpoint controlnet.safetensors \
    --control_image "input_image.jpg" \
    --prompt "a dark evil mysterius house with ghosts, cinematic, MM full HD"

License

controlnet.safetensors falls under the FLUX.1 [dev] Non-Commercial License