Instructions to use StableDiffusionVN/Flux with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use StableDiffusionVN/Flux with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf StableDiffusionVN/Flux:Q4_K_S # Run inference directly in the terminal: llama cli -hf StableDiffusionVN/Flux:Q4_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf StableDiffusionVN/Flux:Q4_K_S # Run inference directly in the terminal: llama cli -hf StableDiffusionVN/Flux:Q4_K_S
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf StableDiffusionVN/Flux:Q4_K_S # Run inference directly in the terminal: ./llama-cli -hf StableDiffusionVN/Flux:Q4_K_S
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf StableDiffusionVN/Flux:Q4_K_S # Run inference directly in the terminal: ./build/bin/llama-cli -hf StableDiffusionVN/Flux:Q4_K_S
Use Docker
docker model run hf.co/StableDiffusionVN/Flux:Q4_K_S
- LM Studio
- Jan
- Ollama
How to use StableDiffusionVN/Flux with Ollama:
ollama run hf.co/StableDiffusionVN/Flux:Q4_K_S
- Unsloth Desktop
- Docker Model Runner
How to use StableDiffusionVN/Flux with Docker Model Runner:
docker model run hf.co/StableDiffusionVN/Flux:Q4_K_S
- Lemonade
How to use StableDiffusionVN/Flux with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull StableDiffusionVN/Flux:Q4_K_S
Run and chat with the model
lemonade run user.Flux-Q4_K_S
List all available models
lemonade list
- Atomic Chat
Commit History
-
/content/
Verified signature73676cc
-
/content/
Verified signatureb2970dc -
Delete Checkpoint/Flux_dev_turbo_max.safetensors
Verified signatureabcdc94 -
Rename Checkpoinr/Flux_dev_turbo_krea_mix.safetensors to Checkpoint/Flux_dev_turbo_krea_mix.safetensors
Verified signature624abcb -
/content/
Verified signature920e66f -
/content/
Verified signaturee9e12bf -
/content/
Verified signature7a76833
-
/content/
Verified signature418d04d -
/content/
Verified signatureef2981a -
Delete Lora/Krea_lora_128.safetensors
Verified signature10663f5 -
/content/
Verified signature3861bb5 -
/content/
Verified signature03fbfab -
/content/
Verified signature47691c1 -
/content/
Verified signature4d8117c
-
/content/
Verified signatureafc9aef -
/content/
Verified signatured20e47a
-
/content/
Verified signature423b085 -
/content/
Verified signaturebdd5b7e
-
Rename Lora/flux_yuuface.safetensors to Lora/SDVN_flux_yuuface.safetensors
Verified signatureab4e906 -
Upload flux_yuuface.safetensors
Verified signature25fd97c
-
/content/
Verified signaturee1a1b5e
-
/content/
Verified signature54c718d -
/content/
Verified signature4e56a59
-
Rename Checkpoints/Flux_dev_v1_fill-fp8.safetensors to Checkpoint/Flux_dev_v1_fill-fp8.safetensors
Verified signature6cd8d5c
-
Rename checkpoints/Flux_dev_v1_fill-fp8.safetensors to Checkpoints/Flux_dev_v1_fill-fp8.safetensors
Verified signatured1d30cd -
/content/
Verified signatured06f90b -
Delete Checkpoint/Flux_dev_v1_fill.safetensors
Verified signaturec40a029
-
Upload 10 files
Verified signature31597c9
-
/content/
Verified signature9fc510b -
Rename Checkpoints/Flux_dev_v1_fill.safetensors to Checkpoint/Flux_dev_v1_fill.safetensors
Verified signature8cb4798 -
Rename checkpoints/Flux_dev_v1_fill.safetensors to Checkpoints/Flux_dev_v1_fill.safetensors
Verified signature1b6291c -
/content/
Verified signatureff99a05 -
/content/
Verified signaturee1c537d -
Rename Redux/flux1-canny-dev-lora.safetensors to Redux/flux1-redux-dev.safetensors
Verified signatureff1bfa4 -
/content/
Verified signaturebf3600a -
/content/
Verified signature9ee6f00 -
/content/
Verified signature7a93a13
-
/content/
Verified signaturee4bd077 -
/content/
Verified signaturecc64133 -
Delete StepLora/Hyper-FLUX.1-dev-8steps-lora.safetensors
Verified signature8aae372
-
Rename ComfyUI_workflow/Flux image prompt text-img Upscale.json to ComfyUI_workflow/Flux_image_prompt_text-img_Upscale.json
Verified signature8a2ca9e -
Upload Flux image prompt text-img Upscale.json
Verified signature50975ca
-
Update README.md
Verified signaturea888777 -
Rename ComfyUI_workflow/Flux Hyper Lora Upscale.json to ComfyUI_workflow/Flux_Hyper_Lora_Upscale.json
Verified signaturea6bd064 -
Rename ComfyUI_workflow/Flux Hyper Lora Upscale.png to ComfyUI_workflow/Flux_Hyper_Lora_Upscale.png
Verified signature9e6456b -
Update README.md
Verified signature29b467d -
/content/
Verified signature30cdb45 -
Upload 2 files
Verified signature368b596
-
Update README.md
Verified signaturec67eb90 -
Update README.md
Verified signaturedc8a8a8