Dedicated GPU Setup
Best local image models for 24gb vram
If you are looking for the best image model for 24GB VRAM, below is a detailed compatibility report for open-source image generation models (like FLUX.1 and SDXL) that run locally on your system.
Supported GPU Configurations & Tiers:
NVIDIA RTX 3090NVIDIA RTX 4090AMD RX 7900 XTX
Compatible Local Image Models (13)
Black Forest Labs32B params
FLUX.2 [dev]
Black Forest Labs9B params
FLUX.2 Klein 9B
FP16 BaseOOM
Q5_K_MCPU Offload
Q5_K_SCPU Offload
Q4_K_MCPU Offload
Q4_K_SCPU Offload
Q3_K_MCPU Offload
Q3_K_SCPU Offload
Q2_KCPU Offload
DetailsBlack Forest Labs4B params
FLUX.2 Klein 4B
FP16 BaseFits in VRAM
DetailsBlack Forest Labs12B params
FLUX.1 Kontext [dev]
FP16 BaseOOM
Q8_0CPU Offload
Q6_KCPU Offload
Q5_K_MCPU Offload
Q5_1CPU Offload
Q5_0CPU Offload
Q5_K_SCPU Offload
Q4_K_MCPU Offload
Q4_1CPU Offload
Q4_0CPU Offload
Q4_K_SCPU Offload
Q3_K_MFits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
DetailsBlack Forest Labs2.8B params
FLUX.1 [dev]
FP16 BaseOOM
F16OOM
Q8_0CPU Offload
Q6_KCPU Offload
Q5_1CPU Offload
Q5_K_SCPU Offload
Q5_0CPU Offload
Q4_1Fits in VRAM
Q4_K_SFits in VRAM
Q4_0Fits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
DetailsBlack Forest Labs12B params
FLUX.1 Schnell
FP16 BaseOOM
F16OOM
Q8_0CPU Offload
Q4_1Fits in VRAM
Q4_0Fits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
DetailsBlack Forest Labs x Krea12B params
FLUX.1 Krea [dev]
FP16 BaseOOM
Q8_0CPU Offload
Q6_KCPU Offload
Q4_K_MFits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
DetailsAlibaba (Qwen Team)20B params
Qwen-Image-2512
HiDream.ai (Vivago AI)17B params
HiDream-I1 Full
FP16 BaseOOM
FP16OOM
Q8_0OOM
Q6_KCPU Offload
Q5_K_MCPU Offload
Q4_K_MCPU Offload
Q4_0CPU Offload
Q3_K_MCPU Offload
Q2_KCPU Offload
DetailsWan (Kuaishou / ByteDance)6B params
Z-Image-Turbo
Stability AI3B params
Stable Diffusion XL Base 1.0
Kuaishou (Kwai-Kolors)3B params
Kolors
FP16 BaseFits in VRAM
DetailsBria AI8B params
FIBO
FP16 BaseCPU Offload
Details