whichLlmmodel
Back to Hardware Index
Dedicated GPU Setup

Best local image models for 32gb vram

If you are looking for the best image model for 32GB VRAM, below is a detailed compatibility report for open-source image generation models (like FLUX.1 and SDXL) that run locally on your system.

Supported GPU Configurations & Tiers:
NVIDIA RTX 5000 Ada (32GB)Dual NVIDIA RTX 4080 (32GB)Dual NVIDIA RTX 3080 16GB

Compatible Local Image Models (14)

Black Forest Labs32B params

FLUX.2 [dev]

FP16 BaseOOM
BF16OOM
Q5_K_SCPU Offload
Q3_K_MCPU Offload
Q3_K_SCPU Offload
Q2_KCPU Offload
Details
Black Forest Labs9B params

FLUX.2 Klein 9B

FP16 BaseCPU Offload
Q5_K_MFits in VRAM
Q5_K_SFits in VRAM
Q4_K_MFits in VRAM
Q4_K_SFits in VRAM
Q3_K_MFits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
Details
Black Forest Labs4B params

FLUX.2 Klein 4B

FP16 BaseFits in VRAM
Details
Black Forest Labs12B params

FLUX.1 Kontext [dev]

FP16 BaseCPU Offload
Q8_0Fits in VRAM
Q6_KFits in VRAM
Q5_K_MFits in VRAM
Q5_1Fits in VRAM
Q5_0Fits in VRAM
Q5_K_SFits in VRAM
Q4_K_MFits in VRAM
Q4_1Fits in VRAM
Q4_0Fits in VRAM
Q4_K_SFits in VRAM
Q3_K_MFits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
Details
Black Forest Labs2.8B params

FLUX.1 [dev]

FP16 BaseCPU Offload
F16CPU Offload
Q8_0Fits in VRAM
Q6_KFits in VRAM
Q5_1Fits in VRAM
Q5_K_SFits in VRAM
Q5_0Fits in VRAM
Q4_1Fits in VRAM
Q4_K_SFits in VRAM
Q4_0Fits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
Details
Black Forest Labs12B params

FLUX.1 Schnell

FP16 BaseCPU Offload
F16CPU Offload
Q8_0Fits in VRAM
Q4_1Fits in VRAM
Q4_0Fits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
Details
Black Forest Labs x Krea12B params

FLUX.1 Krea [dev]

FP16 BaseCPU Offload
Q8_0Fits in VRAM
Q6_KFits in VRAM
Q4_K_MFits in VRAM
Q3_K_SFits in VRAM
Q2_KFits in VRAM
Details
Black Forest Labs12B params

FLUX.1 Fill [dev]

FP16 BaseCPU Offload
Q3_K_SCPU Offload
Details
Alibaba (Qwen Team)20B params

Qwen-Image-2512

FP16 BaseOOM
BF16OOM
F16OOM
Q8_0CPU Offload
Q6_KCPU Offload
Q4_K_MCPU Offload
Q2_KFits in VRAM
Details
HiDream.ai (Vivago AI)17B params

HiDream-I1 Full

FP16 BaseOOM
FP16OOM
Q8_0CPU Offload
Q6_KCPU Offload
Q5_K_MFits in VRAM
Q4_K_MFits in VRAM
Q4_0Fits in VRAM
Q3_K_MFits in VRAM
Q2_KFits in VRAM
Details
Wan (Kuaishou / ByteDance)6B params

Z-Image-Turbo

FP16 BaseCPU Offload
Q8_0Fits in VRAM
Q6_KFits in VRAM
Q5_0Fits in VRAM
Q4_0Fits in VRAM
Q2_KFits in VRAM
Details
Stability AI3B params

Stable Diffusion XL Base 1.0

FP16 BaseFits in VRAM
Q4_0Fits in VRAM
Q5_K_MFits in VRAM
Details
Kuaishou (Kwai-Kolors)3B params

Kolors

FP16 BaseFits in VRAM
Details
Bria AI8B params

FIBO

FP16 BaseFits in VRAM
Details