Back to Hardware Index

Macbook Unified Memory

Best local text models for MacBook 24gb

If you are searching for the best text model for MacBook 24GB, this compatibility index displays all open-source Large Language Models (LLMs) that fit your system at a baseline context length of 8,192 tokens. Compare quantization formats (FP16, Q8, Q4) to prevent CUDA OOM crashes.

Supported GPU Configurations & Tiers:

Apple M2/M3 Macbook Pro (24GB)Apple M2/M3 Macbook Air (24GB)

Compatible Local LLMs (11)

Meta30B params

Muse Glimmer 30B

FP16OOM

Q8_0OOM

Q4_K_MFits in VRAM

Meta8B params

Llama-3.1 8B (Instruct)

FP16Fits in VRAM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

Mistral AI7B params

Mistral 7B v0.3

FP16Fits in VRAM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

Mistral AI22B params

Codestral 22B

FP16OOM

Q8_0OOM

Q4_K_MFits in VRAM

Mistral AI3B params

Ministral 3 3B (Instruct)

FP16Fits in VRAM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

Mistral AI8B params

Ministral 3 8B

FP16Fits in VRAM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

Mistral AI14B params

Ministral 3 14B

FP16Fits in VRAM

Q8_0OOM

Q4_K_MFits in VRAM

Google2.3B params

Gemma 4 E2B

FP16Fits in VRAM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

Google4.5B params

Gemma 4 E4B

FP16Fits in VRAM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

Google11.95B params

Gemma 4 12B

FP16OOM

Q8_0Fits in VRAM

Q4_K_MFits in VRAM

OpenAI21B params

gpt-oss-20b

FP16Fits in VRAM

Q8_0N/A

Q4_K_MN/A