memory

AI Models for NVIDIA RTX 4060 Ti 8GB

8.0GB VRAM • NVIDIA • Ada Lovelace

info GPU Details
check_circle 9 Perfect
thumb_up 2 Good
warning 1 Marginal
cancel 12 Fail
check_circle

Whisper Small

Whisper • 0.24B

PERFECT
0.5GB required +7.5GB headroom
check_circle

Whisper Medium

Whisper • 0.76B

PERFECT
1.5GB required +6.5GB headroom
check_circle

Whisper Base

Whisper • 0.07B

PERFECT
0.2GB required +7.8GB headroom
check_circle

SD 1.5

Stable Diffusion • 0.98B

PERFECT
4.0GB required +4.0GB headroom
check_circle

CLIP ViT-H/14

CLIP • 0.60B

PERFECT
2.0GB required +6.0GB headroom
check_circle

BGE-Small-EN

BGE • 0.03B

PERFECT
0.1GB required +7.9GB headroom
check_circle

CLIP ViT-L/14

CLIP • 0.40B

PERFECT
1.5GB required +6.5GB headroom
check_circle

BGE-M3

BGE • 0.50B

PERFECT
1.0GB required +7.0GB headroom
check_circle

BGE-Large-EN

BGE • 0.33B

PERFECT
0.7GB required +7.3GB headroom
warning

SDXL 1.0

Stable Diffusion • 6.60B

MARGINAL
8.0GB required +0.0GB headroom
thumb_up

SD 2.1

Stable Diffusion • 0.87B

GOOD
5.0GB required +3.0GB headroom
thumb_up

SD 3 Medium

Stable Diffusion • 2.00B

GOOD
6.0GB required +2.0GB headroom
cancel

DeepSeek-V2.5

DeepSeek • 236.00B

FAIL/OOM
472.0GB required -464.0GB headroom
cancel

FLUX.1 Dev

FLUX • 12.00B

FAIL/OOM
24.0GB required -16.0GB headroom
cancel

Mistral Large 2

Mistral • 123.00B

FAIL/OOM
246.0GB required -238.0GB headroom
cancel

DeepSeek-Coder-V2

DeepSeek • 236.00B

FAIL/OOM
472.0GB required -464.0GB headroom
cancel

Llama 3.3 70B

Llama • 70.00B

FAIL/OOM
140.0GB required -132.0GB headroom
cancel

DeepSeek-V3

DeepSeek • 671.00B

FAIL/OOM
1342.0GB required -1334.0GB headroom
cancel

Qwen2-VL 7B

Qwen • 7.00B

FAIL/OOM
14.0GB required -6.0GB headroom
cancel

Qwen2-VL 72B

Qwen • 72.00B

FAIL/OOM
144.0GB required -136.0GB headroom
cancel

LLaVA 1.6 34B

LLaVA • 34.00B

FAIL/OOM
68.0GB required -60.0GB headroom
cancel

FLUX.1 Schnell

FLUX • 12.00B

FAIL/OOM
24.0GB required -16.0GB headroom
cancel

LLaVA 1.6 13B

LLaVA • 13.00B

FAIL/OOM
26.0GB required -18.0GB headroom
cancel

LLaVA 1.6 7B

LLaVA • 7.00B

FAIL/OOM
14.0GB required -6.0GB headroom