Compatibility Reports

check_circle

CLIP ViT-L/14

RTX 4080 SUPER

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

cancel

LLaVA 1.6 13B

RTX 4070

FAIL/OOM

26.0GB / 12.0GB VRAM -14.0GB

cancel

DeepSeek-V2.5

RTX 4060 Ti 8GB

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

cancel

Llama 3 70B

RTX 4090

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

Llama 3.1 70B

RTX 4090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

LLaVA 1.6 34B

RTX 4060 Ti 16GB

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

check_circle

BGE-M3

RTX 4090

PERFECT

1.0GB / 24.0GB VRAM +23.0GB

warning

SDXL 1.0

RTX 3070

MARGINAL

8.0GB / 8.0GB VRAM +0.0GB

cancel

FLUX.1 Schnell

RTX 3080 12GB

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

warning

FLUX.1 Schnell

RTX 3090

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

check_circle

SD 1.5

RTX 4080

PERFECT

4.0GB / 16.0GB VRAM +12.0GB

cancel

Gemma 2 27B

RX 7900 XTX

FAIL/OOM

27.0GB / 24.0GB VRAM -3.0GB

cancel

FLUX.1 Dev

RTX 4080 SUPER

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

cancel

LLaVA 1.6 34B

RTX 4070

FAIL/OOM

68.0GB / 12.0GB VRAM -56.0GB

check_circle

BGE-Small-EN

RTX 4080

PERFECT

0.1GB / 16.0GB VRAM +15.9GB

cancel

LLaVA 1.6 34B

RTX 4080 SUPER

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

cancel

FLUX.1 Schnell

RTX 4000 Ada

FAIL/OOM

24.0GB / 20.0GB VRAM -4.0GB

check_circle

CLIP ViT-L/14

RX 7800 XT

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

check_circle

SD 1.5

RTX 4060 Ti 16GB

PERFECT

4.0GB / 16.0GB VRAM +12.0GB

cancel

Mistral Large 2

RTX 4080 SUPER

FAIL/OOM

246.0GB / 16.0GB VRAM -230.0GB

thumb_up

Qwen2-VL 7B

RTX 4060 Ti 16GB

GOOD

14.0GB / 16.0GB VRAM +2.0GB

check_circle

LLaVA 1.6 13B

Jetson AGX Orin 64GB

PERFECT

26.0GB / 64.0GB VRAM +38.0GB

cancel

Llama 3.1 405B

A100 40GB

FAIL/OOM

405.0GB / 40.0GB VRAM -365.0GB

cancel

Qwen 2.5 72B

RTX 3090

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB