Compatibility Reports

cancel

DeepSeek-V3

RTX 4080 SUPER

FAIL/OOM

1342.0GB / 16.0GB VRAM -1326.0GB

cancel

Mistral Large 2

Jetson AGX Orin 32GB

FAIL/OOM

246.0GB / 32.0GB VRAM -214.0GB

cancel

Qwen 2.5 72B

RTX 3090 Ti

FAIL/OOM

72.0GB / 24.0GB VRAM -48.0GB

cancel

LLaVA 1.6 13B

RTX 3060 Ti

FAIL/OOM

26.0GB / 8.0GB VRAM -18.0GB

check_circle

Qwen 2.5 14B

A100 80GB

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

cancel

FLUX.1 Schnell

RTX 4070 Ti SUPER

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

cancel

DeepSeek-Coder-V2

RTX 3080 12GB

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

cancel

Mistral Large 2

RTX 4070

FAIL/OOM

246.0GB / 12.0GB VRAM -234.0GB

check_circle

LLaVA 1.6 7B

RX 7900 XT

PERFECT

14.0GB / 20.0GB VRAM +6.0GB

check_circle

Llama 3.1 70B

A100 80GB

PERFECT

28.0GB / 80.0GB VRAM +52.0GB

thumb_up

Qwen2-VL 7B

RTX A4000

GOOD

14.0GB / 16.0GB VRAM +2.0GB

check_circle

BGE-Small-EN

RX 7900 XT

PERFECT

0.1GB / 20.0GB VRAM +19.9GB

cancel

Mistral Large 2

RTX 3070 Ti

FAIL/OOM

246.0GB / 8.0GB VRAM -238.0GB

cancel

Mistral Large 2

RTX 4070 Ti

FAIL/OOM

246.0GB / 12.0GB VRAM -234.0GB

check_circle

SD 1.5

RTX 4080 SUPER

PERFECT

4.0GB / 16.0GB VRAM +12.0GB

warning

SDXL 1.0

RTX 3060 Ti

MARGINAL

8.0GB / 8.0GB VRAM +0.0GB

check_circle

LLaVA 1.6 7B

Jetson AGX Orin 32GB

PERFECT

14.0GB / 32.0GB VRAM +18.0GB

check_circle

LLaVA 1.6 7B

H100 PCIe

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

Qwen 2.5 14B

A100 80GB

PERFECT

5.6GB / 80.0GB VRAM +74.4GB

cancel

Llama 3.1 405B

RTX 4090

FAIL/OOM

162.0GB / 24.0GB VRAM -138.0GB

check_circle

CLIP ViT-L/14

RTX 6000 Ada

PERFECT

1.5GB / 48.0GB VRAM +46.5GB

check_circle

Gemma 2 2B

H100 SXM

PERFECT

4.0GB / 80.0GB VRAM +76.0GB

check_circle

CLIP ViT-L/14

RTX 4000 Ada

PERFECT

1.5GB / 20.0GB VRAM +18.5GB

warning

FLUX.1 Schnell

RTX A5000

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB