Compatibility Reports

check_circle

Phi-3 Medium 14B

H100 SXM

PERFECT

5.6GB / 80.0GB VRAM +74.4GB

cancel

Llama 3.3 70B

RX 7900 XT

FAIL/OOM

140.0GB / 20.0GB VRAM -120.0GB

cancel

Llama 3.3 70B

RTX 4070

FAIL/OOM

140.0GB / 12.0GB VRAM -128.0GB

check_circle

Qwen 2.5 32B

A100 40GB

PERFECT

12.8GB / 40.0GB VRAM +27.2GB

check_circle

FLUX.1 Dev

H100 SXM

PERFECT

24.0GB / 80.0GB VRAM +56.0GB

check_circle

BGE-Large-EN

RTX 3060 Ti

PERFECT

0.7GB / 8.0GB VRAM +7.3GB

cancel

DeepSeek-Coder-V2

RTX 6000 Ada

FAIL/OOM

472.0GB / 48.0GB VRAM -424.0GB

cancel

DeepSeek-V3

RTX A6000

FAIL/OOM

1342.0GB / 48.0GB VRAM -1294.0GB

cancel

LLaVA 1.6 34B

RTX 3080 Ti

FAIL/OOM

68.0GB / 12.0GB VRAM -56.0GB

check_circle

Phi-3 Mini 3.8B

H100 SXM

PERFECT

1.5GB / 80.0GB VRAM +78.5GB

check_circle

FLUX.1 Dev

H100 PCIe

PERFECT

24.0GB / 80.0GB VRAM +56.0GB

check_circle

Qwen 2.5 14B

A100 40GB

PERFECT

5.6GB / 40.0GB VRAM +34.4GB

check_circle

CLIP ViT-H/14

RTX 4080 SUPER

PERFECT

2.0GB / 16.0GB VRAM +14.0GB

check_circle

Gemma 2 2B

H100 PCIe

PERFECT

0.8GB / 80.0GB VRAM +79.2GB

check_circle

SD 2.1

RTX 4090

PERFECT

5.0GB / 24.0GB VRAM +19.0GB

cancel

Llama 3.1 405B

RTX 3090

FAIL/OOM

162.0GB / 24.0GB VRAM -138.0GB

check_circle

FLUX.1 Schnell

RTX 5000 Ada

PERFECT

24.0GB / 32.0GB VRAM +8.0GB

cancel

DeepSeek-V3

RX 7800 XT

FAIL/OOM

1342.0GB / 16.0GB VRAM -1326.0GB

cancel

Qwen 2.5 72B

RTX 3090

FAIL/OOM

28.8GB / 24.0GB VRAM -4.8GB

check_circle

BGE-M3

RTX 3080 10GB

PERFECT

1.0GB / 10.0GB VRAM +9.0GB

cancel

LLaVA 1.6 34B

RTX 6000 Ada

FAIL/OOM

68.0GB / 48.0GB VRAM -20.0GB

check_circle

BGE-Large-EN

RTX 4060 Ti 16GB

PERFECT

0.7GB / 16.0GB VRAM +15.3GB

check_circle

BGE-M3

RTX 4070 Ti SUPER

PERFECT

1.0GB / 16.0GB VRAM +15.0GB

cancel

Llama 3.3 70B

RTX 4070 Ti

FAIL/OOM

140.0GB / 12.0GB VRAM -128.0GB