Compatibility Reports

check_circle

Qwen 2.5 14B

H100 PCIe

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

cancel

LLaVA 1.6 34B

RTX 4080

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

check_circle

Llama 3 8B

RTX 3090

PERFECT

3.2GB / 24.0GB VRAM +20.8GB

thumb_up

Qwen2-VL 7B

RTX 4080 SUPER

GOOD

14.0GB / 16.0GB VRAM +2.0GB

cancel

Llama 3.1 405B

A100 40GB

FAIL/OOM

810.0GB / 40.0GB VRAM -770.0GB

check_circle

BGE-Small-EN

RTX 4070

PERFECT

0.1GB / 12.0GB VRAM +11.9GB

cancel

Mixtral 8x22B

H100 SXM

FAIL/OOM

282.0GB / 80.0GB VRAM -202.0GB

cancel

DeepSeek-V3

RTX 4000 Ada

FAIL/OOM

1342.0GB / 20.0GB VRAM -1322.0GB

cancel

Mistral Large 2

RTX A5000

FAIL/OOM

246.0GB / 24.0GB VRAM -222.0GB

cancel

FLUX.1 Dev

RTX 3070 Ti

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

check_circle

BGE-Small-EN

RX 7800 XT

PERFECT

0.1GB / 16.0GB VRAM +15.9GB

cancel

DeepSeek-V3

RTX 3080 Ti

FAIL/OOM

1342.0GB / 12.0GB VRAM -1330.0GB

check_circle

SD 3 Medium

A100 40GB

PERFECT

6.0GB / 40.0GB VRAM +34.0GB

cancel

Qwen 2.5 72B

RTX 3090 Ti

FAIL/OOM

28.8GB / 24.0GB VRAM -4.8GB

check_circle

BGE-M3

RTX 3080 Ti

PERFECT

1.0GB / 12.0GB VRAM +11.0GB

check_circle

LLaVA 1.6 7B

RTX 6000 Ada

PERFECT

14.0GB / 48.0GB VRAM +34.0GB

check_circle

Llama 3 8B

H100 PCIe

PERFECT

3.2GB / 80.0GB VRAM +76.8GB

check_circle

Qwen 2.5 32B

A100 80GB

PERFECT

12.8GB / 80.0GB VRAM +67.2GB

check_circle

CLIP ViT-H/14

RTX 4060 Ti 16GB

PERFECT

2.0GB / 16.0GB VRAM +14.0GB

check_circle

Phi-3 Mini 3.8B

H100 SXM

PERFECT

1.9GB / 80.0GB VRAM +78.1GB

cancel

FLUX.1 Schnell

RTX 4080

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

cancel

DeepSeek-V2.5

RTX 4070 Ti SUPER

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

cancel

FLUX.1 Schnell

RTX 4070 SUPER

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

cancel

Llama 3.3 70B

Jetson AGX Orin 32GB

FAIL/OOM

140.0GB / 32.0GB VRAM -108.0GB