Compatibility Reports

cancel

Qwen 2.5 72B

A100 40GB

FAIL/OOM

144.0GB / 40.0GB VRAM -104.0GB

cancel

Llama 3.1 405B

A100 80GB

FAIL/OOM

202.5GB / 80.0GB VRAM -122.5GB

check_circle

CLIP ViT-H/14

RX 7900 XTX

PERFECT

2.0GB / 24.0GB VRAM +22.0GB

check_circle

BGE-Large-EN

RTX 3090

PERFECT

0.7GB / 24.0GB VRAM +23.3GB

check_circle

Qwen2-VL 7B

RTX 3090 Ti

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

cancel

Llama 3.1 405B

A100 80GB

FAIL/OOM

405.0GB / 80.0GB VRAM -325.0GB

check_circle

Qwen2-VL 7B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

cancel

Llama 3.1 405B

H100 SXM

FAIL/OOM

202.5GB / 80.0GB VRAM -122.5GB

cancel

Qwen2-VL 72B

RTX 4090

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

cancel

Gemma 2 27B

RTX 3090 Ti

FAIL/OOM

27.0GB / 24.0GB VRAM -3.0GB

check_circle

CLIP ViT-H/14

RTX 4090

PERFECT

2.0GB / 24.0GB VRAM +22.0GB

cancel

Llama 3.1 405B

H100 SXM

FAIL/OOM

162.0GB / 80.0GB VRAM -82.0GB

check_circle

BGE-Large-EN

RTX 3090 Ti

PERFECT

0.7GB / 24.0GB VRAM +23.3GB

cancel

Qwen2-VL 72B

RTX 3090 Ti

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

cancel

Gemma 2 27B

RTX 3090

FAIL/OOM

27.0GB / 24.0GB VRAM -3.0GB

cancel

Qwen2-VL 72B

RTX 3090

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

check_circle

CLIP ViT-L/14

RTX 3090 Ti

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

cancel

Gemma 2 27B

RTX 3090 Ti

FAIL/OOM

54.0GB / 24.0GB VRAM -30.0GB

cancel

Qwen 2.5 72B

H100 PCIe

FAIL/OOM

144.0GB / 80.0GB VRAM -64.0GB

cancel

Qwen 2.5 14B

RTX 4090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

cancel

Gemma 2 27B

RTX 3090

FAIL/OOM

54.0GB / 24.0GB VRAM -30.0GB

cancel

Llama 3 70B

H100 SXM

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

cancel

Llama 3.1 70B

H100 PCIe

FAIL/OOM

140.0GB / 80.0GB VRAM -60.0GB

cancel

Qwen 2.5 14B

RTX 3090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB