Compatibility Reports

cancel

Mistral Large 2

RTX 3090 Ti

FAIL/OOM

246.0GB / 24.0GB VRAM -222.0GB

cancel

Qwen2-VL 7B

RTX 3060 12GB

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

LLaVA 1.6 34B

Jetson AGX Orin 32GB

FAIL/OOM

68.0GB / 32.0GB VRAM -36.0GB

check_circle

SD 1.5

RTX 3090

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

cancel

Qwen2-VL 72B

RTX 6000 Ada

FAIL/OOM

144.0GB / 48.0GB VRAM -96.0GB

cancel

Qwen2-VL 72B

Jetson AGX Orin 32GB

FAIL/OOM

144.0GB / 32.0GB VRAM -112.0GB

check_circle

BGE-Large-EN

RTX 4090

PERFECT

0.7GB / 24.0GB VRAM +23.3GB

cancel

Gemma 2 27B

RX 7900 XTX

FAIL/OOM

54.0GB / 24.0GB VRAM -30.0GB

cancel

Gemma 2 27B

RTX 4090

FAIL/OOM

54.0GB / 24.0GB VRAM -30.0GB

check_circle

SD 1.5

RX 7900 XTX

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

cancel

Llama 3.1 405B

H100 SXM

FAIL/OOM

810.0GB / 80.0GB VRAM -730.0GB

cancel

Qwen2-VL 72B

RX 7900 XTX

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

check_circle

Qwen2-VL 7B

H100 SXM

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

LLaVA 1.6 13B

A100 80GB

PERFECT

26.0GB / 80.0GB VRAM +54.0GB

check_circle

SD 1.5

RTX 4090

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

check_circle

Qwen2-VL 7B

A100 80GB

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

Qwen2-VL 7B

H100 PCIe

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

cancel

Qwen2-VL 7B

RTX 4070 SUPER

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

check_circle

LLaVA 1.6 13B

H100 SXM

PERFECT

26.0GB / 80.0GB VRAM +54.0GB

check_circle

BGE-M3

RTX 3090

PERFECT

1.0GB / 24.0GB VRAM +23.0GB

cancel

Llama 3.1 405B

A100 80GB

FAIL/OOM

810.0GB / 80.0GB VRAM -730.0GB

cancel

Qwen2-VL 7B

RTX 3080 10GB

FAIL/OOM

14.0GB / 10.0GB VRAM -4.0GB

check_circle

Qwen2-VL 7B

RTX 3090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

cancel

Qwen2-VL 7B

RTX 3080 12GB

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB