Compatibility Reports

cancel

LLaVA 1.6 34B

RTX 4070 SUPER

FAIL/OOM

68.0GB / 12.0GB VRAM -56.0GB

cancel

Llama 3 70B

RTX 4090

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

check_circle

LLaVA 1.6 7B

RX 7900 XTX

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

cancel

LLaVA 1.6 34B

RTX 4070 Ti

FAIL/OOM

68.0GB / 12.0GB VRAM -56.0GB

check_circle

CLIP ViT-H/14

RTX 4080

PERFECT

2.0GB / 16.0GB VRAM +14.0GB

check_circle

BGE-M3

RTX 3090 Ti

PERFECT

1.0GB / 24.0GB VRAM +23.0GB

cancel

DeepSeek-V2.5

Jetson Orin Nano 8GB

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

cancel

LLaVA 1.6 7B

RTX 4060

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

check_circle

SD 1.5

RTX 4070 Ti

PERFECT

4.0GB / 12.0GB VRAM +8.0GB

cancel

LLaVA 1.6 13B

RTX 4000 Ada

FAIL/OOM

26.0GB / 20.0GB VRAM -6.0GB

cancel

LLaVA 1.6 7B

RTX 4070 SUPER

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

FLUX.1 Schnell

RTX 4070 Ti

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

check_circle

Gemma 2 2B

H100 SXM

PERFECT

1.0GB / 80.0GB VRAM +79.0GB

cancel

Qwen 2.5 72B

RTX 3090

FAIL/OOM

72.0GB / 24.0GB VRAM -48.0GB

cancel

DeepSeek-Coder-V2

RX 7900 XT

FAIL/OOM

472.0GB / 20.0GB VRAM -452.0GB

cancel

Llama 3.3 70B

RTX 3090

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

Mistral Large 2

RTX 5000 Ada

FAIL/OOM

246.0GB / 32.0GB VRAM -214.0GB

check_circle

BGE-Small-EN

RTX 6000 Ada

PERFECT

0.1GB / 48.0GB VRAM +47.9GB

cancel

DeepSeek-V3

RTX 3080 10GB

FAIL/OOM

1342.0GB / 10.0GB VRAM -1332.0GB

cancel

LLaVA 1.6 34B

RTX 3070

FAIL/OOM

68.0GB / 8.0GB VRAM -60.0GB

check_circle

Gemma 2 2B

H100 SXM

PERFECT

0.8GB / 80.0GB VRAM +79.2GB

cancel

LLaVA 1.6 34B

RTX A4000

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

cancel

FLUX.1 Schnell

RTX 3080 10GB

FAIL/OOM

24.0GB / 10.0GB VRAM -14.0GB

check_circle

BGE-Small-EN

RTX 4070 Ti

PERFECT

0.1GB / 12.0GB VRAM +11.9GB