Compatibility Reports

check_circle

LLaVA 1.6 7B

RTX 5000 Ada

PERFECT

14.0GB / 32.0GB VRAM +18.0GB

check_circle

FLUX.1 Schnell

A100 40GB

PERFECT

24.0GB / 40.0GB VRAM +16.0GB

check_circle

SD 2.1

RTX 3090

PERFECT

5.0GB / 24.0GB VRAM +19.0GB

cancel

FLUX.1 Dev

RTX 3070

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

cancel

FLUX.1 Schnell

RTX 4060

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

check_circle

Phi-3 Small 7B

RTX 3090

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

check_circle

BGE-Large-EN

RX 7900 XT

PERFECT

0.7GB / 20.0GB VRAM +19.3GB

check_circle

Gemma 2 2B

A100 40GB

PERFECT

1.0GB / 40.0GB VRAM +39.0GB

check_circle

BGE-Large-EN

RTX A4000

PERFECT

0.7GB / 16.0GB VRAM +15.3GB

check_circle

Qwen 2.5 14B

A100 80GB

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

cancel

DeepSeek-V3

RTX 4070

FAIL/OOM

1342.0GB / 12.0GB VRAM -1330.0GB

cancel

Llama 3.3 70B

RTX A5000

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

FLUX.1 Schnell

RTX 3080 Ti

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

cancel

LLaVA 1.6 34B

RTX 3060 Ti

FAIL/OOM

68.0GB / 8.0GB VRAM -60.0GB

check_circle

CLIP ViT-L/14

RX 7900 XT

PERFECT

1.5GB / 20.0GB VRAM +18.5GB

cancel

LLaVA 1.6 13B

RTX A5000

FAIL/OOM

26.0GB / 24.0GB VRAM -2.0GB

cancel

Qwen 2.5 32B

RTX 4090

FAIL/OOM

64.0GB / 24.0GB VRAM -40.0GB

cancel

Qwen 2.5 72B

RTX 4090

FAIL/OOM

36.0GB / 24.0GB VRAM -12.0GB

check_circle

Gemma 2 27B

A100 40GB

PERFECT

10.8GB / 40.0GB VRAM +29.2GB

check_circle

CLIP ViT-H/14

RTX 4070 Ti

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

check_circle

CLIP ViT-H/14

RTX A5000

PERFECT

2.0GB / 24.0GB VRAM +22.0GB

cancel

DeepSeek-Coder-V2

RTX 3080 Ti

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

check_circle

BGE-M3

RX 7900 XT

PERFECT

1.0GB / 20.0GB VRAM +19.0GB

check_circle

LLaVA 1.6 7B

RTX A5000

PERFECT

14.0GB / 24.0GB VRAM +10.0GB