Compatibility Reports

check_circle

SD 3 Medium

RTX A4000

PERFECT

6.0GB / 16.0GB VRAM +10.0GB

cancel

Llama 3.1 70B

RTX 4090

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

DeepSeek-V3

RTX 4070 Ti SUPER

FAIL/OOM

1342.0GB / 16.0GB VRAM -1326.0GB

cancel

LLaVA 1.6 34B

RTX 4060

FAIL/OOM

68.0GB / 8.0GB VRAM -60.0GB

cancel

DeepSeek-V3

RTX 4060 Ti 16GB

FAIL/OOM

1342.0GB / 16.0GB VRAM -1326.0GB

check_circle

Qwen 2.5 14B

H100 PCIe

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

BGE-Large-EN

RTX 4070 Ti SUPER

PERFECT

0.7GB / 16.0GB VRAM +15.3GB

check_circle

BGE-M3

RTX 4080

PERFECT

1.0GB / 16.0GB VRAM +15.0GB

check_circle

Gemma 2 9B

RTX 3090 Ti

PERFECT

4.5GB / 24.0GB VRAM +19.5GB

cancel

LLaVA 1.6 13B

RTX 3070

FAIL/OOM

26.0GB / 8.0GB VRAM -18.0GB

warning

FLUX.1 Dev

RTX 3090

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

check_circle

Gemma 2 2B

A100 40GB

PERFECT

0.8GB / 40.0GB VRAM +39.2GB

check_circle

BGE-M3

RTX A4000

PERFECT

1.0GB / 16.0GB VRAM +15.0GB

check_circle

BGE-Small-EN

Jetson AGX Orin 64GB

PERFECT

0.1GB / 64.0GB VRAM +63.9GB

cancel

Mistral Large 2

RTX A4000

FAIL/OOM

246.0GB / 16.0GB VRAM -230.0GB

cancel

Llama 3.1 70B

RTX 3090 Ti

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

cancel

DeepSeek-V2.5

RTX 4070 SUPER

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

check_circle

SD 2.1

RTX 4070

PERFECT

5.0GB / 12.0GB VRAM +7.0GB

cancel

Llama 3.1 405B

A100 40GB

FAIL/OOM

202.5GB / 40.0GB VRAM -162.5GB

cancel

Llama 3.3 70B

RTX A6000

FAIL/OOM

140.0GB / 48.0GB VRAM -92.0GB

cancel

Llama 3.1 405B

RTX 4090

FAIL/OOM

202.5GB / 24.0GB VRAM -178.5GB

check_circle

Gemma 2 2B

RTX 3090 Ti

PERFECT

1.0GB / 24.0GB VRAM +23.0GB

check_circle

Gemma 2 2B

H100 PCIe

PERFECT

1.0GB / 80.0GB VRAM +79.0GB

check_circle

BGE-M3

RTX A5000

PERFECT

1.0GB / 24.0GB VRAM +23.0GB