Compatibility Reports

check_circle

LLaVA 1.6 7B

RTX 4000 Ada

PERFECT

14.0GB / 20.0GB VRAM +6.0GB

cancel

FLUX.1 Dev

RTX 4070

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

check_circle

Mixtral 8x7B

H100 PCIe

PERFECT

23.4GB / 80.0GB VRAM +56.6GB

cancel

FLUX.1 Schnell

RTX 3070 Ti

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

cancel

FLUX.1 Dev

RTX 3060 12GB

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

check_circle

BGE-M3

RTX 3060 Ti

PERFECT

1.0GB / 8.0GB VRAM +7.0GB

check_circle

SD 2.1

RTX 3080 Ti

PERFECT

5.0GB / 12.0GB VRAM +7.0GB

cancel

Llama 3 70B

RX 7900 XTX

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

check_circle

BGE-M3

RTX 3070 Ti

PERFECT

1.0GB / 8.0GB VRAM +7.0GB

check_circle

FLUX.1 Dev

A100 40GB

PERFECT

24.0GB / 40.0GB VRAM +16.0GB

check_circle

Phi-3 Mini 3.8B

H100 SXM

PERFECT

7.6GB / 80.0GB VRAM +72.4GB

cancel

Llama 3.3 70B

RTX 3070 Ti

FAIL/OOM

140.0GB / 8.0GB VRAM -132.0GB

cancel

Llama 3.3 70B

RTX A4000

FAIL/OOM

140.0GB / 16.0GB VRAM -124.0GB

check_circle

Phi-3 Mini 3.8B

RTX 3090 Ti

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

check_circle

Llama 3.1 8B

A100 40GB

PERFECT

3.2GB / 40.0GB VRAM +36.8GB

check_circle

Mixtral 8x7B

H100 SXM

PERFECT

23.4GB / 80.0GB VRAM +56.6GB

check_circle

SD 2.1

RTX A4000

PERFECT

5.0GB / 16.0GB VRAM +11.0GB

check_circle

BGE-Large-EN

RTX 3080 Ti

PERFECT

0.7GB / 12.0GB VRAM +11.3GB

cancel

FLUX.1 Dev

RTX 4000 Ada

FAIL/OOM

24.0GB / 20.0GB VRAM -4.0GB

cancel

DeepSeek-Coder-V2

Jetson Orin Nano 8GB

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

check_circle

BGE-M3

RTX A6000

PERFECT

1.0GB / 48.0GB VRAM +47.0GB

cancel

DeepSeek-V2.5

RTX 4070 SUPER

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

cancel

Llama 3.3 70B

RTX A6000

FAIL/OOM

140.0GB / 48.0GB VRAM -92.0GB

cancel

DeepSeek-V3

RTX 4060 Ti 16GB

FAIL/OOM

1342.0GB / 16.0GB VRAM -1326.0GB