Compatibility Reports

check_circle

BGE-M3

Jetson AGX Orin 32GB

PERFECT

1.0GB / 32.0GB VRAM +31.0GB

check_circle

LLaVA 1.6 34B

A100 80GB

PERFECT

68.0GB / 80.0GB VRAM +12.0GB

cancel

Llama 3.1 405B

RTX 3090 Ti

FAIL/OOM

162.0GB / 24.0GB VRAM -138.0GB

check_circle

SD 2.1

RTX 3080 10GB

PERFECT

5.0GB / 10.0GB VRAM +5.0GB

cancel

Mistral Large 2

RTX 3060 12GB

FAIL/OOM

246.0GB / 12.0GB VRAM -234.0GB

cancel

DeepSeek-V2.5

RTX 4080 SUPER

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

cancel

Mixtral 8x22B

RTX 4090

FAIL/OOM

56.4GB / 24.0GB VRAM -32.4GB

cancel

FLUX.1 Schnell

RX 7800 XT

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

cancel

Llama 3 70B

RTX 3090 Ti

FAIL/OOM

28.0GB / 24.0GB VRAM -4.0GB

check_circle

SD 1.5

RTX 4070

PERFECT

4.0GB / 12.0GB VRAM +8.0GB

check_circle

CLIP ViT-H/14

RX 7900 XT

PERFECT

2.0GB / 20.0GB VRAM +18.0GB

cancel

LLaVA 1.6 7B

RTX 4070

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

LLaVA 1.6 13B

RTX 4070 Ti SUPER

FAIL/OOM

26.0GB / 16.0GB VRAM -10.0GB

check_circle

CLIP ViT-H/14

RTX A6000

PERFECT

2.0GB / 48.0GB VRAM +46.0GB

cancel

DeepSeek-V3

RTX A5000

FAIL/OOM

1342.0GB / 24.0GB VRAM -1318.0GB

warning

SDXL 1.0

RTX 4060 Ti 8GB

MARGINAL

8.0GB / 8.0GB VRAM +0.0GB

cancel

Mixtral 8x22B

RTX 3090

FAIL/OOM

56.4GB / 24.0GB VRAM -32.4GB

cancel

FLUX.1 Dev

RTX 4070 Ti

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

check_circle

CLIP ViT-H/14

RTX 3080 12GB

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

cancel

DeepSeek-Coder-V2

RTX 4070 Ti

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

cancel

FLUX.1 Schnell

RTX 4080 SUPER

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

warning

FLUX.1 Schnell

RX 7900 XTX

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

check_circle

BGE-Large-EN

RTX 4080

PERFECT

0.7GB / 16.0GB VRAM +15.3GB

cancel

DeepSeek-Coder-V2

RTX 3080 10GB

FAIL/OOM

472.0GB / 10.0GB VRAM -462.0GB