Compatibility Reports

check_circle

CLIP ViT-L/14

Jetson AGX Orin 32GB

PERFECT

1.5GB / 32.0GB VRAM +30.5GB

cancel

Mistral Large 2

RTX 4000 Ada

FAIL/OOM

246.0GB / 20.0GB VRAM -226.0GB

warning

FLUX.1 Dev

RTX A5000

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

cancel

Qwen 2.5 72B

RTX 3090 Ti

FAIL/OOM

144.0GB / 24.0GB VRAM -120.0GB

cancel

Llama 3.3 70B

RTX 4060 Ti 8GB

FAIL/OOM

140.0GB / 8.0GB VRAM -132.0GB

cancel

Mixtral 8x22B

H100 PCIe

FAIL/OOM

282.0GB / 80.0GB VRAM -202.0GB

cancel

DeepSeek-V2.5

RX 7800 XT

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

check_circle

Mistral 7B

RTX 3090

PERFECT

3.5GB / 24.0GB VRAM +20.5GB

check_circle

BGE-M3

RTX 6000 Ada

PERFECT

1.0GB / 48.0GB VRAM +47.0GB

check_circle

BGE-M3

RTX 4080 SUPER

PERFECT

1.0GB / 16.0GB VRAM +15.0GB

cancel

Mistral Large 2

RTX 4060 Ti 16GB

FAIL/OOM

246.0GB / 16.0GB VRAM -230.0GB

cancel

LLaVA 1.6 7B

Jetson Orin Nano 8GB

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

LLaVA 1.6 34B

RTX 4000 Ada

FAIL/OOM

68.0GB / 20.0GB VRAM -48.0GB

check_circle

SD 3 Medium

RTX 3060 12GB

PERFECT

6.0GB / 12.0GB VRAM +6.0GB

cancel

LLaVA 1.6 13B

RTX 3070 Ti

FAIL/OOM

26.0GB / 8.0GB VRAM -18.0GB

check_circle

Qwen 2.5 32B

A100 40GB

PERFECT

32.0GB / 40.0GB VRAM +8.0GB

cancel

LLaVA 1.6 34B

RTX 4080

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB

cancel

DeepSeek-V2.5

RTX 3060 12GB

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

cancel

LLaVA 1.6 13B

RTX 3080 Ti

FAIL/OOM

26.0GB / 12.0GB VRAM -14.0GB

check_circle

SD 1.5

RTX 5000 Ada

PERFECT

4.0GB / 32.0GB VRAM +28.0GB

check_circle

Qwen 2.5 14B

H100 PCIe

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

check_circle

Phi-3 Medium 14B

H100 SXM

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

CLIP ViT-L/14

RTX 3060 12GB

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Llama 3 8B

RTX 3090

PERFECT

3.2GB / 24.0GB VRAM +20.8GB