Compatibility Reports

cancel

DeepSeek-V3

H100 PCIe

FAIL/OOM

1342.0GB / 80.0GB VRAM -1262.0GB

cancel

DeepSeek-V2.5

RTX 3090

FAIL/OOM

472.0GB / 24.0GB VRAM -448.0GB

check_circle

CLIP ViT-H/14

RTX 3060 12GB

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

check_circle

Gemma 2 2B

A100 80GB

PERFECT

1.0GB / 80.0GB VRAM +79.0GB

check_circle

Qwen2-VL 7B

RTX A6000

PERFECT

14.0GB / 48.0GB VRAM +34.0GB

cancel

FLUX.1 Dev

RTX 4070 Ti SUPER

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

check_circle

LLaVA 1.6 13B

Jetson AGX Orin 32GB

PERFECT

26.0GB / 32.0GB VRAM +6.0GB

cancel

Qwen2-VL 72B

RTX 4080 SUPER

FAIL/OOM

144.0GB / 16.0GB VRAM -128.0GB

check_circle

Qwen2-VL 7B

RTX A5000

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

cancel

Qwen2-VL 7B

Jetson Orin Nano 8GB

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

DeepSeek-V2.5

Jetson AGX Orin 32GB

FAIL/OOM

472.0GB / 32.0GB VRAM -440.0GB

cancel

DeepSeek-V2.5

RTX 3090 Ti

FAIL/OOM

472.0GB / 24.0GB VRAM -448.0GB

cancel

Qwen2-VL 7B

RTX 3060 Ti

FAIL/OOM

14.0GB / 8.0GB VRAM -6.0GB

cancel

LLaVA 1.6 7B

RTX 3080 12GB

FAIL/OOM

14.0GB / 12.0GB VRAM -2.0GB

cancel

Llama 3.1 70B

RTX 3090 Ti

FAIL/OOM

35.0GB / 24.0GB VRAM -11.0GB

cancel

LLaVA 1.6 13B

RTX 4080 SUPER

FAIL/OOM

26.0GB / 16.0GB VRAM -10.0GB

warning

FLUX.1 Dev

RTX 3090 Ti

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

warning

FLUX.1 Schnell

RTX 3090 Ti

MARGINAL

24.0GB / 24.0GB VRAM +0.0GB

cancel

Mixtral 8x7B

A100 40GB

FAIL/OOM

46.7GB / 40.0GB VRAM -6.7GB

cancel

DeepSeek-Coder-V2

RTX 3090

FAIL/OOM

472.0GB / 24.0GB VRAM -448.0GB

cancel

Qwen2-VL 72B

Jetson Orin Nano 8GB

FAIL/OOM

144.0GB / 8.0GB VRAM -136.0GB

cancel

FLUX.1 Dev

RX 7800 XT

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

cancel

Mixtral 8x22B

A100 80GB

FAIL/OOM

141.0GB / 80.0GB VRAM -61.0GB

check_circle

Qwen2-VL 7B

Jetson AGX Orin 64GB

PERFECT

14.0GB / 64.0GB VRAM +50.0GB