Compatibility Reports

check_circle

SD 2.1

RTX 4070

PERFECT

5.0GB / 12.0GB VRAM +7.0GB

check_circle

CLIP ViT-H/14

RTX 4070

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

check_circle

Phi-3 Small 7B

A100 80GB

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

cancel

FLUX.1 Dev

RTX A4000

FAIL/OOM

24.0GB / 16.0GB VRAM -8.0GB

check_circle

Qwen 2.5 14B

H100 SXM

PERFECT

5.6GB / 80.0GB VRAM +74.4GB

cancel

DeepSeek-Coder-V2

RTX 3070

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

cancel

DeepSeek-V2.5

RTX A6000

FAIL/OOM

472.0GB / 48.0GB VRAM -424.0GB

cancel

DeepSeek-Coder-V2

RTX 4060 Ti 16GB

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

cancel

LLaVA 1.6 13B

RTX 3060 12GB

FAIL/OOM

26.0GB / 12.0GB VRAM -14.0GB

cancel

DeepSeek-Coder-V2

Jetson AGX Orin 64GB

FAIL/OOM

472.0GB / 64.0GB VRAM -408.0GB

check_circle

Mistral 7B

RTX 3090

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Phi-3 Small 7B

H100 SXM

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

cancel

DeepSeek-V2.5

RTX 4070 Ti

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

check_circle

SD 2.1

RTX 3090 Ti

PERFECT

5.0GB / 24.0GB VRAM +19.0GB

check_circle

CLIP ViT-L/14

RTX 3080 Ti

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

check_circle

Gemma 2 27B

A100 40GB

PERFECT

27.0GB / 40.0GB VRAM +13.0GB

cancel

Llama 3.3 70B

RX 7800 XT

FAIL/OOM

140.0GB / 16.0GB VRAM -124.0GB

cancel

Llama 3.3 70B

RTX 5000 Ada

FAIL/OOM

140.0GB / 32.0GB VRAM -108.0GB

check_circle

LLaVA 1.6 13B

RTX 6000 Ada

PERFECT

26.0GB / 48.0GB VRAM +22.0GB

thumb_up

LLaVA 1.6 7B

RTX 4080

GOOD

14.0GB / 16.0GB VRAM +2.0GB

check_circle

Mistral 7B

H100 PCIe

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

Mixtral 8x7B

H100 PCIe

PERFECT

18.7GB / 80.0GB VRAM +61.3GB

check_circle

SD 1.5

RTX A4000

PERFECT

4.0GB / 16.0GB VRAM +12.0GB

cancel

DeepSeek-Coder-V2

RX 7800 XT

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB