Compatibility Reports

thumb_up

LLaVA 1.6 7B

RTX 4070 Ti SUPER

GOOD

14.0GB / 16.0GB VRAM +2.0GB

cancel

Llama 3.3 70B

RTX 3060 12GB

FAIL/OOM

140.0GB / 12.0GB VRAM -128.0GB

cancel

Mixtral 8x22B

RTX 3090

FAIL/OOM

70.5GB / 24.0GB VRAM -46.5GB

check_circle

LLaVA 1.6 13B

RTX A6000

PERFECT

26.0GB / 48.0GB VRAM +22.0GB

check_circle

BGE-Small-EN

RTX 4060 Ti 16GB

PERFECT

0.1GB / 16.0GB VRAM +15.9GB

check_circle

BGE-Small-EN

RTX 4060 Ti 8GB

PERFECT

0.1GB / 8.0GB VRAM +7.9GB

check_circle

Phi-3 Small 7B

H100 SXM

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

Gemma 2 9B

RTX 4090

PERFECT

4.5GB / 24.0GB VRAM +19.5GB

check_circle

Llama 3 8B

H100 SXM

PERFECT

3.2GB / 80.0GB VRAM +76.8GB

check_circle

Phi-3 Small 7B

H100 PCIe

PERFECT

3.5GB / 80.0GB VRAM +76.5GB

check_circle

Phi-3 Small 7B

RTX 3090 Ti

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

check_circle

Mistral 7B

H100 SXM

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

Llama 3.1 8B

H100 PCIe

PERFECT

3.2GB / 80.0GB VRAM +76.8GB

check_circle

CLIP ViT-L/14

RTX 3060 Ti

PERFECT

1.5GB / 8.0GB VRAM +6.5GB

check_circle

Phi-3 Mini 3.8B

A100 40GB

PERFECT

1.9GB / 40.0GB VRAM +38.1GB

cancel

FLUX.1 Schnell

Jetson Orin Nano 8GB

FAIL/OOM

24.0GB / 8.0GB VRAM -16.0GB

check_circle

SD 2.1

RTX 4080 SUPER

PERFECT

5.0GB / 16.0GB VRAM +11.0GB

check_circle

BGE-Small-EN

RTX 3070

PERFECT

0.1GB / 8.0GB VRAM +7.9GB

check_circle

Qwen 2.5 14B

H100 SXM

PERFECT

28.0GB / 80.0GB VRAM +52.0GB

cancel

DeepSeek-V2.5

RTX A4000

FAIL/OOM

472.0GB / 16.0GB VRAM -456.0GB

check_circle

Gemma 2 2B

RTX 4090

PERFECT

0.8GB / 24.0GB VRAM +23.2GB

cancel

DeepSeek-Coder-V2

RTX 3060 Ti

FAIL/OOM

472.0GB / 8.0GB VRAM -464.0GB

check_circle

LLaVA 1.6 13B

RTX 5000 Ada

PERFECT

26.0GB / 32.0GB VRAM +6.0GB

cancel

DeepSeek-V3

RTX 3070

FAIL/OOM

1342.0GB / 8.0GB VRAM -1334.0GB