Compatibility Reports

check_circle

Mistral 7B

H100 PCIe

PERFECT

3.5GB / 80.0GB VRAM +76.5GB

thumb_up

LLaVA 1.6 7B

RTX 4080 SUPER

GOOD

14.0GB / 16.0GB VRAM +2.0GB

check_circle

Llama 3.1 8B

H100 SXM

PERFECT

16.0GB / 80.0GB VRAM +64.0GB

cancel

Qwen 2.5 32B

RTX 3090

FAIL/OOM

64.0GB / 24.0GB VRAM -40.0GB

check_circle

Mixtral 8x22B

H100 SXM

PERFECT

56.4GB / 80.0GB VRAM +23.6GB

check_circle

CLIP ViT-L/14

RTX 4080

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

check_circle

BGE-Large-EN

RTX 4060 Ti 8GB

PERFECT

0.7GB / 8.0GB VRAM +7.3GB

check_circle

Gemma 2 2B

RTX 3090

PERFECT

0.8GB / 24.0GB VRAM +23.2GB

check_circle

Llama 3 70B

H100 SXM

PERFECT

35.0GB / 80.0GB VRAM +45.0GB

cancel

Llama 3.1 70B

RTX 3090 Ti

FAIL/OOM

70.0GB / 24.0GB VRAM -46.0GB

check_circle

Llama 3.1 8B

A100 40GB

PERFECT

8.0GB / 40.0GB VRAM +32.0GB

check_circle

Qwen 2.5 14B

RTX 3090 Ti

PERFECT

5.6GB / 24.0GB VRAM +18.4GB

check_circle

Phi-3 Small 7B

RTX 3090 Ti

PERFECT

3.5GB / 24.0GB VRAM +20.5GB

cancel

Mixtral 8x22B

RTX 3090 Ti

FAIL/OOM

282.0GB / 24.0GB VRAM -258.0GB

cancel

Llama 3 70B

RTX 3090 Ti

FAIL/OOM

70.0GB / 24.0GB VRAM -46.0GB

cancel

Llama 3.3 70B

RTX 4080

FAIL/OOM

140.0GB / 16.0GB VRAM -124.0GB

check_circle

FLUX.1 Schnell

RTX 6000 Ada

PERFECT

24.0GB / 48.0GB VRAM +24.0GB

check_circle

Phi-3 Medium 14B

H100 SXM

PERFECT

28.0GB / 80.0GB VRAM +52.0GB

check_circle

Qwen 2.5 14B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

check_circle

Phi-3 Medium 14B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

check_circle

Gemma 2 9B

A100 40GB

PERFECT

4.5GB / 40.0GB VRAM +35.5GB

check_circle

Gemma 2 9B

RTX 3090 Ti

PERFECT

3.6GB / 24.0GB VRAM +20.4GB

cancel

Llama 3 70B

RTX 3090 Ti

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

check_circle

Mixtral 8x22B

H100 PCIe

PERFECT

56.4GB / 80.0GB VRAM +23.6GB