Compatibility Reports

cancel

Llama 3.3 70B

RTX 4060 Ti 16GB

FAIL/OOM

140.0GB / 16.0GB VRAM -124.0GB

check_circle

CLIP ViT-H/14

RTX 3080 Ti

PERFECT

2.0GB / 12.0GB VRAM +10.0GB

cancel

Mistral Large 2

RTX A6000

FAIL/OOM

246.0GB / 48.0GB VRAM -198.0GB

check_circle

CLIP ViT-L/14

RTX A5000

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

cancel

Mistral Large 2

Jetson AGX Orin 64GB

FAIL/OOM

246.0GB / 64.0GB VRAM -182.0GB

check_circle

Gemma 2 2B

A100 80GB

PERFECT

2.0GB / 80.0GB VRAM +78.0GB

check_circle

Gemma 2 27B

H100 SXM

PERFECT

54.0GB / 80.0GB VRAM +26.0GB

check_circle

BGE-M3

RTX 5000 Ada

PERFECT

1.0GB / 32.0GB VRAM +31.0GB

cancel

FLUX.1 Schnell

RTX 4070

FAIL/OOM

24.0GB / 12.0GB VRAM -12.0GB

check_circle

BGE-M3

RTX 3060 12GB

PERFECT

1.0GB / 12.0GB VRAM +11.0GB

cancel

Mixtral 8x22B

RTX 4090

FAIL/OOM

70.5GB / 24.0GB VRAM -46.5GB

cancel

LLaVA 1.6 34B

RTX A5000

FAIL/OOM

68.0GB / 24.0GB VRAM -44.0GB

check_circle

LLaVA 1.6 7B

RTX A6000

PERFECT

14.0GB / 48.0GB VRAM +34.0GB

check_circle

Llama 3 8B

A100 80GB

PERFECT

3.2GB / 80.0GB VRAM +76.8GB

check_circle

Mistral 7B

RTX 3090

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

check_circle

Phi-3 Small 7B

RTX 3090

PERFECT

3.5GB / 24.0GB VRAM +20.5GB

check_circle

SD 1.5

RX 7800 XT

PERFECT

4.0GB / 16.0GB VRAM +12.0GB

cancel

DeepSeek-Coder-V2

RTX 4000 Ada

FAIL/OOM

472.0GB / 20.0GB VRAM -452.0GB

check_circle

Llama 3 8B

H100 PCIe

PERFECT

8.0GB / 80.0GB VRAM +72.0GB

cancel

Llama 3.1 405B

A100 40GB

FAIL/OOM

162.0GB / 40.0GB VRAM -122.0GB

check_circle

BGE-M3

RTX 4070

PERFECT

1.0GB / 12.0GB VRAM +11.0GB

check_circle

CLIP ViT-L/14

RTX 3060 12GB

PERFECT

1.5GB / 12.0GB VRAM +10.5GB

cancel

DeepSeek-Coder-V2

RTX 3060 12GB

FAIL/OOM

472.0GB / 12.0GB VRAM -460.0GB

cancel

LLaVA 1.6 34B

RTX 4080

FAIL/OOM

68.0GB / 16.0GB VRAM -52.0GB