Compatibility Reports

check_circle

Qwen 2.5 72B

A100 40GB

PERFECT

28.8GB / 40.0GB VRAM +11.2GB

check_circle

Whisper Base

RTX 3060 12GB

PERFECT

0.2GB / 12.0GB VRAM +11.8GB

cancel

Llama 3 70B

RX 7900 XTX

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

check_circle

Qwen 2.5 32B

H100 SXM

PERFECT

32.0GB / 80.0GB VRAM +48.0GB

check_circle

Whisper Base

RTX 4060 Ti 16GB

PERFECT

0.2GB / 16.0GB VRAM +15.8GB

check_circle

Gemma 2 27B

H100 PCIe

PERFECT

27.0GB / 80.0GB VRAM +53.0GB

check_circle

Gemma 2 2B

A100 40GB

PERFECT

4.0GB / 40.0GB VRAM +36.0GB

check_circle

Llama 3.1 8B

RTX 3090

PERFECT

16.0GB / 24.0GB VRAM +8.0GB

check_circle

Phi-3 Small 7B

A100 40GB

PERFECT

14.0GB / 40.0GB VRAM +26.0GB

check_circle

Gemma 2 9B

A100 80GB

PERFECT

18.0GB / 80.0GB VRAM +62.0GB

check_circle

Mistral 7B

A100 80GB

PERFECT

14.0GB / 80.0GB VRAM +66.0GB

cancel

Llama 3.1 70B

RTX 3090

FAIL/OOM

140.0GB / 24.0GB VRAM -116.0GB

check_circle

SD 1.5

Jetson Orin Nano 8GB

PERFECT

4.0GB / 8.0GB VRAM +4.0GB

cancel

Llama 3.1 405B

RTX 4090

FAIL/OOM

810.0GB / 24.0GB VRAM -786.0GB

check_circle

Gemma 2 2B

RTX 3090 Ti

PERFECT

2.0GB / 24.0GB VRAM +22.0GB

check_circle

Mistral 7B

RTX 4090

PERFECT

3.5GB / 24.0GB VRAM +20.5GB

check_circle

Gemma 2 9B

RTX 4090

PERFECT

18.0GB / 24.0GB VRAM +6.0GB

check_circle

Qwen 2.5 7B

A100 80GB

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

Qwen 2.5 7B

A100 80GB

PERFECT

3.5GB / 80.0GB VRAM +76.5GB

check_circle

Mistral 7B

H100 SXM

PERFECT

3.5GB / 80.0GB VRAM +76.5GB

check_circle

Phi-3 Medium 14B

H100 PCIe

PERFECT

28.0GB / 80.0GB VRAM +52.0GB

check_circle

Whisper Medium

RX 7900 XT

PERFECT

1.5GB / 20.0GB VRAM +18.5GB

warning

Mixtral 8x7B

RTX 4090

MARGINAL

23.4GB / 24.0GB VRAM +0.6GB

check_circle

SD 1.5

RTX 4060

PERFECT

4.0GB / 8.0GB VRAM +4.0GB