Compatibility Reports

check_circle

Whisper Medium

A100 80GB

PERFECT

1.5GB / 80.0GB VRAM +78.5GB

check_circle

Whisper Small

RTX 3060 12GB

PERFECT

0.5GB / 12.0GB VRAM +11.5GB

check_circle

Mixtral 8x22B

A100 80GB

PERFECT

70.5GB / 80.0GB VRAM +9.5GB

check_circle

Qwen 2.5 72B

H100 PCIe

PERFECT

28.8GB / 80.0GB VRAM +51.2GB

check_circle

Llama 3.1 70B

A100 40GB

PERFECT

35.0GB / 40.0GB VRAM +5.0GB

check_circle

SDXL 1.0

H100 SXM

PERFECT

8.0GB / 80.0GB VRAM +72.0GB

check_circle

Gemma 2 9B

RTX 3090

PERFECT

3.6GB / 24.0GB VRAM +20.4GB

check_circle

Whisper Base

RX 7900 XTX

PERFECT

0.2GB / 24.0GB VRAM +23.8GB

check_circle

Whisper Small

RTX 4080

PERFECT

0.5GB / 16.0GB VRAM +15.5GB

check_circle

Whisper Small

RTX 4060 Ti 16GB

PERFECT

0.5GB / 16.0GB VRAM +15.5GB

check_circle

Whisper Small

RTX A4000

PERFECT

0.5GB / 16.0GB VRAM +15.5GB

check_circle

Gemma 2 9B

RTX 3090

PERFECT

9.0GB / 24.0GB VRAM +15.0GB

cancel

Llama 3.1 70B

RTX 4090

FAIL/OOM

70.0GB / 24.0GB VRAM -46.0GB

check_circle

Whisper Medium

RX 7800 XT

PERFECT

1.5GB / 16.0GB VRAM +14.5GB

check_circle

Whisper Small

A100 40GB

PERFECT

0.5GB / 40.0GB VRAM +39.5GB

check_circle

Llama 3 8B

RTX 4090

PERFECT

16.0GB / 24.0GB VRAM +8.0GB

check_circle

Whisper Base

A100 40GB

PERFECT

0.2GB / 40.0GB VRAM +39.8GB

check_circle

Llama 3 8B

RTX 3090 Ti

PERFECT

16.0GB / 24.0GB VRAM +8.0GB

check_circle

Llama 3 70B

A100 80GB

PERFECT

70.0GB / 80.0GB VRAM +10.0GB

check_circle

Whisper Small

RX 7900 XT

PERFECT

0.5GB / 20.0GB VRAM +19.5GB

check_circle

Gemma 2 27B

A100 80GB

PERFECT

27.0GB / 80.0GB VRAM +53.0GB

check_circle

Qwen 2.5 7B

H100 SXM

PERFECT

2.8GB / 80.0GB VRAM +77.2GB

check_circle

CLIP ViT-L/14

RX 7900 XTX

PERFECT

1.5GB / 24.0GB VRAM +22.5GB

check_circle

Llama 3.1 8B

H100 PCIe

PERFECT

16.0GB / 80.0GB VRAM +64.0GB