Compatibility Reports

check_circle

Whisper Large v3

A100 80GB

PERFECT

3.0GB / 80.0GB VRAM +77.0GB

check_circle

Phi-3 Medium 14B

RTX 4090

PERFECT

5.6GB / 24.0GB VRAM +18.4GB

cancel

Mixtral 8x7B

RTX 4090

FAIL/OOM

46.7GB / 24.0GB VRAM -22.7GB

check_circle

Phi-3 Medium 14B

A100 40GB

PERFECT

28.0GB / 40.0GB VRAM +12.0GB

check_circle

Gemma 2 2B

RTX 3090 Ti

PERFECT

4.0GB / 24.0GB VRAM +20.0GB

check_circle

Phi-3 Medium 14B

RTX 3090 Ti

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Llama 3.1 8B

RTX 3090 Ti

PERFECT

16.0GB / 24.0GB VRAM +8.0GB

check_circle

Gemma 2 27B

RTX 4090

PERFECT

13.5GB / 24.0GB VRAM +10.5GB

check_circle

Whisper Base

RTX 3080 12GB

PERFECT

0.2GB / 12.0GB VRAM +11.8GB

check_circle

Qwen 2.5 7B

RTX 3090 Ti

PERFECT

2.8GB / 24.0GB VRAM +21.2GB

check_circle

SDXL 1.0

RX 7800 XT

PERFECT

8.0GB / 16.0GB VRAM +8.0GB

check_circle

Mixtral 8x22B

H100 PCIe

PERFECT

70.5GB / 80.0GB VRAM +9.5GB

check_circle

SD 2.1

RTX 4070 SUPER

PERFECT

5.0GB / 12.0GB VRAM +7.0GB

check_circle

Qwen 2.5 32B

H100 PCIe

PERFECT

64.0GB / 80.0GB VRAM +16.0GB

check_circle

Llama 3.1 8B

H100 SXM

PERFECT

3.2GB / 80.0GB VRAM +76.8GB

check_circle

Mistral 7B

H100 SXM

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

Phi-3 Small 7B

RTX 3090 Ti

PERFECT

14.0GB / 24.0GB VRAM +10.0GB

check_circle

Qwen 2.5 7B

H100 PCIe

PERFECT

7.0GB / 80.0GB VRAM +73.0GB

check_circle

BGE-M3

RTX 4060

PERFECT

1.0GB / 8.0GB VRAM +7.0GB

check_circle

Phi-3 Small 7B

A100 40GB

PERFECT

3.5GB / 40.0GB VRAM +36.5GB

check_circle

Qwen 2.5 32B

H100 SXM

PERFECT

64.0GB / 80.0GB VRAM +16.0GB

check_circle

Qwen 2.5 7B

A100 40GB

PERFECT

2.8GB / 40.0GB VRAM +37.2GB

check_circle

SDXL 1.0

RTX 4060 Ti 16GB

PERFECT

8.0GB / 16.0GB VRAM +8.0GB

check_circle

Whisper Base

RTX 6000 Ada

PERFECT

0.2GB / 48.0GB VRAM +47.8GB